-- Logs begin at Mon 2022-06-27 17:38:13 UTC, end at Mon 2022-06-27 19:05:57 UTC. -- Jun 27 18:31:44.248332 dv-cinder-844601-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 27 18:31:44.256712 dv-cinder-844601-6-smb devstack@keystone.service[86858]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 27 18:31:44.258696 dv-cinder-844601-6-smb devstack@keystone.service[86858]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 18:31:44 2022] *** Jun 27 18:31:44.258696 dv-cinder-844601-6-smb devstack@keystone.service[86858]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 18:31:44.258696 dv-cinder-844601-6-smb devstack@keystone.service[86858]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 18:31:44.258696 dv-cinder-844601-6-smb devstack@keystone.service[86858]: nodename: dv-cinder-844601-6-smb Jun 27 18:31:44.258696 dv-cinder-844601-6-smb devstack@keystone.service[86858]: machine: x86_64 Jun 27 18:31:44.258696 dv-cinder-844601-6-smb devstack@keystone.service[86858]: clock source: unix Jun 27 18:31:44.258696 dv-cinder-844601-6-smb devstack@keystone.service[86858]: pcre jit disabled Jun 27 18:31:44.258696 dv-cinder-844601-6-smb devstack@keystone.service[86858]: detected number of CPU cores: 4 Jun 27 18:31:44.258696 dv-cinder-844601-6-smb devstack@keystone.service[86858]: current working directory: / Jun 27 18:31:44.258696 dv-cinder-844601-6-smb devstack@keystone.service[86858]: detected binary path: /usr/bin/uwsgi-core Jun 27 18:31:44.258696 dv-cinder-844601-6-smb devstack@keystone.service[86858]: your processes number limit is 47680 Jun 27 18:31:44.259282 dv-cinder-844601-6-smb devstack@keystone.service[86858]: your memory page size is 4096 bytes Jun 27 18:31:44.259282 dv-cinder-844601-6-smb devstack@keystone.service[86858]: detected max file descriptor number: 2048 Jun 27 18:31:44.259282 dv-cinder-844601-6-smb devstack@keystone.service[86858]: lock engine: pthread robust mutexes Jun 27 18:31:44.259282 dv-cinder-844601-6-smb devstack@keystone.service[86858]: thunder lock: enabled Jun 27 18:31:44.259282 dv-cinder-844601-6-smb devstack@keystone.service[86858]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 27 18:31:44.259282 dv-cinder-844601-6-smb devstack@keystone.service[86858]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 18:31:44.303458 dv-cinder-844601-6-smb devstack@keystone.service[86858]: Python main interpreter initialized at 0x5621ada939c0 Jun 27 18:31:44.303458 dv-cinder-844601-6-smb devstack@keystone.service[86858]: python threads support enabled Jun 27 18:31:44.303458 dv-cinder-844601-6-smb devstack@keystone.service[86858]: your server socket listen backlog is limited to 100 connections Jun 27 18:31:44.303458 dv-cinder-844601-6-smb devstack@keystone.service[86858]: your mercy for graceful operations on workers is 90 seconds Jun 27 18:31:44.303805 dv-cinder-844601-6-smb devstack@keystone.service[86858]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 18:31:44.303881 dv-cinder-844601-6-smb devstack@keystone.service[86858]: *** Operational MODE: preforking *** Jun 27 18:31:44.304160 dv-cinder-844601-6-smb devstack@keystone.service[86858]: *** uWSGI is running in multiple interpreter mode *** Jun 27 18:31:44.304160 dv-cinder-844601-6-smb devstack@keystone.service[86858]: spawned uWSGI master process (pid: 86858) Jun 27 18:31:44.304356 dv-cinder-844601-6-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 27 18:31:44.305961 dv-cinder-844601-6-smb devstack@keystone.service[86858]: spawned uWSGI worker 1 (pid: 86869, cores: 1) Jun 27 18:31:44.305961 dv-cinder-844601-6-smb devstack@keystone.service[86858]: spawned uWSGI worker 2 (pid: 86870, cores: 1) Jun 27 18:31:44.305961 dv-cinder-844601-6-smb devstack@keystone.service[86858]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 18:31:49.798068 dv-cinder-844601-6-smb devstack@keystone.service[86869]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 18:31:49.798068 dv-cinder-844601-6-smb devstack@keystone.service[86869]: from cryptography.utils import int_from_bytes Jun 27 18:31:49.798824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 18:31:49.798824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: from cryptography.utils import int_from_bytes Jun 27 18:31:49.798948 dv-cinder-844601-6-smb devstack@keystone.service[86870]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 18:31:49.798948 dv-cinder-844601-6-smb devstack@keystone.service[86870]: from cryptography.utils import int_from_bytes Jun 27 18:31:49.798948 dv-cinder-844601-6-smb devstack@keystone.service[86870]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 18:31:49.798948 dv-cinder-844601-6-smb devstack@keystone.service[86870]: from cryptography.utils import int_from_bytes Jun 27 18:31:49.846409 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 18:31:49.846603 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 18:31:49.846796 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] command line args: [] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 18:31:49.846914 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 18:31:49.847069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 18:31:49.847155 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 18:31:49.847235 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ================================================================================ {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 18:31:49.847319 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] command line args: [] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 18:31:49.847491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] admin_token = **** {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.847610 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 18:31:49.847745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ================================================================================ {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 18:31:49.847826 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] config_dir = [] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.847937 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.848027 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] admin_token = **** {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.848107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] config_source = [] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.848235 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] config_dir = [] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.848314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] debug = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.848428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.848517 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.848707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] config_source = [] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.848772 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] debug = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.848838 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.848979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.849120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.849226 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.849325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.849427 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.849530 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.849632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.849738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] list_limit = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.849841 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] log_config_append = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.849948 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.850046 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.850148 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] list_limit = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.850253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] log_dir = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.850374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] log_config_append = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.850473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] log_file = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.850569 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.850674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.850754 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] log_dir = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.850754 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] log_file = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.850943 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.851063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.851138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.851254 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.851330 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.851456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.851576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.851664 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.851745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.851872 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.851955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.852036 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.852161 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.852262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.852342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.852496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.852615 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.852730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.852816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.852962 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.853077 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.853203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.853281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.853442 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.853568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.853689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.853805 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.853926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.854182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.854296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.854417 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] publish_errors = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.854589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.854768 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.36/identity {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.854887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.855007 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] publish_errors = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.855140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.855268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.855384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.855504 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.855504 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.855777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.855777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] standard_threads = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.856010 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.856132 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.856247 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.856368 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.856491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] standard_threads = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.856614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.856729 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.856843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] use_journal = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.856963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.857084 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] use_json = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.857200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.857322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] use_stderr = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.857438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] use_journal = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.858351 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] use_syslog = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.858472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] use_json = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.858588 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.858709 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] use_stderr = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.858901 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.859019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] use_syslog = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.859139 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.859255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 18:31:49.859369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.859483 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.859631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.859754 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.859870 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.859990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.860112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.860228 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.860351 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.860466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.860587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.860703 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.860824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.860945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.861069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.861184 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.861303 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.861425 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.861541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.861656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.861786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.861903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.862025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.862140 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.862253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.862383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.862505 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.862621 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.862743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.862858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.862973 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.863095 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.863217 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.863338 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.863459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.863607 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.863725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.863853 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.863970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.864084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.864198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.864318 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.864439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.864624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.864742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.864858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.864972 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.865087 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.865201 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.865324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.865440 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.865554 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.865669 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.865789 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.865911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.866040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.866156 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.866276 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.866392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.866511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.866627 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.866750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.866871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.866987 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.867107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.867223 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.867336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.867462 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.867606 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.867722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.867846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.867968 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.868084 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.868207 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.868322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.868436 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.868550 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.868694 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.868803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.868909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.869008 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.869111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.869209 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.869306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.869412 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.869525 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.869624 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.869727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.869845 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.869967 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.870095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.870095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.870319 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.870441 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.870559 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.870675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.870789 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.870789 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.871003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.871003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.871222 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.871341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.871457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.871609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.871740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.871857 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.871973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.872088 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.872211 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.872328 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.872455 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.872573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.872688 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.872802 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.872918 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.873042 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.873221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.873328 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.873443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.873558 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.873682 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.873801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.873925 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.874043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.874159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.874265 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.874380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.874504 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.874633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.874751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.874867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.874983 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.875099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.875223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.875349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.875473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.875659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.875778 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.875900 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.876017 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.876206 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.876332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.876450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.876566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.876681 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.876797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.876924 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.877047 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.877164 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.877280 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.877396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.877513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.877641 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.877771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.877890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.878005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.878121 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.878237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.878353 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.878477 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.878594 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.878710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.878825 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.878947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.879070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.879195 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.879313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.879428 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.879559 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.879678 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.879794 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.879926 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.880045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.880161 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.880277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.880392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.880392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.880618 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.880736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.880852 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.880967 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.881082 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.881198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.881325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.881443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.881558 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.881681 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.881798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.881914 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.882037 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.882154 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.882270 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.882385 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.882500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.882622 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.882752 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.882869 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.882985 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.882985 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.883208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.883208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.883442 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.883584 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] auth.external = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.883703 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.883819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.883934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.884050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.884179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.884303 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.884419 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.884535 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] auth.password = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.884680 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] auth.external = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.884814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] auth.token = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.884932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.885048 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.885173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.885292 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.885408 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.885524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.885631 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] auth.password = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.885746 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.885872 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] auth.token = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.885989 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.886111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.886229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.886353 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.886472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.886605 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.886724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] credential.caching = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.886848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.886968 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.887084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.887200 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.887324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.887448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.887605 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.887725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.887841 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] credential.caching = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.887958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.888087 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.888207 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.888323 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.888440 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.888555 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.888691 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.888810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.888926 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.889050 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.889168 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.889284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.889408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.889526 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.889643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.889759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.889875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.889999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.890189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.890309 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.890426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.890543 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.890659 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] federation.caching = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.890776 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.890900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.891018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.891136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.891252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.891370 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.891489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.891640 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.891759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] federation.caching = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.891875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.891992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.892110 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.892232 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.892362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.892480 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.892596 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.892718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.892836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.892952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.893077 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.893196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.893317 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.893435 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.893551 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] identity.caching = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.893668 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.893792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.893916 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.894033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.894149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.894266 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.894382 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.894507 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.894625 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] identity.caching = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.894741 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.894856 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.894972 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.894972 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.895198 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.895317 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.895433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.895433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.895698 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.895698 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.895941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.896059 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.896176 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.896293 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.896410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.896526 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.896657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.896784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.896902 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.897018 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.897134 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.897250 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.897377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.897495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.897611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.897611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.897829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.897829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.898058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.898175 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.898292 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.898410 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.898526 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.898651 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.898770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.898887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.898993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.899108 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.899224 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.899349 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.899469 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.899632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.899752 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.899868 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.899985 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.900113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.900232 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.900348 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.900464 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.900582 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.900698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.900823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.900940 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.901056 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.901173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.901289 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.901409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.901534 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.901652 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.901769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.901885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.902001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.902117 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.902246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.902365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.902481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.902598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.902715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.902831 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.902955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.903073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.903190 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.903306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.903423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.903553 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.903685 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.903812 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.903931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.904047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.904164 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.904279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.904888 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.905007 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.905123 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.905240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.905357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.905473 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.905598 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.905715 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.905833 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.905949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.906065 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.906189 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.906315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.906434 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.906551 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.906668 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.906785 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.906901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.907025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.907143 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.907260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.907376 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.907492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.907652 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.907786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.907912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.908030 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.908448 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.908572 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.908688 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.908813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.908933 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.909050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.909050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.909269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.909385 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.909510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.909510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.909730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.909846 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.909963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.910079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.910203 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.910321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.910437 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.910552 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.910668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.910784 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.910908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.911026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.911142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.911142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.911364 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.911480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.911625 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.911744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.911860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.911977 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.912094 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.912218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.912342 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.912459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.912576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.912693 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.912808 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.912933 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.913051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.913168 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.913283 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.913400 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.913521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.913714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.913834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.913951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.914068 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.914185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.914302 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.914426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.914545 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.914661 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.914778 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.914894 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.915010 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.915135 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] resource.caching = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.915254 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.915371 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.915493 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.915629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.915747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.915875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.915993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.916110 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.916227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.916343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.916459 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.916587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.916706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] resource.caching = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.916823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.916939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.917062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.917179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.917305 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.917423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.917540 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] role.caching = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.917657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.917773 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] role.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.917890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.918014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.918133 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.918255 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.918373 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.918490 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.918613 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.918746 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.918865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.918982 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.919102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] role.caching = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.919219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.919335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] role.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.919461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.919631 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.919751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.919867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.920014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.920641 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.920775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.920894 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.921010 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.921127 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.921243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.921364 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.921491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.921610 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.921726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.921842 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.921958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.922074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.922199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.922317 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.922434 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.922551 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.922668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.922793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.922912 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.923029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.923145 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.923269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.923392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.923522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.923659 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.923776 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.923893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.924009 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.924127 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.924255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.924374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.924491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.924608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.924608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.924827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.924827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.925057 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.925173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.925289 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.925289 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.925508 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.925632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.925751 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.925868 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.925984 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.926101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.926217 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.926341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] token.caching = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.926459 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.926575 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.926691 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.926808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.926924 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.927048 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.927166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.927282 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.927399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.927514 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.927651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.927782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.927900 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.928016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.928133 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] token.caching = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.928249 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.928365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.928489 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.928607 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.928724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.928841 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.928957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.929073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.929198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.929316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.929432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.929548 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.929665 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.929780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.929906 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.930024 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.930140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.930256 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.930372 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.930488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.930616 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.connection = **** {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.930743 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.930871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.930990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.931106 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.931223 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.931343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.931469 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.931641 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.931760 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.931877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.931994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.932110 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.932238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.932357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.932474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.connection = **** {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.932600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.932726 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.932844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.932961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.933149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.933270 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.933387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.933504 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.933620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.933737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.933862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.933981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.934100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.934217 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.934334 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.934452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.934577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.934696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.934814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.934931 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.935047 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.935047 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86869) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 18:31:49.935277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.935277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.935277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.935277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.935277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.935277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.935277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.935277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 18:31:49.935277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86870) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 18:31:49.961353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:49.961582 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:49.961814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:49.962384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:49.962622 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:49.962854 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:49.970705 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:49.971850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:49.998736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:49.998964 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:49.999810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.000044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.140126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.140363 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.188316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.188546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.189019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.189258 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.252070 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.252294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.252465 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.252551 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.252700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.252783 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.252944 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.253028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.253131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.253216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.253346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.253565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.277694 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.277929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.278061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.278149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.278295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.278380 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.278519 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.278601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.278737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.278829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.278953 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.279036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.279165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.279939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.290508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.290763 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.302980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.303209 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.303430 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.303512 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.303675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.303758 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.303892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.303973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.304106 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.304196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.304317 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86869) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.304398 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.304535 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.304750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86870) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 27 18:31:50.321320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.321529 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 18:31:50.321650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.321878 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.321967 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 18:31:50.322068 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 18:31:50.322196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.322334 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.322414 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 27 18:31:50.322591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.322671 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.322847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.322941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.323099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.323179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.323390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.334360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.334635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.334748 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.334900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.335028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.335179 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.335298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.335606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.344009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.344466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.347250 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.347545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.347756 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.347839 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.348037 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.348119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.348321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.348410 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.348602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.348685 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.348865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.348945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.349134 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.349221 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.349397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.349476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.349663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.349743 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.349925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.350006 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.350190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.350454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.376544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.377249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.378139 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.378417 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.378860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.379141 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.383636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.384026 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.384306 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.384413 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.384803 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.385086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.392187 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.392420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.393433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.393712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.396873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.397155 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.397430 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.397704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.397973 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.398242 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.398382 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.398509 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.398669 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.398773 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.398952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.399235 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.399513 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.399814 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.400082 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.400352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.417803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.418075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.419503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.419804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.422615 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.424344 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.426252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.426644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.427983 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.428381 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.431613 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.433378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.435192 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.437038 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.438832 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.439127 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.439407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.439708 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.439992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.440274 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.440700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.440997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.441278 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.441567 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.441847 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.442135 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.459687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.459963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.460223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.460480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.461702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.461987 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.462256 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.462520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.468956 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.470647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.470916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.470999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.472724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.473056 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.474174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.474469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.474767 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.475071 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.475366 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.476486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.476771 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.477052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.477334 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.477610 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.489736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.490014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.490291 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.490569 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.491317 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.491620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.491904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.492153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.492247 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.492448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.492758 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.493761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.494059 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.494381 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.510978 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.512838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.514796 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.516890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.518119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.519844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.520244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.521453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.521727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.521955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.522037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.523607 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.523893 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.524188 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.529316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.530883 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.531591 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.533192 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.534128 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.534413 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.534804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.535075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.536433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.536724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.537119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.537399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.544146 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.544432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.544709 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.546513 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.546798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.547079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.552540 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86869) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.552815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.553089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.553360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.553628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.553991 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.554271 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.554546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.554824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.555009 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86870) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 27 18:31:50.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.555288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.555383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.555585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.555679 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.555865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.555957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.556130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86869) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.556247 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.556510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.556796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.557082 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.557355 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.557640 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.557912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.558174 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.558460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.558721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86870) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 27 18:31:50.594427 dv-cinder-844601-6-smb devstack@keystone.service[86869]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5621ada939c0 pid: 86869 (default app) Jun 27 18:31:50.597440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5621ada939c0 pid: 86870 (default app) Jun 27 18:31:50.597828 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f2aa5-9b07-4a3d-b3da-6670fa1ba300 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:31:50.598119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f2aa5-9b07-4a3d-b3da-6670fa1ba300 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:31:50.598397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f2aa5-9b07-4a3d-b3da-6670fa1ba300 None None] PATH_INFO: `/v3` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:31:50.602538 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 791 bytes} [Mon Jun 27 18:31:50 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:31:59.257861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5009941-b596-4e5a-8213-03e6ec4288d1 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:31:59.258443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5009941-b596-4e5a-8213-03e6ec4288d1 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:31:59.258443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5009941-b596-4e5a-8213-03e6ec4288d1 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:31:59.262752 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1/2] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:31:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:31:59.268112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a62dbf-05d8-416b-bfa6-7e85ba34a729 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:31:59.268523 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a62dbf-05d8-416b-bfa6-7e85ba34a729 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:31:59.268658 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a62dbf-05d8-416b-bfa6-7e85ba34a729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:31:59.336643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: INFO dbcounter [None req-90a62dbf-05d8-416b-bfa6-7e85ba34a729 None None] Registered counter for database keystone Jun 27 18:31:59.357665 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG oslo_db.sqlalchemy.engines [None req-90a62dbf-05d8-416b-bfa6-7e85ba34a729 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86869) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:31:59.363985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writer thread running {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:31:59.539179 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG passlib.handlers.bcrypt [None req-90a62dbf-05d8-416b-bfa6-7e85ba34a729 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86869) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 27 18:31:59.539643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG passlib.handlers.bcrypt [None req-90a62dbf-05d8-416b-bfa6-7e85ba34a729 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86869) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 27 18:31:59.593769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-90a62dbf-05d8-416b-bfa6-7e85ba34a729 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:31:59.595370 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-90a62dbf-05d8-416b-bfa6-7e85ba34a729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:31:59.715078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:31:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 27 18:31:59.869738 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5009941-b596-4e5a-8213-03e6ec4288d1 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:31:59.940058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: INFO dbcounter [None req-c5009941-b596-4e5a-8213-03e6ec4288d1 None None] Registered counter for database keystone Jun 27 18:31:59.959376 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG oslo_db.sqlalchemy.engines [None req-c5009941-b596-4e5a-8213-03e6ec4288d1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86870) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 18:31:59.965574 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writer thread running {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 18:32:00.085489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5009941-b596-4e5a-8213-03e6ec4288d1 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:00.089818 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633babc5-1d0f-42a5-b30b-92eec04c447c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:00.090477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633babc5-1d0f-42a5-b30b-92eec04c447c admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:00.090765 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633babc5-1d0f-42a5-b30b-92eec04c447c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:00.091047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633babc5-1d0f-42a5-b30b-92eec04c447c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:00.099804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633babc5-1d0f-42a5-b30b-92eec04c447c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:00.179372 dv-cinder-844601-6-smb devstack@keystone.service[86870]: WARNING keystone.common.rbac_enforcer.enforcer [None req-633babc5-1d0f-42a5-b30b-92eec04c447c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 27 18:32:00.179372 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633babc5-1d0f-42a5-b30b-92eec04c447c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:00.179372 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 2/4] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Jun 27 18:31:59 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 18:32:00.179780 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a62dbf-05d8-416b-bfa6-7e85ba34a729 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:00.186724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a62dbf-05d8-416b-bfa6-7e85ba34a729 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:00.191293 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9dcd0-7202-4914-b86f-ca2e33c93161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:00.192444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9dcd0-7202-4914-b86f-ca2e33c93161 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:00.192743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9dcd0-7202-4914-b86f-ca2e33c93161 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:00.193060 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9dcd0-7202-4914-b86f-ca2e33c93161 admin admin] PATH_INFO: `/v3/projects/1f3d89cc168b4f4880cd82876788b05f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:00.197213 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9dcd0-7202-4914-b86f-ca2e33c93161 admin admin] RBAC: Authorizing `identity:get_project(project_id=1f3d89cc168b4f4880cd82876788b05f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:00.248681 dv-cinder-844601-6-smb devstack@keystone.service[86869]: WARNING keystone.common.rbac_enforcer.enforcer [None req-99c9dcd0-7202-4914-b86f-ca2e33c93161 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 27 18:32:00.249023 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c9dcd0-7202-4914-b86f-ca2e33c93161 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:00.253529 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 3/5] 10.222.0.36 () {56 vars in 1207 bytes} [Mon Jun 27 18:32:00 2022] GET /identity/v3/projects/1f3d89cc168b4f4880cd82876788b05f => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:02.221414 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4a531-3133-4127-aecf-52d9e9d9e67d None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:02.221968 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4a531-3133-4127-aecf-52d9e9d9e67d None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:02.221968 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4a531-3133-4127-aecf-52d9e9d9e67d None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:02.226066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 3/6] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:02.231298 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d4855-51f2-4442-a0d0-43482f07bba2 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:02.232289 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d4855-51f2-4442-a0d0-43482f07bba2 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:02.232431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d4855-51f2-4442-a0d0-43482f07bba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:02.255632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-d76d4855-51f2-4442-a0d0-43482f07bba2 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:02.257141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-d76d4855-51f2-4442-a0d0-43482f07bba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:02.265481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 4/7] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 27 18:32:02.287503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4a531-3133-4127-aecf-52d9e9d9e67d None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:02.299912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4a531-3133-4127-aecf-52d9e9d9e67d None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:02.304061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa802c6b-97d9-438a-9cfe-d60e48b1b62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:02.304685 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa802c6b-97d9-438a-9cfe-d60e48b1b62b admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:02.304968 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa802c6b-97d9-438a-9cfe-d60e48b1b62b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:02.305248 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa802c6b-97d9-438a-9cfe-d60e48b1b62b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:02.313414 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa802c6b-97d9-438a-9cfe-d60e48b1b62b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:02.315179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa802c6b-97d9-438a-9cfe-d60e48b1b62b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:02.323865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 4/8] 10.222.0.36 () {58 vars in 1324 bytes} [Mon Jun 27 18:32:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 18:32:02.329185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d4855-51f2-4442-a0d0-43482f07bba2 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:02.338345 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d4855-51f2-4442-a0d0-43482f07bba2 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:02.342830 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18519a-8d57-4b00-b865-8d1855efe3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:02.343767 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18519a-8d57-4b00-b865-8d1855efe3dc admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:02.344068 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18519a-8d57-4b00-b865-8d1855efe3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:02.344479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18519a-8d57-4b00-b865-8d1855efe3dc admin admin] PATH_INFO: `/v3/users/c8d6148460c64b19ad3d5930db893c77` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:02.346186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18519a-8d57-4b00-b865-8d1855efe3dc admin admin] RBAC: Authorizing `identity:get_user(user_id=c8d6148460c64b19ad3d5930db893c77)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:02.348495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18519a-8d57-4b00-b865-8d1855efe3dc admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:02.350239 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 5/9] 10.222.0.36 () {56 vars in 1198 bytes} [Mon Jun 27 18:32:02 2022] GET /identity/v3/users/c8d6148460c64b19ad3d5930db893c77 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:04.391941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7e82c-5d4c-4278-9599-6c1a899258e1 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:04.392491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7e82c-5d4c-4278-9599-6c1a899258e1 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:04.392491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7e82c-5d4c-4278-9599-6c1a899258e1 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:04.393882 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 5/10] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:04.399157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ba96e-08fd-42f3-b3e2-57519c1d72a0 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:04.399583 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ba96e-08fd-42f3-b3e2-57519c1d72a0 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:04.399757 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ba96e-08fd-42f3-b3e2-57519c1d72a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:04.416388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-042ba96e-08fd-42f3-b3e2-57519c1d72a0 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:04.417587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-042ba96e-08fd-42f3-b3e2-57519c1d72a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:04.456164 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3134c-ad87-40ae-874d-7634363d1aa1 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:04.456456 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3134c-ad87-40ae-874d-7634363d1aa1 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:04.456740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3134c-ad87-40ae-874d-7634363d1aa1 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:04.458131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 6/11] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:32:04.462984 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be8b45-c2ad-40a7-936d-5c00ba05daf1 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:04.463275 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be8b45-c2ad-40a7-936d-5c00ba05daf1 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:04.463586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be8b45-c2ad-40a7-936d-5c00ba05daf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:04.500886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 6/12] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:04.503480 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG passlib.handlers.bcrypt [None req-82be8b45-c2ad-40a7-936d-5c00ba05daf1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86870) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 27 18:32:04.503930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG passlib.handlers.bcrypt [None req-82be8b45-c2ad-40a7-936d-5c00ba05daf1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86870) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 27 18:32:04.523972 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ba96e-08fd-42f3-b3e2-57519c1d72a0 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:04.547335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:04.549937 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-82be8b45-c2ad-40a7-936d-5c00ba05daf1 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:04.551572 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-82be8b45-c2ad-40a7-936d-5c00ba05daf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:04.625500 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ba96e-08fd-42f3-b3e2-57519c1d72a0 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:04.655668 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 7/13] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:04.658834 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c78a39-65fb-4416-a592-b32c422c53e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:04.659723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78a39-65fb-4416-a592-b32c422c53e0 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:04.660011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78a39-65fb-4416-a592-b32c422c53e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:04.660287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78a39-65fb-4416-a592-b32c422c53e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:04.671098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c78a39-65fb-4416-a592-b32c422c53e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:04.674122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be8b45-c2ad-40a7-936d-5c00ba05daf1 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:04.682358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-66c78a39-65fb-4416-a592-b32c422c53e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:04.682358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:04.682358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:04.682358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:04.682358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:04.682358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:04.682358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:04.682358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:04.682358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:04.682358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:04.682358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:04.682358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:04.682358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:04.682358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:04.682358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:04.682358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:04.683475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:04.683475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:04.683475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:04.683475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:04.683475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:04.683475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:04.683475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:04.683475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:04.683475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:04.683475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:04.683475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:04.683475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:04.683475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:04.683475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:04.683475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:04.683475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:04.684315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:04.684315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:04.684315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:04.684315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:04.684315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:04.684315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:04.684315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:04.684315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:04.684315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:04.684315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:04.684315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:04.684315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:04.684315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 7/14] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:32:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:32:04.689137 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c78a39-65fb-4416-a592-b32c422c53e0 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:04.770815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:04.775262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be8b45-c2ad-40a7-936d-5c00ba05daf1 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:04.777637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:04.790555 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c78a39-65fb-4416-a592-b32c422c53e0 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:04.812144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da7bd0-e4ce-4f09-a851-e2f339c5284b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:04.813037 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da7bd0-e4ce-4f09-a851-e2f339c5284b None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:04.813325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da7bd0-e4ce-4f09-a851-e2f339c5284b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:04.813610 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da7bd0-e4ce-4f09-a851-e2f339c5284b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:04.824887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f48181-6cc7-4ba4-8807-3e39d3649caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:04.826126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f48181-6cc7-4ba4-8807-3e39d3649caa None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:04.826416 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f48181-6cc7-4ba4-8807-3e39d3649caa None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:04.826697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f48181-6cc7-4ba4-8807-3e39d3649caa None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:04.827451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f48181-6cc7-4ba4-8807-3e39d3649caa None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:04.827790 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f48181-6cc7-4ba4-8807-3e39d3649caa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:04.829202 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f48181-6cc7-4ba4-8807-3e39d3649caa None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:04.840690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 8/15] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:04.846093 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f48181-6cc7-4ba4-8807-3e39d3649caa None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:04.880400 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da7bd0-e4ce-4f09-a851-e2f339c5284b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:04.881931 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da7bd0-e4ce-4f09-a851-e2f339c5284b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:04.942813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f48181-6cc7-4ba4-8807-3e39d3649caa None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:04.976254 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b586b9-b2a1-4581-9d07-a1cd04505975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:04.977116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b586b9-b2a1-4581-9d07-a1cd04505975 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:04.977468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 8/16] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 18:32:04.977577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b586b9-b2a1-4581-9d07-a1cd04505975 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:04.977740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b586b9-b2a1-4581-9d07-a1cd04505975 None admin] PATH_INFO: `/v3/users/c8d6148460c64b19ad3d5930db893c77` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:04.979048 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b586b9-b2a1-4581-9d07-a1cd04505975 None admin] RBAC: Authorizing `identity:get_user(user_id=c8d6148460c64b19ad3d5930db893c77)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:04.980539 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b586b9-b2a1-4581-9d07-a1cd04505975 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:04.982250 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 9/17] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:04 2022] GET /identity/v3/users/c8d6148460c64b19ad3d5930db893c77 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:04.983514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da7bd0-e4ce-4f09-a851-e2f339c5284b None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:04.986820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:04.988409 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b586b9-b2a1-4581-9d07-a1cd04505975 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:05.003171 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:05.080767 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da7bd0-e4ce-4f09-a851-e2f339c5284b None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:05.086617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b586b9-b2a1-4581-9d07-a1cd04505975 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:05.113159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb87a9-2b79-454e-b87b-cc55c4e97d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:05.113943 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb87a9-2b79-454e-b87b-cc55c4e97d69 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:05.114227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb87a9-2b79-454e-b87b-cc55c4e97d69 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:05.114507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb87a9-2b79-454e-b87b-cc55c4e97d69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:05.120539 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15489b-d8c0-4a93-afd7-3d4b269e60bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:05.121328 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15489b-d8c0-4a93-afd7-3d4b269e60bb None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:05.121615 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15489b-d8c0-4a93-afd7-3d4b269e60bb None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:05.121898 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15489b-d8c0-4a93-afd7-3d4b269e60bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:05.123624 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15489b-d8c0-4a93-afd7-3d4b269e60bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:05.125078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15489b-d8c0-4a93-afd7-3d4b269e60bb None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:05.126704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 10/18] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:32:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:05.132319 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15489b-d8c0-4a93-afd7-3d4b269e60bb None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:05.133475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb87a9-2b79-454e-b87b-cc55c4e97d69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:05.135167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb87a9-2b79-454e-b87b-cc55c4e97d69 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:05.159111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-bafb87a9-2b79-454e-b87b-cc55c4e97d69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:32:05.159111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:05.159111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:05.159111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:05.159111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:05.159111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:05.159111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:05.159111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:05.159111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:05.159111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:05.159111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:05.159111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:05.159111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:32:05.159111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:32:05.159111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:32:05.160019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:32:05.160019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:05.160019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:05.160019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:05.160019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:05.160019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:05.160019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:05.160019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:05.160019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:05.160019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:05.160019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:05.160019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:05.160019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:05.160019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:05.160019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:05.160019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:05.160019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:05.160816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:32:05.160816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:32:05.160816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:32:05.160816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:05.160816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 9/19] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:32:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:32:05.166004 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb87a9-2b79-454e-b87b-cc55c4e97d69 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:05.212636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:05.221740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:05.231225 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15489b-d8c0-4a93-afd7-3d4b269e60bb None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:05.264276 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb87a9-2b79-454e-b87b-cc55c4e97d69 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:05.266170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec94efe-5b0e-44e2-b457-c072a2a34659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:05.266831 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec94efe-5b0e-44e2-b457-c072a2a34659 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:05.267112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec94efe-5b0e-44e2-b457-c072a2a34659 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:05.267393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec94efe-5b0e-44e2-b457-c072a2a34659 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:05.268251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec94efe-5b0e-44e2-b457-c072a2a34659 None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.domain.id=default, user.id=c8d6148460c64b19ad3d5930db893c77) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:05.268562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec94efe-5b0e-44e2-b457-c072a2a34659 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:05.270011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec94efe-5b0e-44e2-b457-c072a2a34659 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:05.276720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 11/20] 10.222.0.36 () {56 vars in 1322 bytes} [Mon Jun 27 18:32:05 2022] GET /identity/v3/role_assignments?user.id=c8d6148460c64b19ad3d5930db893c77&scope.domain.id=default&role.id=b156409c977248e1b23c26e589b1e04f => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:05.299096 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbabf1-ea76-4bec-8158-174599d718e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:05.299816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbabf1-ea76-4bec-8158-174599d718e8 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:05.300106 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbabf1-ea76-4bec-8158-174599d718e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:05.300391 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbabf1-ea76-4bec-8158-174599d718e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:05.301145 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbabf1-ea76-4bec-8158-174599d718e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:05.301458 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbabf1-ea76-4bec-8158-174599d718e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:05.302916 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbabf1-ea76-4bec-8158-174599d718e8 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:05.322754 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 10/21] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:07.703602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876b2c4-fafe-48e9-a84b-186f23d6a352 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:07.704641 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876b2c4-fafe-48e9-a84b-186f23d6a352 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:07.705123 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876b2c4-fafe-48e9-a84b-186f23d6a352 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:07.706693 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 12/22] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:07.712248 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fae03-f255-4a0a-a401-60e4ce956f53 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:07.713087 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fae03-f255-4a0a-a401-60e4ce956f53 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:07.713569 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4fae03-f255-4a0a-a401-60e4ce956f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:07.744803 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-da4fae03-f255-4a0a-a401-60e4ce956f53 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:07.746342 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-da4fae03-f255-4a0a-a401-60e4ce956f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:07.846020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 11/23] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:07.870164 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd44a9-e1f4-4534-9a8b-12ee9c2ce0f8 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:07.870468 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd44a9-e1f4-4534-9a8b-12ee9c2ce0f8 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:07.870727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd44a9-e1f4-4534-9a8b-12ee9c2ce0f8 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:07.872273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:07.877635 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acd21a-f2be-40ee-8eab-a70ea7d57c1a None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:07.877934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acd21a-f2be-40ee-8eab-a70ea7d57c1a None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:07.878211 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02acd21a-f2be-40ee-8eab-a70ea7d57c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:07.889760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd44a9-e1f4-4534-9a8b-12ee9c2ce0f8 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:07.918388 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-02acd21a-f2be-40ee-8eab-a70ea7d57c1a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:07.920395 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-02acd21a-f2be-40ee-8eab-a70ea7d57c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:08.004939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:08.055827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 12/25] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:08.057180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ce1f2-18d3-4511-bd32-01fc8cf47dce None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:08.057475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ce1f2-18d3-4511-bd32-01fc8cf47dce None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:08.057757 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ce1f2-18d3-4511-bd32-01fc8cf47dce None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:08.067443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 13/26] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:08 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:08.068696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592028c0-3c67-4ae0-a3c0-b99c4ba55a5d None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:08.068988 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592028c0-3c67-4ae0-a3c0-b99c4ba55a5d None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:08.069271 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592028c0-3c67-4ae0-a3c0-b99c4ba55a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:08.096244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-592028c0-3c67-4ae0-a3c0-b99c4ba55a5d None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:08.097567 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-592028c0-3c67-4ae0-a3c0-b99c4ba55a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:08.114841 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd44a9-e1f4-4534-9a8b-12ee9c2ce0f8 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:08.177656 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e338e-b881-4d78-a43e-166c5560d506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:08.178465 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e338e-b881-4d78-a43e-166c5560d506 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:08.178795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e338e-b881-4d78-a43e-166c5560d506 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:08.179074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e338e-b881-4d78-a43e-166c5560d506 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:08.194471 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e338e-b881-4d78-a43e-166c5560d506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:08.202846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-130e338e-b881-4d78-a43e-166c5560d506 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:08.202846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:08.202846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:08.202846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:08.202846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:08.202846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:08.202846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:08.202846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:08.202846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:08.202846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:08.202846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:08.202846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:08.202846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:08.202846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:08.202846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:08.202846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:08.203726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:08.203726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:08.203726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:08.203726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:08.203726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:08.203726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:08.203726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:08.203726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:08.203726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:08.203726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:08.203726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:08.203726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:08.203726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:08.203726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:08.203726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:08.203726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:08.204491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:08.204491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:08.204491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:08.204491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:08.204491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:08.204491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:08.204491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:08.204491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:08.204491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:08.204491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:08.204491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:08.204491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:08.205168 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 14/27] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:32:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:08.209062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e338e-b881-4d78-a43e-166c5560d506 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:08.222800 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:08.232049 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 14/28] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:08.235938 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592028c0-3c67-4ae0-a3c0-b99c4ba55a5d None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:08.397825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e338e-b881-4d78-a43e-166c5560d506 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:08.414131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592028c0-3c67-4ae0-a3c0-b99c4ba55a5d None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:08.423180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:08.452904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1468f-ac2c-41ab-87f1-f1a8dd5f0264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:08.453803 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1468f-ac2c-41ab-87f1-f1a8dd5f0264 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:08.454229 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1468f-ac2c-41ab-87f1-f1a8dd5f0264 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:08.454713 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1468f-ac2c-41ab-87f1-f1a8dd5f0264 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:08.455622 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1468f-ac2c-41ab-87f1-f1a8dd5f0264 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:08.456205 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1468f-ac2c-41ab-87f1-f1a8dd5f0264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:08.457931 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e1468f-ac2c-41ab-87f1-f1a8dd5f0264 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:08.461577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6766f-8e24-439a-b065-5ec705a9eaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:08.462253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6766f-8e24-439a-b065-5ec705a9eaef None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:08.462541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6766f-8e24-439a-b065-5ec705a9eaef None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:08.462823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6766f-8e24-439a-b065-5ec705a9eaef None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:08.463602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6766f-8e24-439a-b065-5ec705a9eaef None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:08.465001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6766f-8e24-439a-b065-5ec705a9eaef None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:08.475622 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 15/29] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:08.477759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1468f-ac2c-41ab-87f1-f1a8dd5f0264 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:08.600183 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e1468f-ac2c-41ab-87f1-f1a8dd5f0264 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:08.637723 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ce31e5-f4f4-4a5c-80bf-b4423e4b1f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:08.638865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce31e5-f4f4-4a5c-80bf-b4423e4b1f88 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:08.639292 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce31e5-f4f4-4a5c-80bf-b4423e4b1f88 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:08.639789 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ce31e5-f4f4-4a5c-80bf-b4423e4b1f88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:08.650909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce31e5-f4f4-4a5c-80bf-b4423e4b1f88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:08.652575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ce31e5-f4f4-4a5c-80bf-b4423e4b1f88 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:08.665589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 15/30] 10.222.0.36 () {60 vars in 1131 bytes} [Mon Jun 27 18:32:08 2022] POST /identity/v3/roles => generated 219 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:32:08.667309 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3c21d-77e0-499c-94b4-1d581b822ca7 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:08.667745 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3c21d-77e0-499c-94b4-1d581b822ca7 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:08.668136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3c21d-77e0-499c-94b4-1d581b822ca7 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:08.673315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-13ce31e5-f4f4-4a5c-80bf-b4423e4b1f88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:32:08.673315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:08.673315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:08.673315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:08.673315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:08.673315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:08.673315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:08.673315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:08.673315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:08.673315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:08.673315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:08.673315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:08.673315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:32:08.673315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:32:08.673315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:32:08.674329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:32:08.674329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:08.674329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:08.674329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:08.674329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:08.674329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:08.674329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:08.674329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:08.674329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:08.674329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:08.674329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:08.674329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:08.674329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:08.674329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:08.674329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:08.674329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:08.674329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:08.675693 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:32:08.675693 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:32:08.675693 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:32:08.675693 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:08.675948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 16/31] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:08.676844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3c21d-77e0-499c-94b4-1d581b822ca7 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:08.678050 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 16/32] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:32:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:08.679721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a260dee-230b-49ed-8da6-709419421ec0 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:08.680160 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a260dee-230b-49ed-8da6-709419421ec0 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:08.680578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a260dee-230b-49ed-8da6-709419421ec0 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:08.682513 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 17/33] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:08.684075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ab022-0565-41b7-b156-858dc37c5581 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:08.684544 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ab022-0565-41b7-b156-858dc37c5581 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:08.684946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ab022-0565-41b7-b156-858dc37c5581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:08.709187 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-055ab022-0565-41b7-b156-858dc37c5581 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:08.711016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-055ab022-0565-41b7-b156-858dc37c5581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:08.734935 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:08.760272 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:08.805141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3c21d-77e0-499c-94b4-1d581b822ca7 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:08.816146 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 18/34] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:08.817351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ab022-0565-41b7-b156-858dc37c5581 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:08.863335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b05450-5c84-46ca-8494-c33237114d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:08.863335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b05450-5c84-46ca-8494-c33237114d38 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:08.863335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b05450-5c84-46ca-8494-c33237114d38 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:08.863335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b05450-5c84-46ca-8494-c33237114d38 None admin] PATH_INFO: `/v3/users/c8d6148460c64b19ad3d5930db893c77` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:08.864865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b05450-5c84-46ca-8494-c33237114d38 None admin] RBAC: Authorizing `identity:get_user(user_id=c8d6148460c64b19ad3d5930db893c77)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:08.866839 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b05450-5c84-46ca-8494-c33237114d38 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:08.868836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 17/35] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:08 2022] GET /identity/v3/users/c8d6148460c64b19ad3d5930db893c77 => generated 247 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:08.869975 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94487ee8-40b1-4068-84c2-143ba478dfdc None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:08.869975 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94487ee8-40b1-4068-84c2-143ba478dfdc None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:08.870353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94487ee8-40b1-4068-84c2-143ba478dfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:08.893052 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-94487ee8-40b1-4068-84c2-143ba478dfdc None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:08.894985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-94487ee8-40b1-4068-84c2-143ba478dfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:08.946581 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ab022-0565-41b7-b156-858dc37c5581 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:08.970967 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 18/36] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:08.972379 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94487ee8-40b1-4068-84c2-143ba478dfdc None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:08.985833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3c383-965f-4402-9d47-c0f600ae8cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:08.986564 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3c383-965f-4402-9d47-c0f600ae8cba None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:08.986909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3c383-965f-4402-9d47-c0f600ae8cba None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:08.987243 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3c383-965f-4402-9d47-c0f600ae8cba None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:08.988085 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3c383-965f-4402-9d47-c0f600ae8cba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:08.988398 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3c383-965f-4402-9d47-c0f600ae8cba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:08.989924 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3c383-965f-4402-9d47-c0f600ae8cba None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:09.002188 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 19/37] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:09.003005 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3c383-965f-4402-9d47-c0f600ae8cba None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:09.017563 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:09.043276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:09.083193 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94487ee8-40b1-4068-84c2-143ba478dfdc None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:09.113848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3c383-965f-4402-9d47-c0f600ae8cba None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:09.121046 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5bb05-1bb6-4465-8bec-b8e5a1720a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:09.121722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5bb05-1bb6-4465-8bec-b8e5a1720a7f None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:09.122038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5bb05-1bb6-4465-8bec-b8e5a1720a7f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:09.122316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee5bb05-1bb6-4465-8bec-b8e5a1720a7f None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:09.123180 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5bb05-1bb6-4465-8bec-b8e5a1720a7f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:09.124715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee5bb05-1bb6-4465-8bec-b8e5a1720a7f None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:09.147011 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2942693-fc62-4219-873e-9117deef1f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:09.147843 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2942693-fc62-4219-873e-9117deef1f03 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:09.148133 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2942693-fc62-4219-873e-9117deef1f03 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:09.148462 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2942693-fc62-4219-873e-9117deef1f03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:09.149852 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2942693-fc62-4219-873e-9117deef1f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:09.151310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2942693-fc62-4219-873e-9117deef1f03 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:09.152967 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:32:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:09.154273 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2942693-fc62-4219-873e-9117deef1f03 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:09.186939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1131 bytes} [Mon Jun 27 18:32:08 2022] POST /identity/v3/roles => generated 225 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:32:09.186939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5bb05-1bb6-4465-8bec-b8e5a1720a7f None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:09.266896 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:09.302782 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2942693-fc62-4219-873e-9117deef1f03 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:09.315467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee5bb05-1bb6-4465-8bec-b8e5a1720a7f None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:09.341188 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1fe49-c234-41e2-8738-c2f3c2a3846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:09.341973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1fe49-c234-41e2-8738-c2f3c2a3846a None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:09.342265 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1fe49-c234-41e2-8738-c2f3c2a3846a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:09.342545 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1fe49-c234-41e2-8738-c2f3c2a3846a None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:09.343312 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1fe49-c234-41e2-8738-c2f3c2a3846a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:09.344560 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:09.344782 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1fe49-c234-41e2-8738-c2f3c2a3846a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:09.356176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f40bf-8ad1-4270-87f6-08890d375f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:09.356909 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f40bf-8ad1-4270-87f6-08890d375f2f None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:09.357539 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f40bf-8ad1-4270-87f6-08890d375f2f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:09.357539 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f40bf-8ad1-4270-87f6-08890d375f2f None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:09.359109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f40bf-8ad1-4270-87f6-08890d375f2f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:09.359929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f40bf-8ad1-4270-87f6-08890d375f2f None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:09.502084 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 20/40] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jun 27 18:32:09 2022] POST /identity/v3/projects => generated 301 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:32:09.503356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f40bf-8ad1-4270-87f6-08890d375f2f None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:09.572070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 21/41] 10.222.0.36 () {60 vars in 1131 bytes} [Mon Jun 27 18:32:09 2022] POST /identity/v3/roles => generated 223 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:32:09.573720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56e19f-6166-4ab5-826a-8d78cb6d9d92 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:09.574018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56e19f-6166-4ab5-826a-8d78cb6d9d92 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:09.574591 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56e19f-6166-4ab5-826a-8d78cb6d9d92 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:09.576533 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 22/42] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:09.582251 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccbbc2-132b-4f74-8238-59bf35623fdb None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:09.582572 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccbbc2-132b-4f74-8238-59bf35623fdb None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:09.582825 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfccbbc2-132b-4f74-8238-59bf35623fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:09.606677 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-bfccbbc2-132b-4f74-8238-59bf35623fdb None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:09.608711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-bfccbbc2-132b-4f74-8238-59bf35623fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:09.644511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f40bf-8ad1-4270-87f6-08890d375f2f None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:09.702208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df48de-677e-4cdd-977c-92a35f3e5023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:09.703116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df48de-677e-4cdd-977c-92a35f3e5023 None admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:09.703405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df48de-677e-4cdd-977c-92a35f3e5023 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:09.703718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df48de-677e-4cdd-977c-92a35f3e5023 None admin] PATH_INFO: `/v3/domains/default/users/c8d6148460c64b19ad3d5930db893c77/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:09.706646 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df48de-677e-4cdd-977c-92a35f3e5023 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c8d6148460c64b19ad3d5930db893c77, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:09.708222 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79df48de-677e-4cdd-977c-92a35f3e5023 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:09.718994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 23/43] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:09.743780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccbbc2-132b-4f74-8238-59bf35623fdb None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:09.817009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 21/44] 10.222.0.36 () {58 vars in 1361 bytes} [Mon Jun 27 18:32:09 2022] PUT /identity/v3/domains/default/users/c8d6148460c64b19ad3d5930db893c77/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:32:09.817622 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:09.850992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfccbbc2-132b-4f74-8238-59bf35623fdb None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:09.888282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682574ba-8eb2-42fc-a7b7-542dff217087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:09.889150 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682574ba-8eb2-42fc-a7b7-542dff217087 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:09.889438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682574ba-8eb2-42fc-a7b7-542dff217087 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:09.889718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682574ba-8eb2-42fc-a7b7-542dff217087 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:09.890998 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682574ba-8eb2-42fc-a7b7-542dff217087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:09.892624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682574ba-8eb2-42fc-a7b7-542dff217087 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:09.894446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 24/45] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:32:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:09.900118 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df48de-677e-4cdd-977c-92a35f3e5023 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:09.938007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:10.007861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df48de-677e-4cdd-977c-92a35f3e5023 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:10.147059 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c36e25-ad07-4f15-ad0c-b2483e1b9eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:10.147679 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c36e25-ad07-4f15-ad0c-b2483e1b9eb6 None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:10.147970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c36e25-ad07-4f15-ad0c-b2483e1b9eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:10.148251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c36e25-ad07-4f15-ad0c-b2483e1b9eb6 None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:10.148978 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c36e25-ad07-4f15-ad0c-b2483e1b9eb6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:10.150434 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c36e25-ad07-4f15-ad0c-b2483e1b9eb6 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:10.251176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 22/46] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jun 27 18:32:09 2022] POST /identity/v3/projects => generated 312 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:32:11.860013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85146cb-9336-4212-8d37-bf1afffcdbbf None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:11.860533 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85146cb-9336-4212-8d37-bf1afffcdbbf None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:11.860616 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85146cb-9336-4212-8d37-bf1afffcdbbf None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:11.861950 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 25/47] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:11.867243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82ecf1-a196-4cfe-91f5-be97ba75ef8a None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:11.867715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82ecf1-a196-4cfe-91f5-be97ba75ef8a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:11.867849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82ecf1-a196-4cfe-91f5-be97ba75ef8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:11.884276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-ab82ecf1-a196-4cfe-91f5-be97ba75ef8a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:11.885459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ab82ecf1-a196-4cfe-91f5-be97ba75ef8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:11.954319 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 23/48] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:11.977826 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85146cb-9336-4212-8d37-bf1afffcdbbf None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:12.077838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85146cb-9336-4212-8d37-bf1afffcdbbf None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:12.110327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca5d668-cebb-4597-8355-6116c58f94a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:12.111057 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5d668-cebb-4597-8355-6116c58f94a2 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:12.111343 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5d668-cebb-4597-8355-6116c58f94a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:12.111657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca5d668-cebb-4597-8355-6116c58f94a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:12.115280 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:12.124491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca5d668-cebb-4597-8355-6116c58f94a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:12.133340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-cca5d668-cebb-4597-8355-6116c58f94a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:12.133340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:12.133340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:12.133340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:12.133340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:12.133340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:12.133340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:12.133340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:12.133340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:12.133340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:12.133340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:12.133340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:12.133340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:12.133340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:12.133340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:12.133340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:12.134365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:12.134365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:12.134365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:12.134365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:12.134365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:12.134365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:12.134365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:12.134365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:12.134365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:12.134365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:12.134365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:12.134365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:12.134365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:12.134365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:12.134365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:12.134365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:12.135154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:12.135154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:12.135154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:12.135154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:12.135154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:12.135154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:12.135154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:12.135154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:12.135154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:12.135154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:12.135154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:12.135154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:12.135154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 26/49] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:32:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:12.140394 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82ecf1-a196-4cfe-91f5-be97ba75ef8a None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:12.157696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:12.238735 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab82ecf1-a196-4cfe-91f5-be97ba75ef8a None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:12.264343 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c597cfb-bac7-4c9c-bb7d-232521cf1ed9 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:12.264642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c597cfb-bac7-4c9c-bb7d-232521cf1ed9 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:12.265039 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c597cfb-bac7-4c9c-bb7d-232521cf1ed9 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:12.266310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 27/50] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:32:12.271161 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d5461-8d63-4622-907b-507df34d61a8 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:12.271454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d5461-8d63-4622-907b-507df34d61a8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:12.271781 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d5461-8d63-4622-907b-507df34d61a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:12.279040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292c2c5-7226-4d9c-8513-d9d2c422e0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:12.279736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c2c5-7226-4d9c-8513-d9d2c422e0d9 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:12.280023 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c2c5-7226-4d9c-8513-d9d2c422e0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:12.280302 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292c2c5-7226-4d9c-8513-d9d2c422e0d9 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:12.281057 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292c2c5-7226-4d9c-8513-d9d2c422e0d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:12.281374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292c2c5-7226-4d9c-8513-d9d2c422e0d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:12.282768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292c2c5-7226-4d9c-8513-d9d2c422e0d9 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:12.289082 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-811d5461-8d63-4622-907b-507df34d61a8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:12.290305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-811d5461-8d63-4622-907b-507df34d61a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:12.291522 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 24/51] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:12.297579 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292c2c5-7226-4d9c-8513-d9d2c422e0d9 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:12.363207 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 28/52] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:12.373942 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:12.386932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d5461-8d63-4622-907b-507df34d61a8 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:12.396202 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292c2c5-7226-4d9c-8513-d9d2c422e0d9 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:12.436908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d7208-8641-4d32-ad9e-0de1f782c047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:12.437815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d7208-8641-4d32-ad9e-0de1f782c047 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:12.438105 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d7208-8641-4d32-ad9e-0de1f782c047 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:12.438390 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589d7208-8641-4d32-ad9e-0de1f782c047 None admin] PATH_INFO: `/v3/users/c8d6148460c64b19ad3d5930db893c77` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:12.439741 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d7208-8641-4d32-ad9e-0de1f782c047 None admin] RBAC: Authorizing `identity:get_user(user_id=c8d6148460c64b19ad3d5930db893c77)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:12.441235 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589d7208-8641-4d32-ad9e-0de1f782c047 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:12.442961 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 25/53] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:12 2022] GET /identity/v3/users/c8d6148460c64b19ad3d5930db893c77 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:12.448757 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d7208-8641-4d32-ad9e-0de1f782c047 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:12.568375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589d7208-8641-4d32-ad9e-0de1f782c047 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:12.605478 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d5461-8d63-4622-907b-507df34d61a8 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:12.608179 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b0b4b-fd72-48fa-a6f5-31a435907f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:12.608995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b0b4b-fd72-48fa-a6f5-31a435907f69 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:12.609286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b0b4b-fd72-48fa-a6f5-31a435907f69 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:12.609566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b0b4b-fd72-48fa-a6f5-31a435907f69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:12.610778 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b0b4b-fd72-48fa-a6f5-31a435907f69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:12.612285 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b0b4b-fd72-48fa-a6f5-31a435907f69 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:12.614297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 26/54] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:32:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:12.619815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b0b4b-fd72-48fa-a6f5-31a435907f69 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:12.637850 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:12.638411 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:12.647573 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84109831-5fae-44ca-87ca-bc33c2a09def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:12.650891 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84109831-5fae-44ca-87ca-bc33c2a09def None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:12.650891 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84109831-5fae-44ca-87ca-bc33c2a09def None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:12.650891 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84109831-5fae-44ca-87ca-bc33c2a09def None admin] PATH_INFO: `/v3/domains/default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:12.650891 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84109831-5fae-44ca-87ca-bc33c2a09def None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:12.651707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84109831-5fae-44ca-87ca-bc33c2a09def None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:12.653976 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 29/55] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:32:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:12.659993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84109831-5fae-44ca-87ca-bc33c2a09def None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:12.729869 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b0b4b-fd72-48fa-a6f5-31a435907f69 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:12.762113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84109831-5fae-44ca-87ca-bc33c2a09def None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:12.763945 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a9895-2222-4f37-8188-1266b6973f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:12.764606 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9895-2222-4f37-8188-1266b6973f38 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:12.764891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9895-2222-4f37-8188-1266b6973f38 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:12.765172 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9895-2222-4f37-8188-1266b6973f38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:12.765996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a9895-2222-4f37-8188-1266b6973f38 None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.domain.id=default, user.id=c8d6148460c64b19ad3d5930db893c77) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:12.766311 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a9895-2222-4f37-8188-1266b6973f38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:12.767789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a9895-2222-4f37-8188-1266b6973f38 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:12.773525 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 27/56] 10.222.0.36 () {56 vars in 1322 bytes} [Mon Jun 27 18:32:12 2022] GET /identity/v3/role_assignments?user.id=c8d6148460c64b19ad3d5930db893c77&scope.domain.id=default&role.id=b156409c977248e1b23c26e589b1e04f => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:12.798394 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19787a9-8cbb-40cf-9289-5082ff8a68e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:12.799091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19787a9-8cbb-40cf-9289-5082ff8a68e3 None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:12.799380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19787a9-8cbb-40cf-9289-5082ff8a68e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:12.799702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19787a9-8cbb-40cf-9289-5082ff8a68e3 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:12.800444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19787a9-8cbb-40cf-9289-5082ff8a68e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:12.801943 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19787a9-8cbb-40cf-9289-5082ff8a68e3 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:12.885938 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 30/57] 10.222.0.36 () {60 vars in 1140 bytes} [Mon Jun 27 18:32:12 2022] POST /identity/v3/projects => generated 298 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:32:14.905655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727d92d-6085-4404-b5c6-4e5f0d81678c None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:14.906170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727d92d-6085-4404-b5c6-4e5f0d81678c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:14.906255 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727d92d-6085-4404-b5c6-4e5f0d81678c None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:14.907620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 28/58] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:14.912825 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fac643-439e-4be4-82c3-c69f858c4a5e None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:14.913196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fac643-439e-4be4-82c3-c69f858c4a5e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:14.913394 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fac643-439e-4be4-82c3-c69f858c4a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:14.930114 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-80fac643-439e-4be4-82c3-c69f858c4a5e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:14.931322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-80fac643-439e-4be4-82c3-c69f858c4a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:14.971913 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:14.995834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 31/59] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:15.020521 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727d92d-6085-4404-b5c6-4e5f0d81678c None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:15.097992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:15.119612 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727d92d-6085-4404-b5c6-4e5f0d81678c None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:15.152317 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea25f99c-043f-4ebc-afed-673c07495406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:15.153116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25f99c-043f-4ebc-afed-673c07495406 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:15.153402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25f99c-043f-4ebc-afed-673c07495406 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:15.153677 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea25f99c-043f-4ebc-afed-673c07495406 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:15.154840 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25f99c-043f-4ebc-afed-673c07495406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:15.156420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea25f99c-043f-4ebc-afed-673c07495406 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:15.157953 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 29/60] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:32:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:15.163311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fac643-439e-4be4-82c3-c69f858c4a5e None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:15.259147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fac643-439e-4be4-82c3-c69f858c4a5e None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:15.291647 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed831bc2-4f35-4532-b6d4-3185b1e6f6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:15.292310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831bc2-4f35-4532-b6d4-3185b1e6f6c9 None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:15.292597 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831bc2-4f35-4532-b6d4-3185b1e6f6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:15.292879 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed831bc2-4f35-4532-b6d4-3185b1e6f6c9 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:15.294165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed831bc2-4f35-4532-b6d4-3185b1e6f6c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:15.295645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed831bc2-4f35-4532-b6d4-3185b1e6f6c9 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:15.390497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 32/61] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:32:15 2022] POST /identity/v3/users => generated 275 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:32:18.495321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833caddc-38d3-4bf9-bf08-044f0b5a0fb1 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:18.496347 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833caddc-38d3-4bf9-bf08-044f0b5a0fb1 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:18.496869 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833caddc-38d3-4bf9-bf08-044f0b5a0fb1 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:18.498667 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 30/62] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:18.504305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259d1fe-4324-4ae2-8fe6-0a15c04562bd None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:18.505126 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259d1fe-4324-4ae2-8fe6-0a15c04562bd None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:18.505609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259d1fe-4324-4ae2-8fe6-0a15c04562bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:18.531551 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-3259d1fe-4324-4ae2-8fe6-0a15c04562bd None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:18.531551 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3259d1fe-4324-4ae2-8fe6-0a15c04562bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:18.557918 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:18.586223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7930f-822b-43a4-a1a8-8e2b68e1602a None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:18.586519 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7930f-822b-43a4-a1a8-8e2b68e1602a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:18.586795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7930f-822b-43a4-a1a8-8e2b68e1602a None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:18.588255 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:32:18.597870 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9151b-1e4a-4a65-83c6-f2754108069f None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:18.598160 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9151b-1e4a-4a65-83c6-f2754108069f None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:18.598441 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9151b-1e4a-4a65-83c6-f2754108069f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:18.610228 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 33/64] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:18.631654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-cab9151b-1e4a-4a65-83c6-f2754108069f None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:18.633358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-cab9151b-1e4a-4a65-83c6-f2754108069f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:18.633688 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259d1fe-4324-4ae2-8fe6-0a15c04562bd None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:18.770829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 32/65] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:18.802528 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb63a71-ab9a-454a-9f9f-edc069b2d1aa None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:18.803066 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb63a71-ab9a-454a-9f9f-edc069b2d1aa None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:18.803492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb63a71-ab9a-454a-9f9f-edc069b2d1aa None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:18.806096 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 33/66] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:18.809323 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb63a71-ab9a-454a-9f9f-edc069b2d1aa None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:18.814463 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259d1fe-4324-4ae2-8fe6-0a15c04562bd None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:18.852668 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba021619-f93b-4990-b998-35b07f2c01e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:18.853703 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba021619-f93b-4990-b998-35b07f2c01e8 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:18.854131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba021619-f93b-4990-b998-35b07f2c01e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:18.854655 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba021619-f93b-4990-b998-35b07f2c01e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:18.866475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba021619-f93b-4990-b998-35b07f2c01e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:18.874970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-ba021619-f93b-4990-b998-35b07f2c01e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:18.874970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:18.874970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:18.874970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:18.874970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:18.874970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:18.874970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:18.874970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:18.874970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:18.874970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:18.874970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:18.874970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:18.874970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:18.874970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:18.874970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:18.874970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:18.875994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:18.875994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:18.875994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:18.875994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:18.875994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:18.875994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:18.875994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:18.875994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:18.875994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:18.875994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:18.875994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:18.875994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:18.875994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:18.875994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:18.875994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:18.875994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:18.876921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:18.876921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:18.876921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:18.876921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:18.876921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:18.876921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:18.876921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:18.876921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:18.876921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:18.876921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:18.876921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:18.876921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:18.879223 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 34/67] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:32:18.880678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0453c-f88e-4341-8660-cbff3687fbb4 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:18.881172 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0453c-f88e-4341-8660-cbff3687fbb4 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:18.881645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e0453c-f88e-4341-8660-cbff3687fbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:18.901494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:18.905403 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-a9e0453c-f88e-4341-8660-cbff3687fbb4 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:18.906835 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-a9e0453c-f88e-4341-8660-cbff3687fbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:18.926062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:18.932368 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb63a71-ab9a-454a-9f9f-edc069b2d1aa None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:18.967991 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256aad5c-55e1-4490-a00c-f73f20277915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:18.968804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aad5c-55e1-4490-a00c-f73f20277915 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:18.969086 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aad5c-55e1-4490-a00c-f73f20277915 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:18.969374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256aad5c-55e1-4490-a00c-f73f20277915 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:18.979502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256aad5c-55e1-4490-a00c-f73f20277915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:18.987577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-256aad5c-55e1-4490-a00c-f73f20277915 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:18.987577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:18.987577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:18.987577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:18.987577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:18.987577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:18.987577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:18.987577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:18.987577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:18.987577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:18.987577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:18.987577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:18.987577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:18.987577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:18.987577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:18.987577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:18.988418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:18.988418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:18.988418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:18.988418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:18.988418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:18.988418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:18.988418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:18.988418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:18.988418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:18.988418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:18.988418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:18.988418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:18.988418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:18.988418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:18.988418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:18.988418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:18.989879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:18.989879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:18.989879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:18.989879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:18.989879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:18.989879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:18.989879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:18.989879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:18.989879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:18.989879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:18.989879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:18.989879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:18.989879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 34/68] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:32:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:18.990541 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 35/69] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:18.990541 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0f0ca-52a5-4756-b02e-1cf3b945d6a3 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:18.990659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0f0ca-52a5-4756-b02e-1cf3b945d6a3 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:18.990942 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0f0ca-52a5-4756-b02e-1cf3b945d6a3 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:18.991788 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256aad5c-55e1-4490-a00c-f73f20277915 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:18.992832 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 36/70] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:18.997910 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0f0ca-52a5-4756-b02e-1cf3b945d6a3 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:19.108070 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256aad5c-55e1-4490-a00c-f73f20277915 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:19.114353 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0f0ca-52a5-4756-b02e-1cf3b945d6a3 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:19.148730 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8eaf8e-cf6b-40f4-ad93-991badd7b856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:19.149184 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ca331-12ce-4ded-b11a-bb0cf48b9b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:19.149460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8eaf8e-cf6b-40f4-ad93-991badd7b856 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:19.149751 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8eaf8e-cf6b-40f4-ad93-991badd7b856 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:19.149862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ca331-12ce-4ded-b11a-bb0cf48b9b23 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:19.150027 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8eaf8e-cf6b-40f4-ad93-991badd7b856 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:19.150116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ca331-12ce-4ded-b11a-bb0cf48b9b23 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:19.150395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ca331-12ce-4ded-b11a-bb0cf48b9b23 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:19.150778 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8eaf8e-cf6b-40f4-ad93-991badd7b856 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:19.151114 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8eaf8e-cf6b-40f4-ad93-991badd7b856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:19.151203 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ca331-12ce-4ded-b11a-bb0cf48b9b23 None admin] RBAC: Adding query filter params (name=member) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:19.151448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ca331-12ce-4ded-b11a-bb0cf48b9b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:19.153059 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8eaf8e-cf6b-40f4-ad93-991badd7b856 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:19.153453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ca331-12ce-4ded-b11a-bb0cf48b9b23 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:19.155771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:19.162844 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 37/71] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:19.162976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 35/72] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:19.164052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8eaf8e-cf6b-40f4-ad93-991badd7b856 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:19.164157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebaa1e-4e42-4010-a34a-33e1d300cfa4 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:19.164342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebaa1e-4e42-4010-a34a-33e1d300cfa4 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:19.164619 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cebaa1e-4e42-4010-a34a-33e1d300cfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:19.183367 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-7cebaa1e-4e42-4010-a34a-33e1d300cfa4 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:19.185112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-7cebaa1e-4e42-4010-a34a-33e1d300cfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:19.189203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:19.254735 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 36/73] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:19.255600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebaa1e-4e42-4010-a34a-33e1d300cfa4 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:19.282797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8eaf8e-cf6b-40f4-ad93-991badd7b856 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:19.315851 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad72b5a-1101-4d42-bb05-30d02718d90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:19.316669 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad72b5a-1101-4d42-bb05-30d02718d90a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:19.316962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad72b5a-1101-4d42-bb05-30d02718d90a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:19.317244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad72b5a-1101-4d42-bb05-30d02718d90a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:19.327325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad72b5a-1101-4d42-bb05-30d02718d90a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:19.335429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-9ad72b5a-1101-4d42-bb05-30d02718d90a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:19.335429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:19.335429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:19.335429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:19.335429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:19.335429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:19.335429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:19.335429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:19.335429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:19.335429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:19.335429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:19.335429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:19.335429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:19.335429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:19.335429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:19.335429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:19.336306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:19.336306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:19.336306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:19.336306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:19.336306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:19.336306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:19.336306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:19.336306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:19.336306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:19.336306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:19.336306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:19.336306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:19.336306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:19.336306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:19.336306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:19.336306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:19.337048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:19.337048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:19.337048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:19.337048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:19.337048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:19.337048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:19.337048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:19.337048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:19.337048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:19.337048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:19.337048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:19.337048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:19.337048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 38/74] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:32:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:19.337673 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad72b5a-1101-4d42-bb05-30d02718d90a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:19.360413 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cebaa1e-4e42-4010-a34a-33e1d300cfa4 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:19.387739 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:19.395373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0711d-a17f-42ec-8d8e-8a0d6690b042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:19.400730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0711d-a17f-42ec-8d8e-8a0d6690b042 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:19.400730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0711d-a17f-42ec-8d8e-8a0d6690b042 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:19.400730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0711d-a17f-42ec-8d8e-8a0d6690b042 None admin] PATH_INFO: `/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:19.410453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0711d-a17f-42ec-8d8e-8a0d6690b042 None admin] RBAC: Authorizing `identity:get_user(user_id=fdc3b2b9c8654f7383bb4032c4f52f2a)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:19.411620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:19.411988 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa0711d-a17f-42ec-8d8e-8a0d6690b042 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:19.413687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 37/75] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:19 2022] GET /identity/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:19.415157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256ba15-b05e-4384-8bd9-4da44c5eb416 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:19.415577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256ba15-b05e-4384-8bd9-4da44c5eb416 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:19.415755 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256ba15-b05e-4384-8bd9-4da44c5eb416 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:19.418365 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 38/76] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:19.418365 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256ba15-b05e-4384-8bd9-4da44c5eb416 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:19.437626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad72b5a-1101-4d42-bb05-30d02718d90a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:19.471815 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004906c-b3b9-4b55-bc8e-e7371d5ce235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:19.472692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004906c-b3b9-4b55-bc8e-e7371d5ce235 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:19.472981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004906c-b3b9-4b55-bc8e-e7371d5ce235 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:19.473264 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004906c-b3b9-4b55-bc8e-e7371d5ce235 None admin] PATH_INFO: `/v3/users/c8d6148460c64b19ad3d5930db893c77` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:19.474713 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004906c-b3b9-4b55-bc8e-e7371d5ce235 None admin] RBAC: Authorizing `identity:get_user(user_id=c8d6148460c64b19ad3d5930db893c77)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:19.476221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004906c-b3b9-4b55-bc8e-e7371d5ce235 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:19.477865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 39/77] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:19 2022] GET /identity/v3/users/c8d6148460c64b19ad3d5930db893c77 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:19.478630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004906c-b3b9-4b55-bc8e-e7371d5ce235 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:19.518941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256ba15-b05e-4384-8bd9-4da44c5eb416 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:19.554066 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd898a8c-17e5-4da1-984a-a0c6360fd566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:19.554868 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd898a8c-17e5-4da1-984a-a0c6360fd566 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:19.555155 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd898a8c-17e5-4da1-984a-a0c6360fd566 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:19.555435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd898a8c-17e5-4da1-984a-a0c6360fd566 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:19.567069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd898a8c-17e5-4da1-984a-a0c6360fd566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:19.575341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-bd898a8c-17e5-4da1-984a-a0c6360fd566 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:19.575341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:19.575341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:19.575341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:19.575341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:19.575341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:19.575341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:19.575341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:19.575341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:19.575341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:19.575341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:19.575341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:19.575341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:19.575341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:19.575341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:19.575341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:19.576314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:19.576314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:19.576314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:19.576314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:19.576314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:19.576314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:19.576314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:19.576314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:19.576314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:19.576314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:19.576314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:19.576314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:19.576314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:19.576314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:19.576314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:19.576314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:19.577074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:19.577074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:19.577074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:19.577074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:19.577074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:19.577074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:19.577074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:19.577074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:19.577074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:19.577074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:19.577074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:19.577074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:19.577074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 39/78] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:19.577704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd898a8c-17e5-4da1-984a-a0c6360fd566 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:19.585038 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004906c-b3b9-4b55-bc8e-e7371d5ce235 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:19.619124 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441b14e-a520-411b-b6bf-f5382a307fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:19.619794 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441b14e-a520-411b-b6bf-f5382a307fa4 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:19.620083 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441b14e-a520-411b-b6bf-f5382a307fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:19.620362 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441b14e-a520-411b-b6bf-f5382a307fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:19.621110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441b14e-a520-411b-b6bf-f5382a307fa4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:19.621447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441b14e-a520-411b-b6bf-f5382a307fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:19.622831 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441b14e-a520-411b-b6bf-f5382a307fa4 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:19.623057 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:19.630670 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 40/79] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:32:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:19.631940 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be74506-aabd-449d-a5e1-998087f5f64f None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:19.632429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be74506-aabd-449d-a5e1-998087f5f64f None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:19.632529 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be74506-aabd-449d-a5e1-998087f5f64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:19.638640 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:19.648847 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-7be74506-aabd-449d-a5e1-998087f5f64f None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:19.650048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-7be74506-aabd-449d-a5e1-998087f5f64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:19.676594 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd898a8c-17e5-4da1-984a-a0c6360fd566 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:19.709423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a7ee0-4fc1-4e64-a62b-7dd932368d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:19.710067 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a7ee0-4fc1-4e64-a62b-7dd932368d8c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:19.710351 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a7ee0-4fc1-4e64-a62b-7dd932368d8c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:19.710626 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a7ee0-4fc1-4e64-a62b-7dd932368d8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:19.714669 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 41/80] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:19.716066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be74506-aabd-449d-a5e1-998087f5f64f None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:19.778364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a7ee0-4fc1-4e64-a62b-7dd932368d8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:19.779855 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a7ee0-4fc1-4e64-a62b-7dd932368d8c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:19.817677 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be74506-aabd-449d-a5e1-998087f5f64f None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:19.823337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:19.850936 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7a429-3d75-4183-acbb-5487b1ca65cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:19.851611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7a429-3d75-4183-acbb-5487b1ca65cc None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:19.851904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7a429-3d75-4183-acbb-5487b1ca65cc None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:19.852184 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7a429-3d75-4183-acbb-5487b1ca65cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:19.854808 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:19.877406 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 40/81] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:19.878169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a7ee0-4fc1-4e64-a62b-7dd932368d8c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:19.919312 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7a429-3d75-4183-acbb-5487b1ca65cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:19.920819 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7a429-3d75-4183-acbb-5487b1ca65cc None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:19.975441 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a7ee0-4fc1-4e64-a62b-7dd932368d8c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:20.010928 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d590de-94be-44ac-a12a-90d3d46e026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:20.011644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d590de-94be-44ac-a12a-90d3d46e026a None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:20.012535 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d590de-94be-44ac-a12a-90d3d46e026a None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:20.012819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d590de-94be-44ac-a12a-90d3d46e026a None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:20.013563 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d590de-94be-44ac-a12a-90d3d46e026a None admin] RBAC: Adding query filter params (name=member) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:20.013869 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d590de-94be-44ac-a12a-90d3d46e026a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:20.015264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d590de-94be-44ac-a12a-90d3d46e026a None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:20.018520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 42/82] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:20.019365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7a429-3d75-4183-acbb-5487b1ca65cc None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:20.026505 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 41/83] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:20.027615 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d590de-94be-44ac-a12a-90d3d46e026a None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:20.038870 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:20.052417 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:20.117326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7a429-3d75-4183-acbb-5487b1ca65cc None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:20.126843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d590de-94be-44ac-a12a-90d3d46e026a None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:20.151104 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11d0d2-94c4-4891-b7cf-160bdce5aa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:20.151946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11d0d2-94c4-4891-b7cf-160bdce5aa95 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:20.152240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11d0d2-94c4-4891-b7cf-160bdce5aa95 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:20.152539 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11d0d2-94c4-4891-b7cf-160bdce5aa95 None admin] PATH_INFO: `/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:20.153742 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11d0d2-94c4-4891-b7cf-160bdce5aa95 None admin] RBAC: Authorizing `identity:get_user(user_id=fdc3b2b9c8654f7383bb4032c4f52f2a)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:20.155192 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11d0d2-94c4-4891-b7cf-160bdce5aa95 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:20.156858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 43/84] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:20 2022] GET /identity/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:20.157612 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11d0d2-94c4-4891-b7cf-160bdce5aa95 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:20.159941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b531bf5-74a4-45ab-a51a-e57933b39852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:20.160853 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b531bf5-74a4-45ab-a51a-e57933b39852 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:20.161144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b531bf5-74a4-45ab-a51a-e57933b39852 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:20.161430 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b531bf5-74a4-45ab-a51a-e57933b39852 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:20.162623 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b531bf5-74a4-45ab-a51a-e57933b39852 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:20.164126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b531bf5-74a4-45ab-a51a-e57933b39852 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:20.165743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 42/85] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:32:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:20.166498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b531bf5-74a4-45ab-a51a-e57933b39852 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:20.246226 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:20.257124 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11d0d2-94c4-4891-b7cf-160bdce5aa95 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:20.258634 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:20.269531 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b531bf5-74a4-45ab-a51a-e57933b39852 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:20.290354 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcd412-fc6e-44b6-a3ae-051052322939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:20.291203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcd412-fc6e-44b6-a3ae-051052322939 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:20.291487 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcd412-fc6e-44b6-a3ae-051052322939 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:20.291803 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcd412-fc6e-44b6-a3ae-051052322939 None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:20.292992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcd412-fc6e-44b6-a3ae-051052322939 None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:20.294947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcd412-fc6e-44b6-a3ae-051052322939 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:20.296162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 44/86] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:20 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:20.296917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcd412-fc6e-44b6-a3ae-051052322939 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:20.305062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fffaf-92e9-4537-80d3-b51ff734a79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:20.305927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fffaf-92e9-4537-80d3-b51ff734a79b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:20.306218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fffaf-92e9-4537-80d3-b51ff734a79b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:20.306502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fffaf-92e9-4537-80d3-b51ff734a79b None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:20.307738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fffaf-92e9-4537-80d3-b51ff734a79b None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:20.309220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3fffaf-92e9-4537-80d3-b51ff734a79b None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:20.310957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 43/87] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:20 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:20.311736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fffaf-92e9-4537-80d3-b51ff734a79b None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:20.396989 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcd412-fc6e-44b6-a3ae-051052322939 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:20.410587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fffaf-92e9-4537-80d3-b51ff734a79b None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:20.429594 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28229492-fb77-4323-a041-155a61986141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:20.430457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28229492-fb77-4323-a041-155a61986141 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:20.430739 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28229492-fb77-4323-a041-155a61986141 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:20.431015 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28229492-fb77-4323-a041-155a61986141 None admin] PATH_INFO: `/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:20.432210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28229492-fb77-4323-a041-155a61986141 None admin] RBAC: Authorizing `identity:get_user(user_id=fdc3b2b9c8654f7383bb4032c4f52f2a)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:20.433659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28229492-fb77-4323-a041-155a61986141 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:20.435295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 45/88] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:20 2022] GET /identity/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:20.436053 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28229492-fb77-4323-a041-155a61986141 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:20.443176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b8017-8864-47fa-b948-396c07604851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:20.443862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b8017-8864-47fa-b948-396c07604851 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:20.444153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b8017-8864-47fa-b948-396c07604851 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:20.444432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b8017-8864-47fa-b948-396c07604851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:20.459459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:20.475889 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:20.514127 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b8017-8864-47fa-b948-396c07604851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:20.515633 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b8017-8864-47fa-b948-396c07604851 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:20.541975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28229492-fb77-4323-a041-155a61986141 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:20.576392 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68cce5-228c-43ac-a1c7-d525e02e688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:20.577058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68cce5-228c-43ac-a1c7-d525e02e688c None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:20.577345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68cce5-228c-43ac-a1c7-d525e02e688c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:20.577622 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68cce5-228c-43ac-a1c7-d525e02e688c None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:20.578331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68cce5-228c-43ac-a1c7-d525e02e688c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:20.579817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d68cce5-228c-43ac-a1c7-d525e02e688c None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:20.611965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 44/89] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:20.612803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b8017-8864-47fa-b948-396c07604851 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:20.655810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:20.693628 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 46/90] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:32:20 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:32:20.694468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68cce5-228c-43ac-a1c7-d525e02e688c None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:20.709320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b8017-8864-47fa-b948-396c07604851 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:20.750571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc6541-9d0f-4f3c-a86b-35df0b97c769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:20.751248 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc6541-9d0f-4f3c-a86b-35df0b97c769 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:20.751569 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc6541-9d0f-4f3c-a86b-35df0b97c769 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:20.751844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc6541-9d0f-4f3c-a86b-35df0b97c769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:20.752697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc6541-9d0f-4f3c-a86b-35df0b97c769 None admin] RBAC: Adding query filter params (role.id=5c4481f023774d67997d4ba28e07cff0, scope.project.id=7cdc86a10dd449abbc708408ab6b0d78, user.id=fdc3b2b9c8654f7383bb4032c4f52f2a) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:20.753019 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc6541-9d0f-4f3c-a86b-35df0b97c769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:20.754534 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc6541-9d0f-4f3c-a86b-35df0b97c769 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:20.760586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 45/91] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:20 2022] GET /identity/v3/role_assignments?user.id=fdc3b2b9c8654f7383bb4032c4f52f2a&scope.project.id=7cdc86a10dd449abbc708408ab6b0d78&role.id=5c4481f023774d67997d4ba28e07cff0 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:20.771841 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc6541-9d0f-4f3c-a86b-35df0b97c769 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:20.817604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:20.826367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68cce5-228c-43ac-a1c7-d525e02e688c None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:20.879286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02051752-e61e-4bb9-9c8a-139e631a8b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:20.880017 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051752-e61e-4bb9-9c8a-139e631a8b4a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:20.880313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051752-e61e-4bb9-9c8a-139e631a8b4a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:20.880598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051752-e61e-4bb9-9c8a-139e631a8b4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:20.881808 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02051752-e61e-4bb9-9c8a-139e631a8b4a None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=7cdc86a10dd449abbc708408ab6b0d78, user.id=c8d6148460c64b19ad3d5930db893c77) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:20.881808 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02051752-e61e-4bb9-9c8a-139e631a8b4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:20.883332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02051752-e61e-4bb9-9c8a-139e631a8b4a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:20.894909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 47/92] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:20 2022] GET /identity/v3/role_assignments?user.id=c8d6148460c64b19ad3d5930db893c77&scope.project.id=7cdc86a10dd449abbc708408ab6b0d78&role.id=b156409c977248e1b23c26e589b1e04f => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:20.895100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02051752-e61e-4bb9-9c8a-139e631a8b4a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:20.984991 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc6541-9d0f-4f3c-a86b-35df0b97c769 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:20.996508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:21.036367 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611bbab-d895-4f4a-b4b1-6db21b74dbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:21.037446 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611bbab-d895-4f4a-b4b1-6db21b74dbbc None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:21.037583 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02051752-e61e-4bb9-9c8a-139e631a8b4a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:21.037784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611bbab-d895-4f4a-b4b1-6db21b74dbbc None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:21.038011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2611bbab-d895-4f4a-b4b1-6db21b74dbbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:21.090899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaeba5-6870-4522-b1db-2848ff7a601f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:21.091846 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaeba5-6870-4522-b1db-2848ff7a601f None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:21.092134 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaeba5-6870-4522-b1db-2848ff7a601f None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:21.092410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaeba5-6870-4522-b1db-2848ff7a601f None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:21.093703 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaeba5-6870-4522-b1db-2848ff7a601f None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:21.095195 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaeba5-6870-4522-b1db-2848ff7a601f None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:21.097161 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 48/93] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:20 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:21.102618 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaeba5-6870-4522-b1db-2848ff7a601f None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:21.131205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611bbab-d895-4f4a-b4b1-6db21b74dbbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:21.133070 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2611bbab-d895-4f4a-b4b1-6db21b74dbbc None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:21.160650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:21.238274 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 46/94] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:21.245064 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611bbab-d895-4f4a-b4b1-6db21b74dbbc None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:21.257164 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:21.269870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaeba5-6870-4522-b1db-2848ff7a601f None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:21.349249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59c70c-5145-4134-8e00-34c30e5620e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:21.349926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59c70c-5145-4134-8e00-34c30e5620e8 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:21.350221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59c70c-5145-4134-8e00-34c30e5620e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:21.350507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d59c70c-5145-4134-8e00-34c30e5620e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:21.351370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59c70c-5145-4134-8e00-34c30e5620e8 None admin] RBAC: Adding query filter params (role.id=422c41a081a44a4e8b04f4d9ce6e8930, scope.project.id=7cdc86a10dd449abbc708408ab6b0d78, user.id=fdc3b2b9c8654f7383bb4032c4f52f2a) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:21.351718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59c70c-5145-4134-8e00-34c30e5620e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:21.353238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d59c70c-5145-4134-8e00-34c30e5620e8 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:21.363567 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2611bbab-d895-4f4a-b4b1-6db21b74dbbc None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:21.367955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 49/95] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:21 2022] GET /identity/v3/role_assignments?user.id=fdc3b2b9c8654f7383bb4032c4f52f2a&scope.project.id=7cdc86a10dd449abbc708408ab6b0d78&role.id=422c41a081a44a4e8b04f4d9ce6e8930 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:21.421752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f704e-e919-4772-aa2c-a2feaef801f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:21.422976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f704e-e919-4772-aa2c-a2feaef801f9 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:21.423460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f704e-e919-4772-aa2c-a2feaef801f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:21.423934 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f704e-e919-4772-aa2c-a2feaef801f9 None admin] PATH_INFO: `/v3/projects/a793cca18e3a4241b259ffdcbb935e3b` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:21.428299 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f704e-e919-4772-aa2c-a2feaef801f9 None admin] RBAC: Authorizing `identity:get_project(project_id=a793cca18e3a4241b259ffdcbb935e3b)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:21.430093 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f704e-e919-4772-aa2c-a2feaef801f9 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:21.432535 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 47/96] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:21 2022] GET /identity/v3/projects/a793cca18e3a4241b259ffdcbb935e3b => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:21.438285 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59c70c-5145-4134-8e00-34c30e5620e8 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:21.598689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:21.613842 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d59c70c-5145-4134-8e00-34c30e5620e8 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:21.665949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de9e87-b7a4-4750-a96f-e47a4284ad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:21.666622 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de9e87-b7a4-4750-a96f-e47a4284ad42 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:21.666913 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de9e87-b7a4-4750-a96f-e47a4284ad42 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:21.667193 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de9e87-b7a4-4750-a96f-e47a4284ad42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:21.668622 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de9e87-b7a4-4750-a96f-e47a4284ad42 None admin] RBAC: Adding query filter params (role.id=5c4481f023774d67997d4ba28e07cff0, scope.project.id=a793cca18e3a4241b259ffdcbb935e3b, user.id=fdc3b2b9c8654f7383bb4032c4f52f2a) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:21.668947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de9e87-b7a4-4750-a96f-e47a4284ad42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:21.670416 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de9e87-b7a4-4750-a96f-e47a4284ad42 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:21.680380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 50/97] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:21 2022] GET /identity/v3/role_assignments?user.id=fdc3b2b9c8654f7383bb4032c4f52f2a&scope.project.id=a793cca18e3a4241b259ffdcbb935e3b&role.id=5c4481f023774d67997d4ba28e07cff0 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:23.475568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7cbc-6658-4518-8c08-063229e5ca28 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:23.475568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7cbc-6658-4518-8c08-063229e5ca28 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:23.475568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7cbc-6658-4518-8c08-063229e5ca28 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:23.476873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 48/98] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:23.481762 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5366641-52fc-4650-8e9f-4b94c1d91786 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:23.482150 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5366641-52fc-4650-8e9f-4b94c1d91786 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:23.482333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5366641-52fc-4650-8e9f-4b94c1d91786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:23.509020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-c5366641-52fc-4650-8e9f-4b94c1d91786 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:23.510512 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c5366641-52fc-4650-8e9f-4b94c1d91786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:23.610219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 51/99] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:23.641471 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8478081-408c-435c-b115-c9a877b253cc None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:23.641772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8478081-408c-435c-b115-c9a877b253cc None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:23.642052 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8478081-408c-435c-b115-c9a877b253cc None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:23.643465 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 49/100] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:23.645123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5366641-52fc-4650-8e9f-4b94c1d91786 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:23.658172 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8953eb-fda3-4fad-bf1c-54e245eac8f1 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:23.658462 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8953eb-fda3-4fad-bf1c-54e245eac8f1 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:23.658752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8953eb-fda3-4fad-bf1c-54e245eac8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:23.688559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-6b8953eb-fda3-4fad-bf1c-54e245eac8f1 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:23.690246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-6b8953eb-fda3-4fad-bf1c-54e245eac8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:23.786673 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:23.804982 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5366641-52fc-4650-8e9f-4b94c1d91786 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:23.825060 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 50/101] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:23.826722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646508b-2593-4c68-ba6d-eeb71da6f582 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:23.827162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646508b-2593-4c68-ba6d-eeb71da6f582 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:23.827613 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646508b-2593-4c68-ba6d-eeb71da6f582 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:23.829071 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 51/102] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:23.838403 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e0987-f791-421e-8319-9929025dd382 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:23.838403 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e0987-f791-421e-8319-9929025dd382 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:23.838403 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e0987-f791-421e-8319-9929025dd382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:23.912340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:23.927379 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-169e0987-f791-421e-8319-9929025dd382 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:23.928603 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-169e0987-f791-421e-8319-9929025dd382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:23.942080 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd5af1-f392-4df4-89b4-9dba520cc065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:23.943113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd5af1-f392-4df4-89b4-9dba520cc065 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:23.943612 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd5af1-f392-4df4-89b4-9dba520cc065 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:23.944137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd5af1-f392-4df4-89b4-9dba520cc065 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:23.945513 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd5af1-f392-4df4-89b4-9dba520cc065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:23.947184 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd5af1-f392-4df4-89b4-9dba520cc065 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:23.948969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 52/103] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:32:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:23.954530 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd5af1-f392-4df4-89b4-9dba520cc065 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:24.015554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 52/104] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:24.023980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5611f2e-4d71-48e3-90eb-ab817c856709 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:24.023980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5611f2e-4d71-48e3-90eb-ab817c856709 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:24.023980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5611f2e-4d71-48e3-90eb-ab817c856709 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:24.023980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 53/105] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:24.023980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5611f2e-4d71-48e3-90eb-ab817c856709 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:24.088487 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd5af1-f392-4df4-89b4-9dba520cc065 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:24.132044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a4eb94-a450-4c5b-8cfa-7c36ae5bfdd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:24.133724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4eb94-a450-4c5b-8cfa-7c36ae5bfdd3 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:24.134609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4eb94-a450-4c5b-8cfa-7c36ae5bfdd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:24.135084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a4eb94-a450-4c5b-8cfa-7c36ae5bfdd3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:24.157975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a4eb94-a450-4c5b-8cfa-7c36ae5bfdd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:24.160721 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5611f2e-4d71-48e3-90eb-ab817c856709 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:24.166906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-54a4eb94-a450-4c5b-8cfa-7c36ae5bfdd3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:24.166906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:24.166906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:24.166906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:24.166906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:24.166906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:24.166906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:24.166906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:24.166906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:24.166906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:24.166906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:24.166906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:24.166906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:24.166906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:24.166906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:24.166906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:24.167798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:24.167798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:24.167798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:24.167798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:24.167798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:24.167798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:24.167798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:24.167798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:24.167798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:24.167798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:24.167798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:24.167798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:24.167798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:24.167798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:24.167798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:24.167798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:24.169079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:24.169079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:24.169079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:24.169079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:24.169079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:24.169079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:24.169079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:24.169079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:24.169079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:24.169079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:24.169079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:24.169079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:24.171045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 53/106] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:24.177394 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e076d0-1ca0-422c-a4fd-21a2d8afb26f None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:24.177835 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e076d0-1ca0-422c-a4fd-21a2d8afb26f None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:24.178253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e076d0-1ca0-422c-a4fd-21a2d8afb26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:24.197380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-25e076d0-1ca0-422c-a4fd-21a2d8afb26f None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:24.198366 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c70fbe-e13d-4c52-a1bd-79b0530e6ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:24.199106 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-25e076d0-1ca0-422c-a4fd-21a2d8afb26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:24.199218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c70fbe-e13d-4c52-a1bd-79b0530e6ba3 None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:24.199645 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c70fbe-e13d-4c52-a1bd-79b0530e6ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:24.200047 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c70fbe-e13d-4c52-a1bd-79b0530e6ba3 None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:24.200855 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c70fbe-e13d-4c52-a1bd-79b0530e6ba3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:24.202412 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c70fbe-e13d-4c52-a1bd-79b0530e6ba3 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:24.206887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:24.209815 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:24.270385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 54/107] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:24.271445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e076d0-1ca0-422c-a4fd-21a2d8afb26f None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:24.305542 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 54/108] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jun 27 18:32:24 2022] POST /identity/v3/projects => generated 302 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:32:24.306469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c70fbe-e13d-4c52-a1bd-79b0530e6ba3 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:24.410996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e076d0-1ca0-422c-a4fd-21a2d8afb26f None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:24.454029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02aebd5-7b61-47bb-b486-0b5ecd314099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:24.455155 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aebd5-7b61-47bb-b486-0b5ecd314099 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:24.455704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aebd5-7b61-47bb-b486-0b5ecd314099 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:24.456341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02aebd5-7b61-47bb-b486-0b5ecd314099 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:24.471065 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02aebd5-7b61-47bb-b486-0b5ecd314099 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:24.480227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-f02aebd5-7b61-47bb-b486-0b5ecd314099 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:24.480227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:24.480227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:24.480227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:24.480227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:24.480227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:24.480227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:24.480227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:24.480227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:24.480227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:24.480227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:24.480227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:24.480227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:24.480227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:24.480227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:24.480227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:24.481737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:24.481737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:24.481737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:24.481737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:24.481737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:24.481737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:24.481737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:24.481737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:24.481737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:24.481737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:24.481737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:24.481737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:24.481737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:24.481737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:24.481737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:24.481737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:24.483262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:24.483262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:24.483262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:24.483262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:24.483262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:24.483262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:24.483262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:24.483262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:24.483262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:24.483262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:24.483262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:24.483262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:24.485720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 55/109] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:32:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:24.487175 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02aebd5-7b61-47bb-b486-0b5ecd314099 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:24.490406 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:24.577771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c70fbe-e13d-4c52-a1bd-79b0530e6ba3 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:24.615480 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02aebd5-7b61-47bb-b486-0b5ecd314099 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:24.618111 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe37f6-3d98-4959-afcc-5247bbc0fc16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:24.619648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe37f6-3d98-4959-afcc-5247bbc0fc16 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:24.619938 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe37f6-3d98-4959-afcc-5247bbc0fc16 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:24.620216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe37f6-3d98-4959-afcc-5247bbc0fc16 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:24.621507 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe37f6-3d98-4959-afcc-5247bbc0fc16 None admin] RBAC: Adding query filter params (name=member) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:24.621821 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe37f6-3d98-4959-afcc-5247bbc0fc16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:24.623211 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe37f6-3d98-4959-afcc-5247bbc0fc16 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:24.634000 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 55/110] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:24.635111 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe37f6-3d98-4959-afcc-5247bbc0fc16 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:24.657288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974667-87da-4f0d-a0e0-d1a0f0d5c053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:24.658124 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974667-87da-4f0d-a0e0-d1a0f0d5c053 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:24.658406 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974667-87da-4f0d-a0e0-d1a0f0d5c053 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:24.658689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b974667-87da-4f0d-a0e0-d1a0f0d5c053 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:24.673352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b974667-87da-4f0d-a0e0-d1a0f0d5c053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:24.681745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-4b974667-87da-4f0d-a0e0-d1a0f0d5c053 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:24.681745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:24.681745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:24.681745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:24.681745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:24.681745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:24.681745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:24.681745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:24.681745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:24.681745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:24.681745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:24.681745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:24.681745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:24.681745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:24.681745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:24.681745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:24.682629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:24.682629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:24.682629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:24.682629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:24.682629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:24.682629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:24.682629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:24.682629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:24.682629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:24.682629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:24.682629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:24.682629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:24.682629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:24.682629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:24.682629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:24.682629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:24.683412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:24.683412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:24.683412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:24.683412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:24.683412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:24.683412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:24.683412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:24.683412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:24.683412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:24.683412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:24.683412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:24.683412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:24.683412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 56/111] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:24.684617 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974667-87da-4f0d-a0e0-d1a0f0d5c053 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:24.714199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:24.755163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:24.780462 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe37f6-3d98-4959-afcc-5247bbc0fc16 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:24.800895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b974667-87da-4f0d-a0e0-d1a0f0d5c053 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:24.817496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da2d77-39ea-4c30-b869-6b36a2059140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:24.818171 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da2d77-39ea-4c30-b869-6b36a2059140 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:24.818462 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da2d77-39ea-4c30-b869-6b36a2059140 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:24.818749 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da2d77-39ea-4c30-b869-6b36a2059140 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:24.819512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da2d77-39ea-4c30-b869-6b36a2059140 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:24.819855 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da2d77-39ea-4c30-b869-6b36a2059140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:24.821262 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da2d77-39ea-4c30-b869-6b36a2059140 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:24.829696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 56/112] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:24.830980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbadde1-e750-41c8-99ce-673d44b92947 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:24.831271 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbadde1-e750-41c8-99ce-673d44b92947 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:24.834076 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbadde1-e750-41c8-99ce-673d44b92947 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:24.834076 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 57/113] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:24.834076 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbadde1-e750-41c8-99ce-673d44b92947 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:24.846375 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc750402-21a0-4f61-ad2c-11b620b0678e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:24.847914 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc750402-21a0-4f61-ad2c-11b620b0678e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:24.848209 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc750402-21a0-4f61-ad2c-11b620b0678e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:24.848542 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc750402-21a0-4f61-ad2c-11b620b0678e None admin] PATH_INFO: `/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:24.849757 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc750402-21a0-4f61-ad2c-11b620b0678e None admin] RBAC: Authorizing `identity:get_user(user_id=fdc3b2b9c8654f7383bb4032c4f52f2a)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:24.851405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc750402-21a0-4f61-ad2c-11b620b0678e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:24.857980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 57/114] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:24 2022] GET /identity/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:24.857980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ff624-c9b5-4703-ad81-8d15ab7d33ae None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:24.857980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ff624-c9b5-4703-ad81-8d15ab7d33ae None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:24.857980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2ff624-c9b5-4703-ad81-8d15ab7d33ae None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:24.857980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 58/115] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:24.861371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ff624-c9b5-4703-ad81-8d15ab7d33ae None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:24.951835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbadde1-e750-41c8-99ce-673d44b92947 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:24.965144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:24.968332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2ff624-c9b5-4703-ad81-8d15ab7d33ae None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:24.986519 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b88a3-acba-4e98-83ee-551c3fa73e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:24.987303 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b88a3-acba-4e98-83ee-551c3fa73e2d None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:24.987689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b88a3-acba-4e98-83ee-551c3fa73e2d None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:24.987977 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b88a3-acba-4e98-83ee-551c3fa73e2d None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:24.988728 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b88a3-acba-4e98-83ee-551c3fa73e2d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:24.989042 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b88a3-acba-4e98-83ee-551c3fa73e2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:24.990442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b88a3-acba-4e98-83ee-551c3fa73e2d None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:25.002093 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 58/116] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:25.002382 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:25.003640 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba654d-98c8-403d-bfbf-314fcc98e297 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:25.004062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba654d-98c8-403d-bfbf-314fcc98e297 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:25.004481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba654d-98c8-403d-bfbf-314fcc98e297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:25.007989 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef4cbc-2150-41fd-9dc2-7ca198376900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:25.008843 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef4cbc-2150-41fd-9dc2-7ca198376900 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:25.009128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef4cbc-2150-41fd-9dc2-7ca198376900 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:25.009405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef4cbc-2150-41fd-9dc2-7ca198376900 None admin] PATH_INFO: `/v3/users/c8d6148460c64b19ad3d5930db893c77` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:25.010738 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef4cbc-2150-41fd-9dc2-7ca198376900 None admin] RBAC: Authorizing `identity:get_user(user_id=c8d6148460c64b19ad3d5930db893c77)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:25.012733 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef4cbc-2150-41fd-9dc2-7ca198376900 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:25.015120 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 59/117] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:24 2022] GET /identity/v3/users/c8d6148460c64b19ad3d5930db893c77 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:25.015787 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef4cbc-2150-41fd-9dc2-7ca198376900 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:25.025315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-91ba654d-98c8-403d-bfbf-314fcc98e297 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:25.026555 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-91ba654d-98c8-403d-bfbf-314fcc98e297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:25.097126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 59/118] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:25.101390 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13e67e-6ab7-4d21-b3ad-a7f85ddadc95 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:25.101760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13e67e-6ab7-4d21-b3ad-a7f85ddadc95 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:25.102182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13e67e-6ab7-4d21-b3ad-a7f85ddadc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:25.124365 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-9f13e67e-6ab7-4d21-b3ad-a7f85ddadc95 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:25.125812 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9f13e67e-6ab7-4d21-b3ad-a7f85ddadc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:25.128874 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef4cbc-2150-41fd-9dc2-7ca198376900 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:25.164512 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9455ca-09af-426e-86ea-80a77b8756f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:25.165385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9455ca-09af-426e-86ea-80a77b8756f9 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:25.165765 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9455ca-09af-426e-86ea-80a77b8756f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:25.166045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9455ca-09af-426e-86ea-80a77b8756f9 None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:25.167250 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9455ca-09af-426e-86ea-80a77b8756f9 None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:25.169414 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9455ca-09af-426e-86ea-80a77b8756f9 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:25.175616 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 60/119] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:25 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:25.175616 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9455ca-09af-426e-86ea-80a77b8756f9 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:25.200576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 60/120] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:25.201332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13e67e-6ab7-4d21-b3ad-a7f85ddadc95 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:25.236000 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:25.254300 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:25.290405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9455ca-09af-426e-86ea-80a77b8756f9 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:25.301838 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13e67e-6ab7-4d21-b3ad-a7f85ddadc95 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:25.326613 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085e077-5e18-42ee-8efb-f91ae100739e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:25.327889 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085e077-5e18-42ee-8efb-f91ae100739e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:25.328433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085e077-5e18-42ee-8efb-f91ae100739e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:25.328920 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085e077-5e18-42ee-8efb-f91ae100739e None admin] PATH_INFO: `/v3/users/e47a4b999cf647de936704e5db4285ae` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:25.336290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5223a7-fcab-425b-9946-1e2c93ffb471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:25.337554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5223a7-fcab-425b-9946-1e2c93ffb471 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:25.337846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5223a7-fcab-425b-9946-1e2c93ffb471 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:25.338129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5223a7-fcab-425b-9946-1e2c93ffb471 None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:25.339479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5223a7-fcab-425b-9946-1e2c93ffb471 None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:25.341500 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5223a7-fcab-425b-9946-1e2c93ffb471 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:25.343451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 61/121] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:25 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:25.343986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5223a7-fcab-425b-9946-1e2c93ffb471 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:25.349364 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085e077-5e18-42ee-8efb-f91ae100739e None admin] RBAC: Authorizing `identity:get_user(user_id=e47a4b999cf647de936704e5db4285ae)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:25.350830 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085e077-5e18-42ee-8efb-f91ae100739e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:25.352701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 61/122] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:25 2022] GET /identity/v3/users/e47a4b999cf647de936704e5db4285ae => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:25.353301 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085e077-5e18-42ee-8efb-f91ae100739e None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:25.462282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085e077-5e18-42ee-8efb-f91ae100739e None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:25.463701 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5223a7-fcab-425b-9946-1e2c93ffb471 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:25.466658 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:25.488155 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:25.498671 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab22a1-bf03-4a53-a549-3db931d6badf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:25.499597 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab22a1-bf03-4a53-a549-3db931d6badf None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:25.499887 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab22a1-bf03-4a53-a549-3db931d6badf None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:25.500171 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab22a1-bf03-4a53-a549-3db931d6badf None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78/users/fdc3b2b9c8654f7383bb4032c4f52f2a/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:25.501948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9960f-1013-425c-80f5-647801504820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:25.502229 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab22a1-bf03-4a53-a549-3db931d6badf None admin] RBAC: Authorizing `identity:create_grant(project_id=7cdc86a10dd449abbc708408ab6b0d78, user_id=fdc3b2b9c8654f7383bb4032c4f52f2a, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:25.502753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9960f-1013-425c-80f5-647801504820 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:25.503039 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9960f-1013-425c-80f5-647801504820 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:25.503316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d9960f-1013-425c-80f5-647801504820 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:25.503778 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab22a1-bf03-4a53-a549-3db931d6badf None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:25.515761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d9960f-1013-425c-80f5-647801504820 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:25.524768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-08d9960f-1013-425c-80f5-647801504820 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:25.524768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:25.524768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:25.524768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:25.524768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:25.524768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:25.524768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:25.524768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:25.524768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:25.524768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:25.524768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:25.524768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:25.524768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:25.524768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:25.524768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:25.524768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:25.525782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:25.525782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:25.525782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:25.525782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:25.525782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:25.525782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:25.525782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:25.525782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:25.525782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:25.525782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:25.525782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:25.525782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:25.525782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:25.525782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:25.525782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:25.525782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:25.526628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:25.526628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:25.526628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:25.526628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:25.526628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:25.526628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:25.526628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:25.526628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:25.526628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:25.526628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:25.526628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:25.526628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:25.533020 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 62/123] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:32:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:25.533020 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9960f-1013-425c-80f5-647801504820 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:25.591862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 62/124] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:32:25 2022] PUT /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78/users/fdc3b2b9c8654f7383bb4032c4f52f2a/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:32:25.591862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab22a1-bf03-4a53-a549-3db931d6badf None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:25.643885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d9960f-1013-425c-80f5-647801504820 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:25.687197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36e4bf-89bc-4aa2-b88d-317539b7a624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:25.688292 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36e4bf-89bc-4aa2-b88d-317539b7a624 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:25.688656 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36e4bf-89bc-4aa2-b88d-317539b7a624 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:25.688944 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36e4bf-89bc-4aa2-b88d-317539b7a624 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:25.701457 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36e4bf-89bc-4aa2-b88d-317539b7a624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:25.709877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-2c36e4bf-89bc-4aa2-b88d-317539b7a624 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:25.709877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:25.709877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:25.709877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:25.709877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:25.709877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:25.709877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:25.709877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:25.709877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:25.709877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:25.709877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:25.709877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:25.709877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:25.709877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:25.709877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:25.709877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:25.711024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:25.711024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:25.711024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:25.711024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:25.711024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:25.711024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:25.711024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:25.711024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:25.711024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:25.711024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:25.711024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:25.711024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:25.711024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:25.711024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:25.711024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:25.711024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:25.711862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:25.711862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:25.711862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:25.711862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:25.711862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:25.711862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:25.711862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:25.711862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:25.711862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:25.711862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:25.711862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:25.711862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:25.711862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 63/125] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:25.712496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36e4bf-89bc-4aa2-b88d-317539b7a624 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:25.747935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:25.754731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab22a1-bf03-4a53-a549-3db931d6badf None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:25.799418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0750b5f-539c-4c60-88c1-3ca7339fbccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:25.800437 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0750b5f-539c-4c60-88c1-3ca7339fbccc None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:25.800734 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0750b5f-539c-4c60-88c1-3ca7339fbccc None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:25.801074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0750b5f-539c-4c60-88c1-3ca7339fbccc None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78/users/c8d6148460c64b19ad3d5930db893c77/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:25.803104 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0750b5f-539c-4c60-88c1-3ca7339fbccc None admin] RBAC: Authorizing `identity:create_grant(project_id=7cdc86a10dd449abbc708408ab6b0d78, user_id=c8d6148460c64b19ad3d5930db893c77, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:25.806300 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0750b5f-539c-4c60-88c1-3ca7339fbccc None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:25.840880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36e4bf-89bc-4aa2-b88d-317539b7a624 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:25.874970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d83dc-3b3b-425c-b7e0-e7facc15f70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:25.875656 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d83dc-3b3b-425c-b7e0-e7facc15f70a None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:25.875947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d83dc-3b3b-425c-b7e0-e7facc15f70a None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:25.876232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d83dc-3b3b-425c-b7e0-e7facc15f70a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:25.940743 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 63/126] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:32:25 2022] PUT /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78/users/c8d6148460c64b19ad3d5930db893c77/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:32:25.941585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0750b5f-539c-4c60-88c1-3ca7339fbccc None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:25.950816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d83dc-3b3b-425c-b7e0-e7facc15f70a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:25.952355 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d83dc-3b3b-425c-b7e0-e7facc15f70a None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:26.005494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:26.037984 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:26.139702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0750b5f-539c-4c60-88c1-3ca7339fbccc None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:26.158376 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 64/127] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:26.159323 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d83dc-3b3b-425c-b7e0-e7facc15f70a None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:26.185788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bb4a0-5ad9-4e3e-9cc9-a66b59be23b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:26.186774 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bb4a0-5ad9-4e3e-9cc9-a66b59be23b9 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:26.187070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bb4a0-5ad9-4e3e-9cc9-a66b59be23b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:26.187630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803bb4a0-5ad9-4e3e-9cc9-a66b59be23b9 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:26.188850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bb4a0-5ad9-4e3e-9cc9-a66b59be23b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:26.189174 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bb4a0-5ad9-4e3e-9cc9-a66b59be23b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:26.191134 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803bb4a0-5ad9-4e3e-9cc9-a66b59be23b9 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:26.201781 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 64/128] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:32:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:26.202761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bb4a0-5ad9-4e3e-9cc9-a66b59be23b9 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:26.289333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d83dc-3b3b-425c-b7e0-e7facc15f70a None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:26.306042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803bb4a0-5ad9-4e3e-9cc9-a66b59be23b9 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:26.313771 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:26.330954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:26.341707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cc2e6-0ec5-4976-ab74-f855469ef629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:26.342581 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cc2e6-0ec5-4976-ab74-f855469ef629 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:26.342868 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cc2e6-0ec5-4976-ab74-f855469ef629 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:26.343148 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469cc2e6-0ec5-4976-ab74-f855469ef629 None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:26.344378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469cc2e6-0ec5-4976-ab74-f855469ef629 None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:26.345903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469cc2e6-0ec5-4976-ab74-f855469ef629 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:26.347816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 65/129] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:26 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:26.348678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cc2e6-0ec5-4976-ab74-f855469ef629 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:26.353461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1bd16-24ee-4035-8d97-ebeddf464295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:26.354155 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1bd16-24ee-4035-8d97-ebeddf464295 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:26.354444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1bd16-24ee-4035-8d97-ebeddf464295 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:26.354726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc1bd16-24ee-4035-8d97-ebeddf464295 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:26.356047 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1bd16-24ee-4035-8d97-ebeddf464295 None admin] RBAC: Adding query filter params (name=member) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:26.356364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1bd16-24ee-4035-8d97-ebeddf464295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:26.358032 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc1bd16-24ee-4035-8d97-ebeddf464295 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:26.367156 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 65/130] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:26.367978 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1bd16-24ee-4035-8d97-ebeddf464295 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:26.459910 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469cc2e6-0ec5-4976-ab74-f855469ef629 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:26.509176 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0551e6d-e575-4a59-97ca-7755c0c49d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:26.513243 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0551e6d-e575-4a59-97ca-7755c0c49d37 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:26.513243 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0551e6d-e575-4a59-97ca-7755c0c49d37 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:26.513243 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0551e6d-e575-4a59-97ca-7755c0c49d37 None admin] PATH_INFO: `/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:26.516526 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0551e6d-e575-4a59-97ca-7755c0c49d37 None admin] RBAC: Authorizing `identity:get_user(user_id=fdc3b2b9c8654f7383bb4032c4f52f2a)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:26.518015 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0551e6d-e575-4a59-97ca-7755c0c49d37 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:26.519741 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 66/131] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:26 2022] GET /identity/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:26.522882 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc1bd16-24ee-4035-8d97-ebeddf464295 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:26.528161 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0551e6d-e575-4a59-97ca-7755c0c49d37 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:26.568228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1c12d-ee2c-406a-9312-63afad6ff4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:26.568999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c12d-ee2c-406a-9312-63afad6ff4a3 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:26.569394 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c12d-ee2c-406a-9312-63afad6ff4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:26.569679 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1c12d-ee2c-406a-9312-63afad6ff4a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:26.570525 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1c12d-ee2c-406a-9312-63afad6ff4a3 None admin] RBAC: Adding query filter params (role.id=c022b2199d7449faa0831ed802c403d3, scope.project.id=7cdc86a10dd449abbc708408ab6b0d78, user.id=e47a4b999cf647de936704e5db4285ae) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:26.570848 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1c12d-ee2c-406a-9312-63afad6ff4a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:26.572574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1c12d-ee2c-406a-9312-63afad6ff4a3 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:26.584580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:26.588995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 66/132] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:26 2022] GET /identity/v3/role_assignments?user.id=e47a4b999cf647de936704e5db4285ae&scope.project.id=7cdc86a10dd449abbc708408ab6b0d78&role.id=c022b2199d7449faa0831ed802c403d3 => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:26.590365 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1c12d-ee2c-406a-9312-63afad6ff4a3 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:26.649662 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0551e6d-e575-4a59-97ca-7755c0c49d37 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:26.685603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724933c-3dbb-4f57-b03f-89d53dd8dce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:26.686500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724933c-3dbb-4f57-b03f-89d53dd8dce8 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:26.686775 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724933c-3dbb-4f57-b03f-89d53dd8dce8 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:26.687057 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724933c-3dbb-4f57-b03f-89d53dd8dce8 None admin] PATH_INFO: `/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:26.688370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724933c-3dbb-4f57-b03f-89d53dd8dce8 None admin] RBAC: Authorizing `identity:get_user(user_id=fdc3b2b9c8654f7383bb4032c4f52f2a)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:26.690006 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724933c-3dbb-4f57-b03f-89d53dd8dce8 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:26.692008 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 67/133] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:26 2022] GET /identity/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:26.697448 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724933c-3dbb-4f57-b03f-89d53dd8dce8 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:26.724193 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:26.790770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1c12d-ee2c-406a-9312-63afad6ff4a3 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:26.828445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724933c-3dbb-4f57-b03f-89d53dd8dce8 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:26.828891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21c6e5-86ea-4e9f-8838-738ee337f285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:26.829936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21c6e5-86ea-4e9f-8838-738ee337f285 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:26.830234 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21c6e5-86ea-4e9f-8838-738ee337f285 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:26.830518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21c6e5-86ea-4e9f-8838-738ee337f285 None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:26.831834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:26.832025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21c6e5-86ea-4e9f-8838-738ee337f285 None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:26.833397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21c6e5-86ea-4e9f-8838-738ee337f285 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:26.835259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 67/134] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:26 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:26.837782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7477175-f32b-4688-9446-b251866e2d63 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:26.838263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7477175-f32b-4688-9446-b251866e2d63 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:26.838741 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7477175-f32b-4688-9446-b251866e2d63 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:26.841037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 68/135] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:26.846717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943a94e-5433-496e-843f-5e8756747843 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:26.847002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943a94e-5433-496e-843f-5e8756747843 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:26.847286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2943a94e-5433-496e-843f-5e8756747843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:26.869329 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-2943a94e-5433-496e-843f-5e8756747843 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:26.872050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2943a94e-5433-496e-843f-5e8756747843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:26.875379 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c95390-334b-4fcc-b7bd-ebe31450c4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:26.876391 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c95390-334b-4fcc-b7bd-ebe31450c4e6 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:26.876734 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c95390-334b-4fcc-b7bd-ebe31450c4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:26.877014 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c95390-334b-4fcc-b7bd-ebe31450c4e6 None admin] PATH_INFO: `/v3/projects/a793cca18e3a4241b259ffdcbb935e3b` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:26.878300 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c95390-334b-4fcc-b7bd-ebe31450c4e6 None admin] RBAC: Authorizing `identity:get_project(project_id=a793cca18e3a4241b259ffdcbb935e3b)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:26.879860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c95390-334b-4fcc-b7bd-ebe31450c4e6 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:26.888039 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 68/136] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:26 2022] GET /identity/v3/projects/a793cca18e3a4241b259ffdcbb935e3b => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:26.889511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c95390-334b-4fcc-b7bd-ebe31450c4e6 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:26.965737 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 69/137] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:26.966566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943a94e-5433-496e-843f-5e8756747843 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:27.027264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:27.087618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2943a94e-5433-496e-843f-5e8756747843 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:27.098389 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c95390-334b-4fcc-b7bd-ebe31450c4e6 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:27.127126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90007d8b-6912-4317-b262-603599204eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:27.128088 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90007d8b-6912-4317-b262-603599204eda None admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:27.128376 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90007d8b-6912-4317-b262-603599204eda None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:27.128660 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90007d8b-6912-4317-b262-603599204eda None admin] PATH_INFO: `/v3/projects/a793cca18e3a4241b259ffdcbb935e3b/users/fdc3b2b9c8654f7383bb4032c4f52f2a/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:27.130660 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90007d8b-6912-4317-b262-603599204eda None admin] RBAC: Authorizing `identity:create_grant(project_id=a793cca18e3a4241b259ffdcbb935e3b, user_id=fdc3b2b9c8654f7383bb4032c4f52f2a, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:27.132216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90007d8b-6912-4317-b262-603599204eda None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:27.158763 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc4aa-5b7b-4bca-9acf-25862fbd7648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:27.159753 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc4aa-5b7b-4bca-9acf-25862fbd7648 None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:27.160051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc4aa-5b7b-4bca-9acf-25862fbd7648 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:27.160338 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ecc4aa-5b7b-4bca-9acf-25862fbd7648 None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78/users/fdc3b2b9c8654f7383bb4032c4f52f2a/roles/422c41a081a44a4e8b04f4d9ce6e8930` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:27.162752 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecc4aa-5b7b-4bca-9acf-25862fbd7648 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cdc86a10dd449abbc708408ab6b0d78, user_id=fdc3b2b9c8654f7383bb4032c4f52f2a, role_id=422c41a081a44a4e8b04f4d9ce6e8930)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:27.164256 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ecc4aa-5b7b-4bca-9acf-25862fbd7648 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:27.205002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 70/138] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:32:26 2022] PUT /identity/v3/projects/a793cca18e3a4241b259ffdcbb935e3b/users/fdc3b2b9c8654f7383bb4032c4f52f2a/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:32:27.206067 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90007d8b-6912-4317-b262-603599204eda None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:27.238001 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 69/139] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:32:26 2022] PUT /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78/users/fdc3b2b9c8654f7383bb4032c4f52f2a/roles/422c41a081a44a4e8b04f4d9ce6e8930 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:32:27.358115 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90007d8b-6912-4317-b262-603599204eda None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:27.366670 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:27.399125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b91eb3-f8a4-4dad-865b-05ca402e0e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:27.400365 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b91eb3-f8a4-4dad-865b-05ca402e0e03 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:27.400879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b91eb3-f8a4-4dad-865b-05ca402e0e03 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:27.401362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b91eb3-f8a4-4dad-865b-05ca402e0e03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:27.403623 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b91eb3-f8a4-4dad-865b-05ca402e0e03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:27.405371 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b91eb3-f8a4-4dad-865b-05ca402e0e03 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:27.407352 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 71/140] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:32:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:27.413084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc4aa-5b7b-4bca-9acf-25862fbd7648 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:27.485428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:27.569065 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ecc4aa-5b7b-4bca-9acf-25862fbd7648 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:27.610257 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da211337-f247-49c5-bc9f-88e138c454eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:27.610924 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da211337-f247-49c5-bc9f-88e138c454eb None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:27.611219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da211337-f247-49c5-bc9f-88e138c454eb None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:27.611509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da211337-f247-49c5-bc9f-88e138c454eb None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:27.612287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da211337-f247-49c5-bc9f-88e138c454eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:27.613764 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da211337-f247-49c5-bc9f-88e138c454eb None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:27.701346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 70/141] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:32:27 2022] POST /identity/v3/users => generated 283 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:32:28.104905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd6598-42dd-4f7a-96c5-931ba70ac15c None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:28.106460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd6598-42dd-4f7a-96c5-931ba70ac15c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:28.106951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd6598-42dd-4f7a-96c5-931ba70ac15c None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:28.108819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 72/142] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:28.114240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a20c64-f60d-439b-b5f1-7e271046dbcd None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:28.114733 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a20c64-f60d-439b-b5f1-7e271046dbcd None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:28.115195 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a20c64-f60d-439b-b5f1-7e271046dbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:28.133195 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-24a20c64-f60d-439b-b5f1-7e271046dbcd None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:28.134717 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-24a20c64-f60d-439b-b5f1-7e271046dbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:28.205379 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 71/143] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:28.242230 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd6598-42dd-4f7a-96c5-931ba70ac15c None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:28.373510 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd6598-42dd-4f7a-96c5-931ba70ac15c None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:28.423825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecf87d-baeb-4f0e-85fc-1619c2342ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:28.424954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecf87d-baeb-4f0e-85fc-1619c2342ab8 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:28.425431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecf87d-baeb-4f0e-85fc-1619c2342ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:28.425951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecf87d-baeb-4f0e-85fc-1619c2342ab8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:28.442599 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fecf87d-baeb-4f0e-85fc-1619c2342ab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:28.450891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-6fecf87d-baeb-4f0e-85fc-1619c2342ab8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:28.450891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:28.450891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:28.450891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:28.450891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:28.450891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:28.450891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:28.450891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:28.450891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:28.450891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:28.450891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:28.450891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:28.450891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:28.450891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:28.450891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:28.450891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:28.451827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:28.451827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:28.451827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:28.451827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:28.451827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:28.451827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:28.451827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:28.451827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:28.451827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:28.451827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:28.451827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:28.451827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:28.451827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:28.451827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:28.451827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:28.451827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:28.452625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:28.452625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:28.452625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:28.452625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:28.452625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:28.452625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:28.452625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:28.452625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:28.452625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:28.452625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:28.452625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:28.452625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:28.454657 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 73/144] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:28.460548 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a20c64-f60d-439b-b5f1-7e271046dbcd None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:28.486485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:28.585615 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a20c64-f60d-439b-b5f1-7e271046dbcd None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:28.630559 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47976be5-f74b-499f-90fb-31370cad5e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:28.631451 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47976be5-f74b-499f-90fb-31370cad5e72 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:28.631921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47976be5-f74b-499f-90fb-31370cad5e72 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:28.632354 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47976be5-f74b-499f-90fb-31370cad5e72 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:28.633267 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47976be5-f74b-499f-90fb-31370cad5e72 None admin] RBAC: Adding query filter params (name=member) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:28.633723 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47976be5-f74b-499f-90fb-31370cad5e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:28.635315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47976be5-f74b-499f-90fb-31370cad5e72 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:28.646347 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 72/145] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:28.651978 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecf87d-baeb-4f0e-85fc-1619c2342ab8 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:28.690308 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:28.720326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c1ace-8021-42c9-92fd-18f4bddbbf5e None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:28.720626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c1ace-8021-42c9-92fd-18f4bddbbf5e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:28.720901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c1ace-8021-42c9-92fd-18f4bddbbf5e None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:28.722324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 73/146] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:32:28.728198 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49d3db-ac6a-4096-b0cb-1081b549fe91 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:28.728767 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49d3db-ac6a-4096-b0cb-1081b549fe91 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:28.729331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e49d3db-ac6a-4096-b0cb-1081b549fe91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:28.751786 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-5e49d3db-ac6a-4096-b0cb-1081b549fe91 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:28.753321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5e49d3db-ac6a-4096-b0cb-1081b549fe91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:28.787091 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecf87d-baeb-4f0e-85fc-1619c2342ab8 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:28.843498 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 74/147] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:28.856442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8284ce-6a1b-4421-891d-323a9d52c7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:28.857340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8284ce-6a1b-4421-891d-323a9d52c7e8 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:28.857887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8284ce-6a1b-4421-891d-323a9d52c7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:28.858163 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8284ce-6a1b-4421-891d-323a9d52c7e8 None admin] PATH_INFO: `/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:28.859427 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8284ce-6a1b-4421-891d-323a9d52c7e8 None admin] RBAC: Authorizing `identity:get_user(user_id=fdc3b2b9c8654f7383bb4032c4f52f2a)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:28.861017 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8284ce-6a1b-4421-891d-323a9d52c7e8 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:28.862957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 74/148] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:28 2022] GET /identity/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:28.868178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49d3db-ac6a-4096-b0cb-1081b549fe91 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:28.892120 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:28.896989 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8284ce-6a1b-4421-891d-323a9d52c7e8 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:29.069968 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e49d3db-ac6a-4096-b0cb-1081b549fe91 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:29.119623 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8284ce-6a1b-4421-891d-323a9d52c7e8 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:29.121980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:29.123642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00147fcd-4e02-441c-83e2-45c8cc096067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:29.124516 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00147fcd-4e02-441c-83e2-45c8cc096067 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:29.124999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00147fcd-4e02-441c-83e2-45c8cc096067 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:29.125464 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00147fcd-4e02-441c-83e2-45c8cc096067 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:29.186220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2434c-de71-4db5-bb8f-60ef7d5600fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:29.187381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2434c-de71-4db5-bb8f-60ef7d5600fb None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:29.187951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2434c-de71-4db5-bb8f-60ef7d5600fb None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:29.188557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2434c-de71-4db5-bb8f-60ef7d5600fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:29.206628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2434c-de71-4db5-bb8f-60ef7d5600fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:29.210515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00147fcd-4e02-441c-83e2-45c8cc096067 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:29.215551 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00147fcd-4e02-441c-83e2-45c8cc096067 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:29.219771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-13b2434c-de71-4db5-bb8f-60ef7d5600fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:29.219771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:29.219771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:29.219771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:29.219771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:29.219771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:29.219771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:29.219771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:29.219771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:29.219771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:29.219771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:29.219771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:29.219771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:29.219771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:29.219771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:29.219771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:29.220649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:29.220649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:29.220649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:29.220649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:29.220649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:29.220649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:29.220649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:29.220649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:29.220649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:29.220649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:29.220649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:29.220649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:29.220649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:29.220649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:29.220649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:29.220649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:29.221443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:29.221443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:29.221443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:29.221443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:29.221443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:29.221443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:29.221443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:29.221443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:29.221443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:29.221443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:29.221443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:29.221443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:29.223963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 75/149] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:32:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:32:29.233825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2434c-de71-4db5-bb8f-60ef7d5600fb None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:29.242310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:29.346863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 75/150] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:29.353421 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00147fcd-4e02-441c-83e2-45c8cc096067 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:29.417351 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2434c-de71-4db5-bb8f-60ef7d5600fb None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:29.477607 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00147fcd-4e02-441c-83e2-45c8cc096067 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:29.479041 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3a1e7-49a3-434f-8366-8e790f75e6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:29.479940 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3a1e7-49a3-434f-8366-8e790f75e6c2 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:29.480852 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3a1e7-49a3-434f-8366-8e790f75e6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:29.481229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3a1e7-49a3-434f-8366-8e790f75e6c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:29.482182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3a1e7-49a3-434f-8366-8e790f75e6c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:29.482974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3a1e7-49a3-434f-8366-8e790f75e6c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:29.484628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b3a1e7-49a3-434f-8366-8e790f75e6c2 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:29.498978 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:29.503238 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 76/151] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:29.509163 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3a1e7-49a3-434f-8366-8e790f75e6c2 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:29.531512 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d2356-6ef6-4c62-bd06-cfe4d6a6be3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:29.533116 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d2356-6ef6-4c62-bd06-cfe4d6a6be3d None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:29.533599 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d2356-6ef6-4c62-bd06-cfe4d6a6be3d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:29.534392 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d2356-6ef6-4c62-bd06-cfe4d6a6be3d None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:29.535978 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d2356-6ef6-4c62-bd06-cfe4d6a6be3d None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:29.538017 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d2356-6ef6-4c62-bd06-cfe4d6a6be3d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:29.540782 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 76/152] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:29 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:29.547190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d2356-6ef6-4c62-bd06-cfe4d6a6be3d None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:29.563924 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:29.695812 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d2356-6ef6-4c62-bd06-cfe4d6a6be3d None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:29.738093 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3a1e7-49a3-434f-8366-8e790f75e6c2 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:29.789769 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2688221-f423-4858-b294-7f55be9aa24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:29.790960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2688221-f423-4858-b294-7f55be9aa24b None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:29.791551 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2688221-f423-4858-b294-7f55be9aa24b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:29.792259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2688221-f423-4858-b294-7f55be9aa24b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:29.794646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2688221-f423-4858-b294-7f55be9aa24b None admin] RBAC: Adding query filter params (role.id=5c4481f023774d67997d4ba28e07cff0, scope.project.id=7cdc86a10dd449abbc708408ab6b0d78, user.id=fdc3b2b9c8654f7383bb4032c4f52f2a) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:29.795491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2688221-f423-4858-b294-7f55be9aa24b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:29.798614 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2688221-f423-4858-b294-7f55be9aa24b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:29.820663 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 77/153] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:29 2022] GET /identity/v3/role_assignments?user.id=fdc3b2b9c8654f7383bb4032c4f52f2a&scope.project.id=7cdc86a10dd449abbc708408ab6b0d78&role.id=5c4481f023774d67997d4ba28e07cff0 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:29.836888 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e69d4-b606-4690-852c-8482aea67ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:29.837793 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e69d4-b606-4690-852c-8482aea67ee6 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:29.838058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e69d4-b606-4690-852c-8482aea67ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:29.838344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e69d4-b606-4690-852c-8482aea67ee6 None admin] PATH_INFO: `/v3/users/c8d6148460c64b19ad3d5930db893c77` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:29.844507 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e69d4-b606-4690-852c-8482aea67ee6 None admin] RBAC: Authorizing `identity:get_user(user_id=c8d6148460c64b19ad3d5930db893c77)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:29.846010 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e69d4-b606-4690-852c-8482aea67ee6 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:29.848125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 77/154] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:29 2022] GET /identity/v3/users/c8d6148460c64b19ad3d5930db893c77 => generated 247 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:29.853389 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2688221-f423-4858-b294-7f55be9aa24b None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:29.927950 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:29.995805 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2688221-f423-4858-b294-7f55be9aa24b None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:30.033877 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251085db-c915-4369-92dd-967aae240887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:30.034940 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251085db-c915-4369-92dd-967aae240887 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:30.035385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251085db-c915-4369-92dd-967aae240887 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:30.035847 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251085db-c915-4369-92dd-967aae240887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:30.111009 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251085db-c915-4369-92dd-967aae240887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:30.112808 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251085db-c915-4369-92dd-967aae240887 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:30.164320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:30.218827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 78/155] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:30.224161 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e69d4-b606-4690-852c-8482aea67ee6 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:30.331488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:30.340704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e69d4-b606-4690-852c-8482aea67ee6 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:30.381881 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce62579-6c37-461d-be79-88b46b2aea6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:30.382763 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce62579-6c37-461d-be79-88b46b2aea6a None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:30.383655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce62579-6c37-461d-be79-88b46b2aea6a None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:30.383942 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce62579-6c37-461d-be79-88b46b2aea6a None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:30.385150 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce62579-6c37-461d-be79-88b46b2aea6a None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:30.387262 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce62579-6c37-461d-be79-88b46b2aea6a None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:30.389330 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 78/156] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:30 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:30.395018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251085db-c915-4369-92dd-967aae240887 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:30.414062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27706838-39fc-4110-ad65-e39c3006333a None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:30.414369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27706838-39fc-4110-ad65-e39c3006333a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:30.414629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27706838-39fc-4110-ad65-e39c3006333a None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:30.416162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 79/157] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:30.421485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9b080-bb57-4b41-ae2c-3254695512ce None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:30.421772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9b080-bb57-4b41-ae2c-3254695512ce None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:30.422054 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9b080-bb57-4b41-ae2c-3254695512ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:30.452647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-c7d9b080-bb57-4b41-ae2c-3254695512ce None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:30.453878 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-c7d9b080-bb57-4b41-ae2c-3254695512ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:30.540770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251085db-c915-4369-92dd-967aae240887 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:30.580526 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4a453-fa98-4df1-908d-98a75c41e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:30.581251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 80/158] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:30.581696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4a453-fa98-4df1-908d-98a75c41e1ac None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:30.582147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4a453-fa98-4df1-908d-98a75c41e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:30.582569 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4a453-fa98-4df1-908d-98a75c41e1ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:30.583590 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4a453-fa98-4df1-908d-98a75c41e1ac None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=7cdc86a10dd449abbc708408ab6b0d78, user.id=c8d6148460c64b19ad3d5930db893c77) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:30.584065 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4a453-fa98-4df1-908d-98a75c41e1ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:30.585693 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4a453-fa98-4df1-908d-98a75c41e1ac None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:30.592447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 79/159] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:30 2022] GET /identity/v3/role_assignments?user.id=c8d6148460c64b19ad3d5930db893c77&scope.project.id=7cdc86a10dd449abbc708408ab6b0d78&role.id=b156409c977248e1b23c26e589b1e04f => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:30.615608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9b080-bb57-4b41-ae2c-3254695512ce None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:30.744916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9b080-bb57-4b41-ae2c-3254695512ce None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:30.753508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:30.795882 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1ce1f-16b6-4a11-8ebf-1e5577e8d848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:30.796705 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1ce1f-16b6-4a11-8ebf-1e5577e8d848 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:30.796996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1ce1f-16b6-4a11-8ebf-1e5577e8d848 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:30.797275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1ce1f-16b6-4a11-8ebf-1e5577e8d848 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:30.810366 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1ce1f-16b6-4a11-8ebf-1e5577e8d848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:30.820205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-56b1ce1f-16b6-4a11-8ebf-1e5577e8d848 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:30.820205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:30.820205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:30.820205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:30.820205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:30.820205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:30.820205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:30.820205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:30.820205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:30.820205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:30.820205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:30.820205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:30.820205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:30.820205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:30.820205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:30.820205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:30.821092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:30.821092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:30.821092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:30.821092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:30.821092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:30.821092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:30.821092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:30.821092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:30.821092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:30.821092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:30.821092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:30.821092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:30.821092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:30.821092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:30.821092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:30.821092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:30.821951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:30.821951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:30.821951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:30.821951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:30.821951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:30.821951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:30.821951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:30.821951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:30.821951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:30.821951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:30.821951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:30.821951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:30.824472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 81/160] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:30.832736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4a453-fa98-4df1-908d-98a75c41e1ac None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:30.849031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:30.935233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53453a8-e0df-45f0-aea6-113b15638aa6 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:30.935933 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53453a8-e0df-45f0-aea6-113b15638aa6 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:30.936429 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53453a8-e0df-45f0-aea6-113b15638aa6 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:30.938112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 82/161] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:30.944858 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72598540-eb75-433d-98ca-be6229756353 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:30.945413 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72598540-eb75-433d-98ca-be6229756353 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:30.945909 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72598540-eb75-433d-98ca-be6229756353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:30.967009 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4a453-fa98-4df1-908d-98a75c41e1ac None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:30.974197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-72598540-eb75-433d-98ca-be6229756353 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:30.975731 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-72598540-eb75-433d-98ca-be6229756353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:31.002970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc02a78-4a2d-490f-bca6-9e8643d8a639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:31.003745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc02a78-4a2d-490f-bca6-9e8643d8a639 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:31.003973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc02a78-4a2d-490f-bca6-9e8643d8a639 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:31.004255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc02a78-4a2d-490f-bca6-9e8643d8a639 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:31.005073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc02a78-4a2d-490f-bca6-9e8643d8a639 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:31.005474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc02a78-4a2d-490f-bca6-9e8643d8a639 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:31.006828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc02a78-4a2d-490f-bca6-9e8643d8a639 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:31.015582 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 80/162] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:31.024845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc02a78-4a2d-490f-bca6-9e8643d8a639 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:31.061203 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 83/163] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:31.110505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:31.111710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72598540-eb75-433d-98ca-be6229756353 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:31.139268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc02a78-4a2d-490f-bca6-9e8643d8a639 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:31.192001 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535e374-7d50-4a40-8ae2-8de4b219ccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:31.193277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535e374-7d50-4a40-8ae2-8de4b219ccf5 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:31.193705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535e374-7d50-4a40-8ae2-8de4b219ccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:31.194133 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535e374-7d50-4a40-8ae2-8de4b219ccf5 None admin] PATH_INFO: `/v3/users/e47a4b999cf647de936704e5db4285ae` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:31.196028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535e374-7d50-4a40-8ae2-8de4b219ccf5 None admin] RBAC: Authorizing `identity:get_user(user_id=e47a4b999cf647de936704e5db4285ae)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:31.197774 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535e374-7d50-4a40-8ae2-8de4b219ccf5 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:31.204621 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 81/164] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:31 2022] GET /identity/v3/users/e47a4b999cf647de936704e5db4285ae => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:31.205824 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535e374-7d50-4a40-8ae2-8de4b219ccf5 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:31.253800 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:31.279192 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72598540-eb75-433d-98ca-be6229756353 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:31.323558 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535e374-7d50-4a40-8ae2-8de4b219ccf5 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:31.331149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223dd4a-fd82-4668-92a7-496ed926a9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:31.340320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223dd4a-fd82-4668-92a7-496ed926a9c0 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:31.340750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223dd4a-fd82-4668-92a7-496ed926a9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:31.341254 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4223dd4a-fd82-4668-92a7-496ed926a9c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:31.352822 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4223dd4a-fd82-4668-92a7-496ed926a9c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:31.366835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-4223dd4a-fd82-4668-92a7-496ed926a9c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:31.366835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:31.366835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:31.366835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:31.366835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:31.366835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:31.366835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:31.366835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:31.366835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:31.366835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:31.366835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:31.366835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:31.366835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:31.366835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:31.366835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:31.366835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:31.367819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:31.367819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:31.367819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:31.367819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:31.367819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:31.367819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:31.367819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:31.367819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:31.367819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:31.367819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:31.367819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:31.367819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:31.367819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:31.367819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:31.367819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:31.367819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:31.368610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:31.368610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:31.368610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:31.368610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:31.368610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:31.368610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:31.368610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:31.368610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:31.368610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:31.368610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:31.368610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:31.368610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:31.368610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 84/165] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:32:31.374498 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a4dbe-4d50-4847-91e2-268c4bb4963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:31.375463 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a4dbe-4d50-4847-91e2-268c4bb4963a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:31.376018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a4dbe-4d50-4847-91e2-268c4bb4963a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:31.376300 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a4dbe-4d50-4847-91e2-268c4bb4963a None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:31.377629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223dd4a-fd82-4668-92a7-496ed926a9c0 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:31.378690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a4dbe-4d50-4847-91e2-268c4bb4963a None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:31.380221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a4dbe-4d50-4847-91e2-268c4bb4963a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:31.381917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 82/166] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:31 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:31.388240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a4dbe-4d50-4847-91e2-268c4bb4963a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:31.415377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:31.593685 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4223dd4a-fd82-4668-92a7-496ed926a9c0 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:31.597963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a4dbe-4d50-4847-91e2-268c4bb4963a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:31.658217 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c51bf-0d6d-4418-9787-9772f555183d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:31.658808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c51bf-0d6d-4418-9787-9772f555183d None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:31.659090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c51bf-0d6d-4418-9787-9772f555183d None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:31.659366 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c51bf-0d6d-4418-9787-9772f555183d None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:31.660166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c51bf-0d6d-4418-9787-9772f555183d None admin] RBAC: Adding query filter params (name=member) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:31.660475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c51bf-0d6d-4418-9787-9772f555183d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:31.661860 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c51bf-0d6d-4418-9787-9772f555183d None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:31.669162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e048793c-b786-4002-a2a6-074f0beee84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:31.670060 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048793c-b786-4002-a2a6-074f0beee84d None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:31.670343 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048793c-b786-4002-a2a6-074f0beee84d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:31.670621 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e048793c-b786-4002-a2a6-074f0beee84d None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78/users/e47a4b999cf647de936704e5db4285ae/roles/c022b2199d7449faa0831ed802c403d3` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:31.675234 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048793c-b786-4002-a2a6-074f0beee84d None admin] RBAC: Authorizing `identity:create_grant(project_id=7cdc86a10dd449abbc708408ab6b0d78, user_id=e47a4b999cf647de936704e5db4285ae, role_id=c022b2199d7449faa0831ed802c403d3)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:31.676705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e048793c-b786-4002-a2a6-074f0beee84d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:31.683684 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 85/167] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:31.686177 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72858e0-81a7-480d-bd80-0628789c3601 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:31.686466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72858e0-81a7-480d-bd80-0628789c3601 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:31.686751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72858e0-81a7-480d-bd80-0628789c3601 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:31.688106 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 86/168] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:31.690304 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72858e0-81a7-480d-bd80-0628789c3601 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:31.694397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:31.757980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 83/169] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:32:31 2022] PUT /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78/users/e47a4b999cf647de936704e5db4285ae/roles/c022b2199d7449faa0831ed802c403d3 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:32:31.765172 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8251ea-44d0-4843-a9af-8705b7f1714e None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:31.765768 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8251ea-44d0-4843-a9af-8705b7f1714e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:31.766323 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8251ea-44d0-4843-a9af-8705b7f1714e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:31.798145 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-8e8251ea-44d0-4843-a9af-8705b7f1714e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:31.799970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-8e8251ea-44d0-4843-a9af-8705b7f1714e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:31.810401 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72858e0-81a7-480d-bd80-0628789c3601 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:31.896056 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:31.896657 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37c89-bfae-4dca-8005-5cc6d0d12e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:31.897463 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37c89-bfae-4dca-8005-5cc6d0d12e30 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:31.898019 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37c89-bfae-4dca-8005-5cc6d0d12e30 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:31.898340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37c89-bfae-4dca-8005-5cc6d0d12e30 None admin] PATH_INFO: `/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:31.904885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e37c89-bfae-4dca-8005-5cc6d0d12e30 None admin] RBAC: Authorizing `identity:get_user(user_id=fdc3b2b9c8654f7383bb4032c4f52f2a)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:31.904885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e37c89-bfae-4dca-8005-5cc6d0d12e30 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:31.904885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 87/170] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:31 2022] GET /identity/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:31.912793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 84/171] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:31.912960 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37c89-bfae-4dca-8005-5cc6d0d12e30 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:31.950532 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8251ea-44d0-4843-a9af-8705b7f1714e None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:32.060411 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:32.083900 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8251ea-44d0-4843-a9af-8705b7f1714e None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:32.106037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37c89-bfae-4dca-8005-5cc6d0d12e30 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:32.131675 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d8f2d-2c98-4efd-9e9e-489d3b8da057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:32.132866 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d8f2d-2c98-4efd-9e9e-489d3b8da057 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:32.133340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d8f2d-2c98-4efd-9e9e-489d3b8da057 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:32.133785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d8f2d-2c98-4efd-9e9e-489d3b8da057 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:32.159312 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d8f2d-2c98-4efd-9e9e-489d3b8da057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:32.174961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-a84d8f2d-2c98-4efd-9e9e-489d3b8da057 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:32.174961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:32.174961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:32.174961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:32.174961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:32.174961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:32.174961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:32.174961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:32.174961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:32.174961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:32.174961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:32.174961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:32.174961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:32.174961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:32.174961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:32.174961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:32.175899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:32.175899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:32.175899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:32.175899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:32.175899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:32.175899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:32.175899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:32.175899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:32.175899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:32.175899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:32.175899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:32.175899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:32.175899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:32.175899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:32.175899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:32.175899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:32.176660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:32.176660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:32.176660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:32.176660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:32.176660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:32.176660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:32.176660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:32.176660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:32.176660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:32.176660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:32.176660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:32.176660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:32.185682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1dcc4-bfa9-4b81-97f5-af60f33a7084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:32.186570 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1dcc4-bfa9-4b81-97f5-af60f33a7084 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:32.187034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1dcc4-bfa9-4b81-97f5-af60f33a7084 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:32.191657 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1dcc4-bfa9-4b81-97f5-af60f33a7084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:32.192510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 85/172] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:32:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:32.197168 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d8f2d-2c98-4efd-9e9e-489d3b8da057 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:32.263243 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:32.306897 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d8f2d-2c98-4efd-9e9e-489d3b8da057 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:32.342991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee446c9-8952-413f-8dd8-f1c274f7dc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:32.344035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee446c9-8952-413f-8dd8-f1c274f7dc36 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:32.344495 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee446c9-8952-413f-8dd8-f1c274f7dc36 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:32.345076 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee446c9-8952-413f-8dd8-f1c274f7dc36 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:32.346004 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee446c9-8952-413f-8dd8-f1c274f7dc36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:32.346491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee446c9-8952-413f-8dd8-f1c274f7dc36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:32.348086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee446c9-8952-413f-8dd8-f1c274f7dc36 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:32.358241 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 86/173] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:32:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:32.363978 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e17eeb-e88d-4b37-bb60-792997c38304 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:32.364467 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e17eeb-e88d-4b37-bb60-792997c38304 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:32.364920 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e17eeb-e88d-4b37-bb60-792997c38304 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:32.366431 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 87/174] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:32.367815 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e17eeb-e88d-4b37-bb60-792997c38304 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:32.392671 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1dcc4-bfa9-4b81-97f5-af60f33a7084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:32.394177 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1dcc4-bfa9-4b81-97f5-af60f33a7084 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:32.476483 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e17eeb-e88d-4b37-bb60-792997c38304 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:32.522875 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:32.539892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:32.548690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf695bcc-5335-4083-b572-82e288542d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:32.549584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf695bcc-5335-4083-b572-82e288542d0c None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:32.562901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf695bcc-5335-4083-b572-82e288542d0c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:32.562901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf695bcc-5335-4083-b572-82e288542d0c None admin] PATH_INFO: `/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:32.562901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf695bcc-5335-4083-b572-82e288542d0c None admin] RBAC: Authorizing `identity:get_user(user_id=fdc3b2b9c8654f7383bb4032c4f52f2a)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:32.562901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf695bcc-5335-4083-b572-82e288542d0c None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:32.562901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 88/175] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:32 2022] GET /identity/v3/users/fdc3b2b9c8654f7383bb4032c4f52f2a => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:32.562901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d154fc6-6102-4dfc-a7dd-bacd4a130634 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:32.563337 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d154fc6-6102-4dfc-a7dd-bacd4a130634 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:32.563337 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d154fc6-6102-4dfc-a7dd-bacd4a130634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:32.582510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-5d154fc6-6102-4dfc-a7dd-bacd4a130634 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:32.583734 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5d154fc6-6102-4dfc-a7dd-bacd4a130634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:32.598945 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 88/176] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 689 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:32.599885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1dcc4-bfa9-4b81-97f5-af60f33a7084 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:32.660078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 89/177] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:32.662799 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d154fc6-6102-4dfc-a7dd-bacd4a130634 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:32.737957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1dcc4-bfa9-4b81-97f5-af60f33a7084 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:32.770528 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d154fc6-6102-4dfc-a7dd-bacd4a130634 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:32.775092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efc6b6-8b1e-436d-902d-64657db37ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:32.808742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efc6b6-8b1e-436d-902d-64657db37ea1 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:32.808742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efc6b6-8b1e-436d-902d-64657db37ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:32.808742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efc6b6-8b1e-436d-902d-64657db37ea1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:32.808999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:32.808999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b7717-ee07-4236-89c7-22e933756422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:32.808999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b7717-ee07-4236-89c7-22e933756422 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:32.808999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b7717-ee07-4236-89c7-22e933756422 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:32.809295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b7717-ee07-4236-89c7-22e933756422 None admin] PATH_INFO: `/v3/projects/a793cca18e3a4241b259ffdcbb935e3b` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:32.809295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b7717-ee07-4236-89c7-22e933756422 None admin] RBAC: Authorizing `identity:get_project(project_id=a793cca18e3a4241b259ffdcbb935e3b)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:32.810500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b7717-ee07-4236-89c7-22e933756422 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:32.816975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 90/178] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:32 2022] GET /identity/v3/projects/a793cca18e3a4241b259ffdcbb935e3b => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:32.816975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35c8db-db23-4db5-b42d-5ac6c64669e5 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:32.816975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35c8db-db23-4db5-b42d-5ac6c64669e5 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:32.816975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35c8db-db23-4db5-b42d-5ac6c64669e5 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:32.816975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 91/179] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:32.816975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f6b26-aa4c-4ea0-9d95-c292e4a3751a None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:32.817408 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f6b26-aa4c-4ea0-9d95-c292e4a3751a None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:32.817408 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f6b26-aa4c-4ea0-9d95-c292e4a3751a None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:32.818100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 92/180] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:32.819634 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f6b26-aa4c-4ea0-9d95-c292e4a3751a None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:32.828054 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:32.856637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efc6b6-8b1e-436d-902d-64657db37ea1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:32.858407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efc6b6-8b1e-436d-902d-64657db37ea1 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:32.925367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f6b26-aa4c-4ea0-9d95-c292e4a3751a None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:32.958742 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa16e90-370f-45d5-8f00-a02ccc7880d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:32.959539 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa16e90-370f-45d5-8f00-a02ccc7880d7 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:32.959836 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa16e90-370f-45d5-8f00-a02ccc7880d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:32.960108 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa16e90-370f-45d5-8f00-a02ccc7880d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:32.960689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 89/181] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:32.961601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efc6b6-8b1e-436d-902d-64657db37ea1 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:32.975660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa16e90-370f-45d5-8f00-a02ccc7880d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:32.983600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-daa16e90-370f-45d5-8f00-a02ccc7880d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:32.983600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:32.983600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:32.983600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:32.983600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:32.983600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:32.983600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:32.983600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:32.983600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:32.983600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:32.983600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:32.983600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:32.983600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:32.983600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:32.983600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:32.983600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:32.984472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:32.984472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:32.984472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:32.984472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:32.984472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:32.984472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:32.984472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:32.984472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:32.984472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:32.984472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:32.984472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:32.984472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:32.984472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:32.984472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:32.984472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:32.984472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:32.985274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:32.985274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:32.985274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:32.985274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:32.985274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:32.985274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:32.985274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:32.985274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:32.985274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:32.985274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:32.985274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:32.985274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:32.985274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 93/182] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:32:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:32.986290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5050051-6ef0-48cf-8532-8dad7c555fd8 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:32.986290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5050051-6ef0-48cf-8532-8dad7c555fd8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:32.986490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5050051-6ef0-48cf-8532-8dad7c555fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:33.002218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-c5050051-6ef0-48cf-8532-8dad7c555fd8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:33.003333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c5050051-6ef0-48cf-8532-8dad7c555fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:33.040726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:33.049216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:33.070782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efc6b6-8b1e-436d-902d-64657db37ea1 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:33.074544 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 94/183] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:33.075904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f331a5-9067-4232-b69e-98c9ce666af0 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:33.076185 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f331a5-9067-4232-b69e-98c9ce666af0 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:33.076465 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f331a5-9067-4232-b69e-98c9ce666af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:33.096618 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-52f331a5-9067-4232-b69e-98c9ce666af0 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:33.097838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-52f331a5-9067-4232-b69e-98c9ce666af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:33.123656 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827fc02-3fc2-4453-b763-97ed5caa12c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:33.124449 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827fc02-3fc2-4453-b763-97ed5caa12c6 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:33.124801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827fc02-3fc2-4453-b763-97ed5caa12c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:33.125056 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7827fc02-3fc2-4453-b763-97ed5caa12c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:33.126496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827fc02-3fc2-4453-b763-97ed5caa12c6 None admin] RBAC: Adding query filter params (role.id=5c4481f023774d67997d4ba28e07cff0, scope.project.id=a793cca18e3a4241b259ffdcbb935e3b, user.id=fdc3b2b9c8654f7383bb4032c4f52f2a) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:33.126815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827fc02-3fc2-4453-b763-97ed5caa12c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:33.128747 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7827fc02-3fc2-4453-b763-97ed5caa12c6 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:33.134716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 90/184] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:32 2022] GET /identity/v3/role_assignments?user.id=fdc3b2b9c8654f7383bb4032c4f52f2a&scope.project.id=a793cca18e3a4241b259ffdcbb935e3b&role.id=5c4481f023774d67997d4ba28e07cff0 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:33.139781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827fc02-3fc2-4453-b763-97ed5caa12c6 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:33.181200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 95/185] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:33.182464 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f331a5-9067-4232-b69e-98c9ce666af0 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:33.287798 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7827fc02-3fc2-4453-b763-97ed5caa12c6 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:33.322824 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f331a5-9067-4232-b69e-98c9ce666af0 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:33.334315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:33.339859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bee5f2-9633-4e9c-9693-da4dde80327a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:33.343086 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bee5f2-9633-4e9c-9693-da4dde80327a None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:33.343086 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bee5f2-9633-4e9c-9693-da4dde80327a None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:33.343086 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bee5f2-9633-4e9c-9693-da4dde80327a None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:33.343086 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bee5f2-9633-4e9c-9693-da4dde80327a None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:33.343688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bee5f2-9633-4e9c-9693-da4dde80327a None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:33.345384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 91/186] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:33 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:33.346144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bee5f2-9633-4e9c-9693-da4dde80327a None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:33.351840 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:33.379367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872af168-5534-4331-8b95-dc3f45bb8c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:33.380126 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872af168-5534-4331-8b95-dc3f45bb8c62 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:33.380410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872af168-5534-4331-8b95-dc3f45bb8c62 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:33.380743 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872af168-5534-4331-8b95-dc3f45bb8c62 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:33.382341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872af168-5534-4331-8b95-dc3f45bb8c62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:33.382341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872af168-5534-4331-8b95-dc3f45bb8c62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:33.383523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872af168-5534-4331-8b95-dc3f45bb8c62 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:33.393398 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 96/187] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:33.394029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872af168-5534-4331-8b95-dc3f45bb8c62 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:33.475234 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bee5f2-9633-4e9c-9693-da4dde80327a None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:33.504565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872af168-5534-4331-8b95-dc3f45bb8c62 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:33.514339 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76e907-ff2b-444d-a34f-65d913ff49f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:33.515162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76e907-ff2b-444d-a34f-65d913ff49f6 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:33.515446 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76e907-ff2b-444d-a34f-65d913ff49f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:33.515761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76e907-ff2b-444d-a34f-65d913ff49f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:33.526209 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76e907-ff2b-444d-a34f-65d913ff49f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:33.534432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-ef76e907-ff2b-444d-a34f-65d913ff49f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:33.534432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:33.534432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:33.534432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:33.534432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:33.534432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:33.534432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:33.534432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:33.534432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:33.534432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:33.534432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:33.534432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:33.534432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:33.534432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:33.534432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:33.534432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:33.535332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:33.535332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:33.535332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:33.535332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:33.535332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:33.535332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:33.535332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:33.535332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:33.535332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:33.535332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:33.535332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:33.535332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:33.535332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:33.535332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:33.535332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:33.535332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:33.536820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:33.536820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:33.536820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:33.536820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:33.536820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:33.536820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:33.536820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:33.536820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:33.536820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:33.536820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:33.536820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:33.536820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:33.536820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 92/188] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:32:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:33.536820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76e907-ff2b-444d-a34f-65d913ff49f6 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:33.550046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946900ba-e2b4-49d5-aa91-4acaeec1761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:33.550859 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946900ba-e2b4-49d5-aa91-4acaeec1761c None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:33.551154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946900ba-e2b4-49d5-aa91-4acaeec1761c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:33.551426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946900ba-e2b4-49d5-aa91-4acaeec1761c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:33.552646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946900ba-e2b4-49d5-aa91-4acaeec1761c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:33.554082 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946900ba-e2b4-49d5-aa91-4acaeec1761c None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:33.560469 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 97/189] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:32:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:33.560469 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946900ba-e2b4-49d5-aa91-4acaeec1761c None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:33.596899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:33.610815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:33.652825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76e907-ff2b-444d-a34f-65d913ff49f6 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:33.659247 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946900ba-e2b4-49d5-aa91-4acaeec1761c None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:33.690084 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6b3a0-72d3-4c33-ab61-60c8e5186fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:33.690740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6b3a0-72d3-4c33-ab61-60c8e5186fc9 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:33.691070 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6b3a0-72d3-4c33-ab61-60c8e5186fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:33.691299 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6b3a0-72d3-4c33-ab61-60c8e5186fc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:33.692199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6b3a0-72d3-4c33-ab61-60c8e5186fc9 None admin] RBAC: Adding query filter params (role.id=422c41a081a44a4e8b04f4d9ce6e8930, scope.project.id=7cdc86a10dd449abbc708408ab6b0d78, user.id=fdc3b2b9c8654f7383bb4032c4f52f2a) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:33.692516 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6b3a0-72d3-4c33-ab61-60c8e5186fc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:33.693980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6b3a0-72d3-4c33-ab61-60c8e5186fc9 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:33.694286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49903a60-058b-4bb9-a19c-11d45e198195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:33.695162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49903a60-058b-4bb9-a19c-11d45e198195 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:33.695448 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49903a60-058b-4bb9-a19c-11d45e198195 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:33.695749 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49903a60-058b-4bb9-a19c-11d45e198195 None admin] PATH_INFO: `/v3/users/e76e94e438314b8c826639f550dc05cd` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:33.699995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 93/190] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:33 2022] GET /identity/v3/role_assignments?user.id=fdc3b2b9c8654f7383bb4032c4f52f2a&scope.project.id=7cdc86a10dd449abbc708408ab6b0d78&role.id=422c41a081a44a4e8b04f4d9ce6e8930 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:33.700788 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6b3a0-72d3-4c33-ab61-60c8e5186fc9 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:33.722271 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49903a60-058b-4bb9-a19c-11d45e198195 None admin] RBAC: Authorizing `identity:get_user(user_id=e76e94e438314b8c826639f550dc05cd)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:33.724078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49903a60-058b-4bb9-a19c-11d45e198195 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:33.726225 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 98/191] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:33 2022] GET /identity/v3/users/e76e94e438314b8c826639f550dc05cd => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:33.732167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49903a60-058b-4bb9-a19c-11d45e198195 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:33.833422 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6b3a0-72d3-4c33-ab61-60c8e5186fc9 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:33.858714 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:33.866436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:33.867356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49903a60-058b-4bb9-a19c-11d45e198195 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:33.883125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5fdf8-a98e-472a-84a6-96518dcfd0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:33.884929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5fdf8-a98e-472a-84a6-96518dcfd0a7 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:33.884929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5fdf8-a98e-472a-84a6-96518dcfd0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:33.884929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5fdf8-a98e-472a-84a6-96518dcfd0a7 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:33.886081 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5fdf8-a98e-472a-84a6-96518dcfd0a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:33.886249 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5fdf8-a98e-472a-84a6-96518dcfd0a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:33.887845 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5fdf8-a98e-472a-84a6-96518dcfd0a7 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:33.903914 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 94/192] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:32:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:33.903914 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5fdf8-a98e-472a-84a6-96518dcfd0a7 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:33.919425 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d391290-656c-44f3-abfb-9f59a58b237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:33.920358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d391290-656c-44f3-abfb-9f59a58b237d None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:33.920787 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d391290-656c-44f3-abfb-9f59a58b237d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:33.921207 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d391290-656c-44f3-abfb-9f59a58b237d None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:33.922073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d391290-656c-44f3-abfb-9f59a58b237d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:33.923756 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d391290-656c-44f3-abfb-9f59a58b237d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:33.987202 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 99/193] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:32:33 2022] POST /identity/v3/users => generated 297 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:32:33.988376 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d391290-656c-44f3-abfb-9f59a58b237d None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:34.021376 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5fdf8-a98e-472a-84a6-96518dcfd0a7 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:34.076016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c0b0f-8ee3-4c67-b5e1-deed2854feba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:34.077342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c0b0f-8ee3-4c67-b5e1-deed2854feba None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:34.077631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c0b0f-8ee3-4c67-b5e1-deed2854feba None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:34.077907 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c0b0f-8ee3-4c67-b5e1-deed2854feba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:34.115829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d391290-656c-44f3-abfb-9f59a58b237d None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:34.145246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:34.153183 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4dae7-1dbc-43d7-8eb2-9b201e4cb1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:34.154525 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4dae7-1dbc-43d7-8eb2-9b201e4cb1ad None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:34.155020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4dae7-1dbc-43d7-8eb2-9b201e4cb1ad None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:34.155459 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4dae7-1dbc-43d7-8eb2-9b201e4cb1ad None admin] PATH_INFO: `/v3/users/e76e94e438314b8c826639f550dc05cd` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:34.158277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4dae7-1dbc-43d7-8eb2-9b201e4cb1ad None admin] RBAC: Authorizing `identity:get_user(user_id=e76e94e438314b8c826639f550dc05cd)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:34.158421 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4dae7-1dbc-43d7-8eb2-9b201e4cb1ad None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:34.159672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c0b0f-8ee3-4c67-b5e1-deed2854feba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:34.160151 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 100/194] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:33 2022] GET /identity/v3/users/e76e94e438314b8c826639f550dc05cd => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:34.161382 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b09e6-3cca-4380-9188-141f6a27dc9d None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:34.161584 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c0b0f-8ee3-4c67-b5e1-deed2854feba None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:34.161692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b09e6-3cca-4380-9188-141f6a27dc9d None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:34.161940 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b09e6-3cca-4380-9188-141f6a27dc9d None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:34.163354 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 101/195] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:34.169040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b09e6-3cca-4380-9188-141f6a27dc9d None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:34.194273 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:34.289524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 95/196] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:34.290830 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecc6de-1f6f-47bd-a2bf-d4554a750a22 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:34.291117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecc6de-1f6f-47bd-a2bf-d4554a750a22 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:34.291397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ecc6de-1f6f-47bd-a2bf-d4554a750a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:34.299507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b09e6-3cca-4380-9188-141f6a27dc9d None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:34.314487 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-64ecc6de-1f6f-47bd-a2bf-d4554a750a22 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:34.315840 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-64ecc6de-1f6f-47bd-a2bf-d4554a750a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:34.340288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909f6ba-2124-4cd9-937e-11233dfc8d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:34.340948 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909f6ba-2124-4cd9-937e-11233dfc8d04 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:34.341238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909f6ba-2124-4cd9-937e-11233dfc8d04 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:34.341520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909f6ba-2124-4cd9-937e-11233dfc8d04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:34.395351 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 96/197] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:34.396238 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecc6de-1f6f-47bd-a2bf-d4554a750a22 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:34.415969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:34.441633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909f6ba-2124-4cd9-937e-11233dfc8d04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:34.444382 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909f6ba-2124-4cd9-937e-11233dfc8d04 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:34.469071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:34.511152 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ecc6de-1f6f-47bd-a2bf-d4554a750a22 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:34.557758 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff423e0d-5605-423d-9046-16d8730a7ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:34.559559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff423e0d-5605-423d-9046-16d8730a7ab7 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:34.559989 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff423e0d-5605-423d-9046-16d8730a7ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:34.560483 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff423e0d-5605-423d-9046-16d8730a7ab7 None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:34.562141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff423e0d-5605-423d-9046-16d8730a7ab7 None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:34.563846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff423e0d-5605-423d-9046-16d8730a7ab7 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:34.570464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 97/198] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:34 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:34.571626 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff423e0d-5605-423d-9046-16d8730a7ab7 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:34.574354 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 102/199] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:34.576194 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909f6ba-2124-4cd9-937e-11233dfc8d04 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:34.687990 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:34.690702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909f6ba-2124-4cd9-937e-11233dfc8d04 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:34.704943 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff423e0d-5605-423d-9046-16d8730a7ab7 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:34.715991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:34.738876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7a95b-def7-4530-aee1-8acf2f63f345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:34.740073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7a95b-def7-4530-aee1-8acf2f63f345 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:34.740459 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7a95b-def7-4530-aee1-8acf2f63f345 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:34.741096 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7a95b-def7-4530-aee1-8acf2f63f345 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:34.742234 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7a95b-def7-4530-aee1-8acf2f63f345 None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=36535f8090e64641b80e339c1590bf71, user.id=e76e94e438314b8c826639f550dc05cd) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:34.742744 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7a95b-def7-4530-aee1-8acf2f63f345 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:34.744727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec7a95b-def7-4530-aee1-8acf2f63f345 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:34.746068 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de8155-5d70-475b-9fee-6221c04c5cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:34.747020 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de8155-5d70-475b-9fee-6221c04c5cbf None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:34.747514 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de8155-5d70-475b-9fee-6221c04c5cbf None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:34.747955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de8155-5d70-475b-9fee-6221c04c5cbf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:34.752199 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 103/200] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:34 2022] GET /identity/v3/role_assignments?user.id=e76e94e438314b8c826639f550dc05cd&scope.project.id=36535f8090e64641b80e339c1590bf71&role.id=b156409c977248e1b23c26e589b1e04f => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:34.759804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7a95b-def7-4530-aee1-8acf2f63f345 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:34.772157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de8155-5d70-475b-9fee-6221c04c5cbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:34.789343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-70de8155-5d70-475b-9fee-6221c04c5cbf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:34.789343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:34.789343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:34.789343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:34.789343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:34.789343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:34.789343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:34.789343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:34.789343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:34.789343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:34.789343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:34.789343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:34.789343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:34.789343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:34.789343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:34.789343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:34.790275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:34.790275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:34.790275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:34.790275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:34.790275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:34.790275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:34.790275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:34.790275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:34.790275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:34.790275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:34.790275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:34.790275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:34.790275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:34.790275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:34.790275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:34.790275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:34.791113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:34.791113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:34.791113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:34.791113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:34.791113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:34.791113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:34.791113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:34.791113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:34.791113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:34.791113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:34.791113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:34.791113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:34.793771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 98/201] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:34.799742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de8155-5d70-475b-9fee-6221c04c5cbf None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:34.877140 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7a95b-def7-4530-aee1-8acf2f63f345 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:34.919850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaec41-74d3-474f-a9dd-3dad2602a1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:34.923560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaec41-74d3-474f-a9dd-3dad2602a1c2 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:34.923560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaec41-74d3-474f-a9dd-3dad2602a1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:34.923560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efaec41-74d3-474f-a9dd-3dad2602a1c2 None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:34.923560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efaec41-74d3-474f-a9dd-3dad2602a1c2 None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:34.925050 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efaec41-74d3-474f-a9dd-3dad2602a1c2 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:34.927152 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 104/202] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:34 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:34.933633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaec41-74d3-474f-a9dd-3dad2602a1c2 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:34.997182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:35.037481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de8155-5d70-475b-9fee-6221c04c5cbf None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:35.061938 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efaec41-74d3-474f-a9dd-3dad2602a1c2 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:35.097990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b9ef0-c8dd-49d8-a379-41ee4ed2dc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:35.098973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b9ef0-c8dd-49d8-a379-41ee4ed2dc06 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:35.099461 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b9ef0-c8dd-49d8-a379-41ee4ed2dc06 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:35.100352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b9ef0-c8dd-49d8-a379-41ee4ed2dc06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:35.101553 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b9ef0-c8dd-49d8-a379-41ee4ed2dc06 None admin] RBAC: Adding query filter params (role.id=422c41a081a44a4e8b04f4d9ce6e8930, scope.project.id=36535f8090e64641b80e339c1590bf71, user.id=e76e94e438314b8c826639f550dc05cd) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:35.102185 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b9ef0-c8dd-49d8-a379-41ee4ed2dc06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:35.103911 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b9ef0-c8dd-49d8-a379-41ee4ed2dc06 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:35.111677 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 105/203] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:34 2022] GET /identity/v3/role_assignments?user.id=e76e94e438314b8c826639f550dc05cd&scope.project.id=36535f8090e64641b80e339c1590bf71&role.id=422c41a081a44a4e8b04f4d9ce6e8930 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:35.130040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2f547-ac03-4f61-a1f3-208f42842483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:35.130728 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2f547-ac03-4f61-a1f3-208f42842483 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:35.131017 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2f547-ac03-4f61-a1f3-208f42842483 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:35.131297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2f547-ac03-4f61-a1f3-208f42842483 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:35.132095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2f547-ac03-4f61-a1f3-208f42842483 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:35.132413 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2f547-ac03-4f61-a1f3-208f42842483 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:35.133812 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2f547-ac03-4f61-a1f3-208f42842483 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:35.144102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 99/204] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:35.149643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b9ef0-c8dd-49d8-a379-41ee4ed2dc06 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:35.297281 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b9ef0-c8dd-49d8-a379-41ee4ed2dc06 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:35.321326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:35.348790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0221188-ce9c-4c23-ad6d-8ad9577cdbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:35.349680 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0221188-ce9c-4c23-ad6d-8ad9577cdbfb None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:35.350068 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0221188-ce9c-4c23-ad6d-8ad9577cdbfb None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:35.350356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0221188-ce9c-4c23-ad6d-8ad9577cdbfb None admin] PATH_INFO: `/v3/users/e47a4b999cf647de936704e5db4285ae` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:35.351947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0221188-ce9c-4c23-ad6d-8ad9577cdbfb None admin] RBAC: Authorizing `identity:get_user(user_id=e47a4b999cf647de936704e5db4285ae)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:35.353407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0221188-ce9c-4c23-ad6d-8ad9577cdbfb None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:35.355452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 106/205] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:35 2022] GET /identity/v3/users/e47a4b999cf647de936704e5db4285ae => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:35.361448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2f547-ac03-4f61-a1f3-208f42842483 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:35.382122 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:35.515662 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2f547-ac03-4f61-a1f3-208f42842483 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:35.551663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1f52b-61da-4251-abe7-6326ae15bc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:35.552250 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1f52b-61da-4251-abe7-6326ae15bc10 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:35.552539 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1f52b-61da-4251-abe7-6326ae15bc10 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:35.552821 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd1f52b-61da-4251-abe7-6326ae15bc10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:35.624807 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1f52b-61da-4251-abe7-6326ae15bc10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:35.626292 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd1f52b-61da-4251-abe7-6326ae15bc10 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:35.636423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:35.734834 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 100/206] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:35.740547 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0221188-ce9c-4c23-ad6d-8ad9577cdbfb None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:35.851253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0221188-ce9c-4c23-ad6d-8ad9577cdbfb None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:35.898114 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615d9cc-1fd6-4fc8-aa6a-28021e49c2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:35.898995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615d9cc-1fd6-4fc8-aa6a-28021e49c2ce None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:35.899285 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615d9cc-1fd6-4fc8-aa6a-28021e49c2ce None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:35.899582 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615d9cc-1fd6-4fc8-aa6a-28021e49c2ce None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:35.900829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615d9cc-1fd6-4fc8-aa6a-28021e49c2ce None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:35.902380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615d9cc-1fd6-4fc8-aa6a-28021e49c2ce None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:35.904162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 107/207] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:35 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:35.910154 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1f52b-61da-4251-abe7-6326ae15bc10 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:36.026376 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd1f52b-61da-4251-abe7-6326ae15bc10 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:36.047555 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:36.082602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfed78ec-39a3-4409-b59b-a1e76653ce60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:36.083264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed78ec-39a3-4409-b59b-a1e76653ce60 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:36.083565 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed78ec-39a3-4409-b59b-a1e76653ce60 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:36.083903 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfed78ec-39a3-4409-b59b-a1e76653ce60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:36.084751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed78ec-39a3-4409-b59b-a1e76653ce60 None admin] RBAC: Adding query filter params (role.id=c022b2199d7449faa0831ed802c403d3, scope.project.id=7cdc86a10dd449abbc708408ab6b0d78, user.id=e47a4b999cf647de936704e5db4285ae) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:36.085061 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed78ec-39a3-4409-b59b-a1e76653ce60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:36.086556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfed78ec-39a3-4409-b59b-a1e76653ce60 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:36.096126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 101/208] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:35 2022] GET /identity/v3/role_assignments?user.id=e47a4b999cf647de936704e5db4285ae&scope.project.id=7cdc86a10dd449abbc708408ab6b0d78&role.id=c022b2199d7449faa0831ed802c403d3 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:36.425629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6ecfc-88ac-4bf3-a910-82e3b801d3d9 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:36.426143 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6ecfc-88ac-4bf3-a910-82e3b801d3d9 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:36.426219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6ecfc-88ac-4bf3-a910-82e3b801d3d9 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:36.427828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 108/209] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:36.434036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65791048-7d06-480f-9748-1cffc8fd82e7 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:36.434331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65791048-7d06-480f-9748-1cffc8fd82e7 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:36.434609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65791048-7d06-480f-9748-1cffc8fd82e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:36.452338 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-65791048-7d06-480f-9748-1cffc8fd82e7 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:36.453549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-65791048-7d06-480f-9748-1cffc8fd82e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:36.527326 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 102/210] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:36.550582 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6ecfc-88ac-4bf3-a910-82e3b801d3d9 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:36.609486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:36.662921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6ecfc-88ac-4bf3-a910-82e3b801d3d9 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:36.686004 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be068-837f-4426-9137-f8a520bc8557 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:36.686260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be068-837f-4426-9137-f8a520bc8557 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:36.686493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be068-837f-4426-9137-f8a520bc8557 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:36.688574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 103/211] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:32:36.697339 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60584119-2859-4e74-a5f1-29024d3ed81e None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:36.697623 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60584119-2859-4e74-a5f1-29024d3ed81e None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:36.697901 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60584119-2859-4e74-a5f1-29024d3ed81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:36.710461 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760d2c4-fde3-4755-8be1-d398fda0b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:36.711628 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760d2c4-fde3-4755-8be1-d398fda0b891 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:36.712130 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760d2c4-fde3-4755-8be1-d398fda0b891 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:36.712666 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760d2c4-fde3-4755-8be1-d398fda0b891 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:36.721361 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-60584119-2859-4e74-a5f1-29024d3ed81e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:36.722498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-60584119-2859-4e74-a5f1-29024d3ed81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:36.724591 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760d2c4-fde3-4755-8be1-d398fda0b891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:36.733484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-1760d2c4-fde3-4755-8be1-d398fda0b891 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:36.733484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:36.733484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:36.733484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:36.733484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:36.733484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:36.733484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:36.733484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:36.733484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:36.733484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:36.733484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:36.733484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:36.733484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:36.733484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:36.733484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:36.733484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:36.734380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:36.734380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:36.734380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:36.734380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:36.734380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:36.734380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:36.734380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:36.734380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:36.734380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:36.734380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:36.734380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:36.734380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:36.734380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:36.734380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:36.734380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:36.734380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:36.735157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:36.735157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:36.735157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:36.735157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:36.735157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:36.735157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:36.735157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:36.735157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:36.735157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:36.735157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:36.735157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:36.735157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:36.737513 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 109/212] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:32:36.744320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760d2c4-fde3-4755-8be1-d398fda0b891 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:36.811644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 104/213] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:36.836822 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60584119-2859-4e74-a5f1-29024d3ed81e None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:36.863771 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760d2c4-fde3-4755-8be1-d398fda0b891 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:36.868449 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:36.877966 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:36.900130 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3a0ce-add6-429d-b86d-4dca2e823127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:36.900917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a0ce-add6-429d-b86d-4dca2e823127 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:36.901214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a0ce-add6-429d-b86d-4dca2e823127 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:36.901561 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3a0ce-add6-429d-b86d-4dca2e823127 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:36.902322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3a0ce-add6-429d-b86d-4dca2e823127 None admin] RBAC: Adding query filter params (name=member) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:36.902638 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3a0ce-add6-429d-b86d-4dca2e823127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:36.904111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3a0ce-add6-429d-b86d-4dca2e823127 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:36.913913 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 110/214] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:36.920074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3a0ce-add6-429d-b86d-4dca2e823127 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:36.944541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60584119-2859-4e74-a5f1-29024d3ed81e None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:36.980163 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22e94c-bb6a-44c5-bbc2-07b88678215d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:36.981217 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22e94c-bb6a-44c5-bbc2-07b88678215d None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:36.981642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22e94c-bb6a-44c5-bbc2-07b88678215d None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:36.982071 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22e94c-bb6a-44c5-bbc2-07b88678215d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:36.983682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22e94c-bb6a-44c5-bbc2-07b88678215d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:36.985277 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e22e94c-bb6a-44c5-bbc2-07b88678215d None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:36.987048 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 105/215] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:32:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:36.994228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22e94c-bb6a-44c5-bbc2-07b88678215d None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:37.029760 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3a0ce-add6-429d-b86d-4dca2e823127 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:37.066427 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcebab-f8ba-4568-a925-5d04081307be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:37.067447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcebab-f8ba-4568-a925-5d04081307be None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:37.067901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcebab-f8ba-4568-a925-5d04081307be None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:37.068305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcebab-f8ba-4568-a925-5d04081307be None admin] PATH_INFO: `/v3/users/858e97306c234649bd838005411bc7e7` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:37.084525 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcebab-f8ba-4568-a925-5d04081307be None admin] RBAC: Authorizing `identity:get_user(user_id=858e97306c234649bd838005411bc7e7)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:37.086136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcebab-f8ba-4568-a925-5d04081307be None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:37.088173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 111/216] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:36 2022] GET /identity/v3/users/858e97306c234649bd838005411bc7e7 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:37.094015 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcebab-f8ba-4568-a925-5d04081307be None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:37.126040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:37.129121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22e94c-bb6a-44c5-bbc2-07b88678215d None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:37.134055 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:37.164677 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c104a867-2a1d-4cfd-991d-a66b7a8eb292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:37.165354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104a867-2a1d-4cfd-991d-a66b7a8eb292 None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:37.165637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104a867-2a1d-4cfd-991d-a66b7a8eb292 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:37.166030 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c104a867-2a1d-4cfd-991d-a66b7a8eb292 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:37.166741 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104a867-2a1d-4cfd-991d-a66b7a8eb292 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:37.168887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c104a867-2a1d-4cfd-991d-a66b7a8eb292 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:37.217306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcebab-f8ba-4568-a925-5d04081307be None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:37.245753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 106/217] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:32:36 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:32:37.259901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5681ec-3e42-482f-a748-49116cb0de58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:37.260701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5681ec-3e42-482f-a748-49116cb0de58 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:37.261119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5681ec-3e42-482f-a748-49116cb0de58 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:37.261471 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5681ec-3e42-482f-a748-49116cb0de58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:37.342745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5681ec-3e42-482f-a748-49116cb0de58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:37.344308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5681ec-3e42-482f-a748-49116cb0de58 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:37.379559 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:37.413947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc80d05-b914-4970-8afc-020ab4612943 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:37.414242 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc80d05-b914-4970-8afc-020ab4612943 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:37.414527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc80d05-b914-4970-8afc-020ab4612943 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:37.416214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 107/218] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:32:37.421819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938839ce-a617-4c13-9538-d4e8c2930fa3 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:37.422107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938839ce-a617-4c13-9538-d4e8c2930fa3 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:37.422391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938839ce-a617-4c13-9538-d4e8c2930fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:37.442212 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-938839ce-a617-4c13-9538-d4e8c2930fa3 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:37.444026 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-938839ce-a617-4c13-9538-d4e8c2930fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:37.464591 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 112/219] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 18:32:37.470597 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5681ec-3e42-482f-a748-49116cb0de58 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:37.537797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 108/220] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:37.538888 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92210f-aeb2-47d0-a41e-ede33384be19 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:37.539184 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92210f-aeb2-47d0-a41e-ede33384be19 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:37.539464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92210f-aeb2-47d0-a41e-ede33384be19 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:37.541056 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 109/221] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:37.546943 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f0fab-5e89-45ac-8074-45d07df30eb0 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:37.547234 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f0fab-5e89-45ac-8074-45d07df30eb0 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:37.547515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f0fab-5e89-45ac-8074-45d07df30eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:37.566693 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-e52f0fab-5e89-45ac-8074-45d07df30eb0 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:37.567932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e52f0fab-5e89-45ac-8074-45d07df30eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:37.600476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5681ec-3e42-482f-a748-49116cb0de58 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:37.639072 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:37.640972 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 110/222] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:37.641671 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f0fab-5e89-45ac-8074-45d07df30eb0 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:37.645911 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33ea39-f640-4680-9c42-8fa2c5850c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:37.647007 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33ea39-f640-4680-9c42-8fa2c5850c3c None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:37.647469 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33ea39-f640-4680-9c42-8fa2c5850c3c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:37.647953 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d33ea39-f640-4680-9c42-8fa2c5850c3c None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:37.649362 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33ea39-f640-4680-9c42-8fa2c5850c3c None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:37.652049 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d33ea39-f640-4680-9c42-8fa2c5850c3c None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:37.655104 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 113/223] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:37 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:37.660492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33ea39-f640-4680-9c42-8fa2c5850c3c None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:37.664507 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:37.779871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f0fab-5e89-45ac-8074-45d07df30eb0 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:37.789650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d33ea39-f640-4680-9c42-8fa2c5850c3c None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:37.818761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d8c5a-01f6-4b37-b342-7108608378ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:37.819581 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d8c5a-01f6-4b37-b342-7108608378ef None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:37.819870 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d8c5a-01f6-4b37-b342-7108608378ef None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:37.820187 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d8c5a-01f6-4b37-b342-7108608378ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:37.831154 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d8c5a-01f6-4b37-b342-7108608378ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:37.838958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-0f5d8c5a-01f6-4b37-b342-7108608378ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:37.838958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:37.838958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:37.838958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:37.838958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:37.838958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:37.838958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:37.838958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:37.838958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:37.838958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:37.838958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:37.838958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:37.838958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:37.838958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:37.838958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:37.838958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:37.840131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:37.840131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:37.840131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:37.840131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:37.840131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:37.840131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:37.840131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:37.840131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:37.840131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:37.840131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:37.840131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:37.840131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:37.840131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:37.840131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:37.840131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:37.840131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:37.841005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:37.841005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:37.841005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:37.841005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:37.841005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:37.841005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:37.841005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:37.841005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:37.841005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:37.841005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:37.841005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:37.841005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:37.841005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 111/224] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:32:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:37.841005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d8c5a-01f6-4b37-b342-7108608378ef None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:37.907041 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f88891-87df-4cd4-b384-a0d61606ab2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:37.908136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f88891-87df-4cd4-b384-a0d61606ab2e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:37.908681 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f88891-87df-4cd4-b384-a0d61606ab2e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:37.910646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f88891-87df-4cd4-b384-a0d61606ab2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:37.915063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f88891-87df-4cd4-b384-a0d61606ab2e None admin] RBAC: Adding query filter params (role.id=5c4481f023774d67997d4ba28e07cff0, scope.project.id=36535f8090e64641b80e339c1590bf71, user.id=858e97306c234649bd838005411bc7e7) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:37.915063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f88891-87df-4cd4-b384-a0d61606ab2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:37.915063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f88891-87df-4cd4-b384-a0d61606ab2e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:37.920366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 114/225] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:37 2022] GET /identity/v3/role_assignments?user.id=858e97306c234649bd838005411bc7e7&scope.project.id=36535f8090e64641b80e339c1590bf71&role.id=5c4481f023774d67997d4ba28e07cff0 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:37.921455 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f88891-87df-4cd4-b384-a0d61606ab2e None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:37.952599 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:38.015961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:38.045668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d8c5a-01f6-4b37-b342-7108608378ef None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:38.050635 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f88891-87df-4cd4-b384-a0d61606ab2e None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:38.091453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df652c4-1e65-4155-ac90-3b93d9cc2eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:38.093291 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df652c4-1e65-4155-ac90-3b93d9cc2eb6 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:38.093757 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df652c4-1e65-4155-ac90-3b93d9cc2eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:38.094183 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df652c4-1e65-4155-ac90-3b93d9cc2eb6 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:38.095267 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df652c4-1e65-4155-ac90-3b93d9cc2eb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:38.095898 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df652c4-1e65-4155-ac90-3b93d9cc2eb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:38.097766 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df652c4-1e65-4155-ac90-3b93d9cc2eb6 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:38.109810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 115/226] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:38.115436 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df652c4-1e65-4155-ac90-3b93d9cc2eb6 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:38.155689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1204819-112a-42a8-bb4d-e179ef7437a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:38.156520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1204819-112a-42a8-bb4d-e179ef7437a5 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:38.156808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1204819-112a-42a8-bb4d-e179ef7437a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:38.157090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1204819-112a-42a8-bb4d-e179ef7437a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:38.196175 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1204819-112a-42a8-bb4d-e179ef7437a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:38.205009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-b1204819-112a-42a8-bb4d-e179ef7437a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:38.205009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:38.205009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:38.205009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:38.205009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:38.205009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:38.205009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:38.205009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:38.205009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:38.205009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:38.205009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:38.205009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:38.205009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:38.205009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:38.205009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:38.205009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:38.206142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:38.206142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:38.206142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:38.206142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:38.206142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:38.206142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:38.206142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:38.206142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:38.206142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:38.206142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:38.206142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:38.206142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:38.206142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:38.206142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:38.206142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:38.206142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:38.207126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:38.207126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:38.207126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:38.207126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:38.207126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:38.207126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:38.207126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:38.207126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:38.207126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:38.207126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:38.207126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:38.207126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:38.212772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 112/227] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:32:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:38.224591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1204819-112a-42a8-bb4d-e179ef7437a5 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:38.233942 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df652c4-1e65-4155-ac90-3b93d9cc2eb6 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:38.271963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c311660-74aa-4e6c-8e9b-8b92dbdfce31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:38.273423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c311660-74aa-4e6c-8e9b-8b92dbdfce31 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:38.273859 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c311660-74aa-4e6c-8e9b-8b92dbdfce31 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:38.274307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c311660-74aa-4e6c-8e9b-8b92dbdfce31 None admin] PATH_INFO: `/v3/users/e76e94e438314b8c826639f550dc05cd` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:38.275785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c311660-74aa-4e6c-8e9b-8b92dbdfce31 None admin] RBAC: Authorizing `identity:get_user(user_id=e76e94e438314b8c826639f550dc05cd)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:38.277833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c311660-74aa-4e6c-8e9b-8b92dbdfce31 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:38.279724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 116/228] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:38 2022] GET /identity/v3/users/e76e94e438314b8c826639f550dc05cd => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:38.283977 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:38.285093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c311660-74aa-4e6c-8e9b-8b92dbdfce31 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:38.433495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1204819-112a-42a8-bb4d-e179ef7437a5 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:38.466011 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c311660-74aa-4e6c-8e9b-8b92dbdfce31 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:38.484233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c97ec-a0a3-4c00-bd09-dda5e9d2de27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:38.485236 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c97ec-a0a3-4c00-bd09-dda5e9d2de27 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:38.485740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c97ec-a0a3-4c00-bd09-dda5e9d2de27 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:38.486213 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c97ec-a0a3-4c00-bd09-dda5e9d2de27 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:38.487169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c97ec-a0a3-4c00-bd09-dda5e9d2de27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:38.487706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c97ec-a0a3-4c00-bd09-dda5e9d2de27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:38.489298 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c97ec-a0a3-4c00-bd09-dda5e9d2de27 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:38.492054 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:38.505031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b3d2c-839c-4737-af7c-7b2594a6fff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:38.505955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b3d2c-839c-4737-af7c-7b2594a6fff8 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:38.506243 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b3d2c-839c-4737-af7c-7b2594a6fff8 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:38.507034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 113/229] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:32:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:38.507142 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b3d2c-839c-4737-af7c-7b2594a6fff8 None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:38.516507 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c97ec-a0a3-4c00-bd09-dda5e9d2de27 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:38.519252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b3d2c-839c-4737-af7c-7b2594a6fff8 None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:38.520626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b3d2c-839c-4737-af7c-7b2594a6fff8 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:38.522489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 117/230] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:38 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:38.529806 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b3d2c-839c-4737-af7c-7b2594a6fff8 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:38.649426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:38.686771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c97ec-a0a3-4c00-bd09-dda5e9d2de27 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:38.724225 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120324a9-7fd0-41cf-97a8-8e2ae27b5767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:38.725576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120324a9-7fd0-41cf-97a8-8e2ae27b5767 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:38.726086 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120324a9-7fd0-41cf-97a8-8e2ae27b5767 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:38.726563 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120324a9-7fd0-41cf-97a8-8e2ae27b5767 None admin] PATH_INFO: `/v3/users/e76e94e438314b8c826639f550dc05cd` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:38.728015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120324a9-7fd0-41cf-97a8-8e2ae27b5767 None admin] RBAC: Authorizing `identity:get_user(user_id=e76e94e438314b8c826639f550dc05cd)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:38.730302 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120324a9-7fd0-41cf-97a8-8e2ae27b5767 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:38.732256 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 114/231] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:38 2022] GET /identity/v3/users/e76e94e438314b8c826639f550dc05cd => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:38.740353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120324a9-7fd0-41cf-97a8-8e2ae27b5767 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:38.742768 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b3d2c-839c-4737-af7c-7b2594a6fff8 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:38.818099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:38.836230 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a48bf-e5f2-4ea1-a0bf-3657d7da2678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:38.837133 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a48bf-e5f2-4ea1-a0bf-3657d7da2678 None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:38.837418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a48bf-e5f2-4ea1-a0bf-3657d7da2678 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:38.837757 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a48bf-e5f2-4ea1-a0bf-3657d7da2678 None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71/users/e76e94e438314b8c826639f550dc05cd/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:38.844859 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a48bf-e5f2-4ea1-a0bf-3657d7da2678 None admin] RBAC: Authorizing `identity:create_grant(project_id=36535f8090e64641b80e339c1590bf71, user_id=e76e94e438314b8c826639f550dc05cd, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:38.846316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a48bf-e5f2-4ea1-a0bf-3657d7da2678 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:38.860070 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120324a9-7fd0-41cf-97a8-8e2ae27b5767 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:38.897632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387cacc-ee40-4e19-a97a-60a48a3cefee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:38.898933 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387cacc-ee40-4e19-a97a-60a48a3cefee None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:38.899451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387cacc-ee40-4e19-a97a-60a48a3cefee None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:38.899953 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387cacc-ee40-4e19-a97a-60a48a3cefee None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:38.902092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387cacc-ee40-4e19-a97a-60a48a3cefee None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:38.903837 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387cacc-ee40-4e19-a97a-60a48a3cefee None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:38.905796 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 115/232] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:38 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:38.911176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387cacc-ee40-4e19-a97a-60a48a3cefee None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:38.950611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 118/233] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:32:38 2022] PUT /identity/v3/projects/36535f8090e64641b80e339c1590bf71/users/e76e94e438314b8c826639f550dc05cd/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:32:39.021372 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387cacc-ee40-4e19-a97a-60a48a3cefee None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:39.061520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85acba1-45d2-4981-b1e4-5ae827e2c016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:39.062842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85acba1-45d2-4981-b1e4-5ae827e2c016 None admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:39.063389 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85acba1-45d2-4981-b1e4-5ae827e2c016 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:39.063896 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85acba1-45d2-4981-b1e4-5ae827e2c016 None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71/users/e76e94e438314b8c826639f550dc05cd/roles/422c41a081a44a4e8b04f4d9ce6e8930` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:39.066611 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85acba1-45d2-4981-b1e4-5ae827e2c016 None admin] RBAC: Authorizing `identity:create_grant(project_id=36535f8090e64641b80e339c1590bf71, user_id=e76e94e438314b8c826639f550dc05cd, role_id=422c41a081a44a4e8b04f4d9ce6e8930)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:39.068452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85acba1-45d2-4981-b1e4-5ae827e2c016 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:39.071180 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:39.141546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 116/234] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:32:38 2022] PUT /identity/v3/projects/36535f8090e64641b80e339c1590bf71/users/e76e94e438314b8c826639f550dc05cd/roles/422c41a081a44a4e8b04f4d9ce6e8930 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:32:39.698560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ae0e0-65a0-42af-9fd5-0d5c3a9f1c63 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:39.699069 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ae0e0-65a0-42af-9fd5-0d5c3a9f1c63 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:39.699173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ae0e0-65a0-42af-9fd5-0d5c3a9f1c63 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:39.701443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 119/235] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:39.706934 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9dd30-0312-40d7-a7f9-d8db982b37b3 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:39.707357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9dd30-0312-40d7-a7f9-d8db982b37b3 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:39.707550 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9dd30-0312-40d7-a7f9-d8db982b37b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:39.728759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-7cd9dd30-0312-40d7-a7f9-d8db982b37b3 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:39.730517 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-7cd9dd30-0312-40d7-a7f9-d8db982b37b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:39.812804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 117/236] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:39.840244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ae0e0-65a0-42af-9fd5-0d5c3a9f1c63 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:39.850562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf13b72-96f2-478a-9e7a-743c8ff8cd22 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:39.850857 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf13b72-96f2-478a-9e7a-743c8ff8cd22 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:39.851125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf13b72-96f2-478a-9e7a-743c8ff8cd22 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:39.856462 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 118/237] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:39 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:39.862261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edba00-5726-49a1-b246-f4350df8fa28 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:39.862556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edba00-5726-49a1-b246-f4350df8fa28 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:39.862837 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edba00-5726-49a1-b246-f4350df8fa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:39.894773 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-d4edba00-5726-49a1-b246-f4350df8fa28 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:39.896016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-d4edba00-5726-49a1-b246-f4350df8fa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:39.988269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 119/238] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:40.011971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edba00-5726-49a1-b246-f4350df8fa28 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:40.061145 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ae0e0-65a0-42af-9fd5-0d5c3a9f1c63 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:40.069202 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:40.114426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edba00-5726-49a1-b246-f4350df8fa28 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:40.119876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:40.150758 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10f7ec-e6d5-4141-b43c-648e00214fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:40.152189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10f7ec-e6d5-4141-b43c-648e00214fc3 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:40.152480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10f7ec-e6d5-4141-b43c-648e00214fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:40.152759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10f7ec-e6d5-4141-b43c-648e00214fc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:40.154400 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10f7ec-e6d5-4141-b43c-648e00214fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:40.155920 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10f7ec-e6d5-4141-b43c-648e00214fc3 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:40.157770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 120/239] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:32:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:40.158194 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb712f-a715-4412-a457-a2090e6b29ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:40.158990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb712f-a715-4412-a457-a2090e6b29ce None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:40.159272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb712f-a715-4412-a457-a2090e6b29ce None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:40.159560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb712f-a715-4412-a457-a2090e6b29ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:40.166416 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10f7ec-e6d5-4141-b43c-648e00214fc3 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:40.182868 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb712f-a715-4412-a457-a2090e6b29ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:40.199928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-51fb712f-a715-4412-a457-a2090e6b29ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:40.199928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:40.199928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:40.199928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:40.199928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:40.199928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:40.199928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:40.199928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:40.199928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:40.199928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:40.199928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:40.199928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:40.199928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:40.199928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:40.199928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:40.199928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:40.200858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:40.200858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:40.200858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:40.200858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:40.200858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:40.200858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:40.200858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:40.200858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:40.200858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:40.200858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:40.200858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:40.200858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:40.200858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:40.200858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:40.200858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:40.200858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:40.201642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:40.201642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:40.201642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:40.201642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:40.201642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:40.201642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:40.201642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:40.201642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:40.201642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:40.201642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:40.201642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:40.201642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:40.204367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 120/240] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:40.209963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb712f-a715-4412-a457-a2090e6b29ce None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:40.270663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10f7ec-e6d5-4141-b43c-648e00214fc3 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:40.305370 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d549478-c90e-48a5-9377-58c655618f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:40.306046 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d549478-c90e-48a5-9377-58c655618f03 None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:40.306330 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d549478-c90e-48a5-9377-58c655618f03 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:40.306606 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d549478-c90e-48a5-9377-58c655618f03 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:40.307330 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d549478-c90e-48a5-9377-58c655618f03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:40.311033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d549478-c90e-48a5-9377-58c655618f03 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:40.312547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:40.380783 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb712f-a715-4412-a457-a2090e6b29ce None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:40.416713 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 121/241] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:32:40 2022] POST /identity/v3/users => generated 293 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:32:40.425615 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400b4be-407c-4812-ba98-56a11a9249cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:40.426647 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400b4be-407c-4812-ba98-56a11a9249cc None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:40.427137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400b4be-407c-4812-ba98-56a11a9249cc None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:40.427654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400b4be-407c-4812-ba98-56a11a9249cc None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:40.428129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de914133-cdc0-48da-8a43-d1f122c1a1cf None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:40.428424 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de914133-cdc0-48da-8a43-d1f122c1a1cf None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:40.428704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de914133-cdc0-48da-8a43-d1f122c1a1cf None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:40.429277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400b4be-407c-4812-ba98-56a11a9249cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:40.429784 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400b4be-407c-4812-ba98-56a11a9249cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:40.430071 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 122/242] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:40.431651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400b4be-407c-4812-ba98-56a11a9249cc None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:40.439683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93227e8-c84c-4e97-b470-076cd160fdfe None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:40.439683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93227e8-c84c-4e97-b470-076cd160fdfe None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:40.439683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93227e8-c84c-4e97-b470-076cd160fdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:40.449686 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 121/243] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:40.455425 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400b4be-407c-4812-ba98-56a11a9249cc None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:40.457363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-b93227e8-c84c-4e97-b470-076cd160fdfe None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:40.459145 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b93227e8-c84c-4e97-b470-076cd160fdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:40.542363 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:40.550140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 123/244] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:40.578781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93227e8-c84c-4e97-b470-076cd160fdfe None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:40.632659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400b4be-407c-4812-ba98-56a11a9249cc None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:40.674882 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31893897-748d-4603-adf7-d7a400e65aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:40.676041 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31893897-748d-4603-adf7-d7a400e65aa3 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:40.676467 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31893897-748d-4603-adf7-d7a400e65aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:40.676946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31893897-748d-4603-adf7-d7a400e65aa3 None admin] PATH_INFO: `/v3/users/5ab0ad8318854715989ba962ebb9a4a3` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:40.695088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31893897-748d-4603-adf7-d7a400e65aa3 None admin] RBAC: Authorizing `identity:get_user(user_id=5ab0ad8318854715989ba962ebb9a4a3)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:40.696865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31893897-748d-4603-adf7-d7a400e65aa3 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:40.699592 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 122/245] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:40 2022] GET /identity/v3/users/5ab0ad8318854715989ba962ebb9a4a3 => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:40.705173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31893897-748d-4603-adf7-d7a400e65aa3 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:40.754089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93227e8-c84c-4e97-b470-076cd160fdfe None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:40.767001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:40.800749 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8d216-fb3d-4277-8222-112b2bf4a400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:40.801792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8d216-fb3d-4277-8222-112b2bf4a400 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:40.802263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8d216-fb3d-4277-8222-112b2bf4a400 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:40.802748 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8d216-fb3d-4277-8222-112b2bf4a400 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:40.815719 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8d216-fb3d-4277-8222-112b2bf4a400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:40.828098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-0bc8d216-fb3d-4277-8222-112b2bf4a400 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:40.828098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:40.828098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:40.828098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:40.828098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:40.828098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:40.828098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:40.828098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:40.828098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:40.828098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:40.828098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:40.828098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:40.828098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:40.828098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:40.828098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:40.828098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:40.829003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:40.829003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:40.829003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:40.829003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:40.829003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:40.829003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:40.829003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:40.829003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:40.829003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:40.829003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:40.829003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:40.829003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:40.829003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:40.829003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:40.829003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:40.829003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:40.829786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:40.829786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:40.829786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:40.829786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:40.829786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:40.829786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:40.829786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:40.829786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:40.829786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:40.829786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:40.829786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:40.829786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:40.830385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31893897-748d-4603-adf7-d7a400e65aa3 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:40.832087 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:40.833126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 124/246] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:32:40.839630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8d216-fb3d-4277-8222-112b2bf4a400 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:40.879986 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db5f97-38e3-4486-81f7-2262d31479a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:40.881032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db5f97-38e3-4486-81f7-2262d31479a5 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:40.881333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db5f97-38e3-4486-81f7-2262d31479a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:40.881620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db5f97-38e3-4486-81f7-2262d31479a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:40.984827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db5f97-38e3-4486-81f7-2262d31479a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:40.985711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8d216-fb3d-4277-8222-112b2bf4a400 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:40.986280 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db5f97-38e3-4486-81f7-2262d31479a5 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:41.027415 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3aef8-dc3e-4277-870f-a606120a53eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:41.028577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3aef8-dc3e-4277-870f-a606120a53eb None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:41.029071 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3aef8-dc3e-4277-870f-a606120a53eb None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:41.029545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf3aef8-dc3e-4277-870f-a606120a53eb None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:41.030540 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3aef8-dc3e-4277-870f-a606120a53eb None admin] RBAC: Adding query filter params (name=member) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:41.031100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3aef8-dc3e-4277-870f-a606120a53eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:41.032725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf3aef8-dc3e-4277-870f-a606120a53eb None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:41.042500 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 125/247] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:41.048500 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3aef8-dc3e-4277-870f-a606120a53eb None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:41.088293 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:41.112931 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 123/248] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:41.122570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db5f97-38e3-4486-81f7-2262d31479a5 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:41.125904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:41.193978 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf3aef8-dc3e-4277-870f-a606120a53eb None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:41.235379 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bec6a-a400-4e20-b81e-daa4d51f4d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:41.236652 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bec6a-a400-4e20-b81e-daa4d51f4d26 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:41.237179 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bec6a-a400-4e20-b81e-daa4d51f4d26 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:41.237670 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bec6a-a400-4e20-b81e-daa4d51f4d26 None admin] PATH_INFO: `/v3/users/858e97306c234649bd838005411bc7e7` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:41.239066 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009bec6a-a400-4e20-b81e-daa4d51f4d26 None admin] RBAC: Authorizing `identity:get_user(user_id=858e97306c234649bd838005411bc7e7)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:41.240766 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009bec6a-a400-4e20-b81e-daa4d51f4d26 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:41.242617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 126/249] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:41 2022] GET /identity/v3/users/858e97306c234649bd838005411bc7e7 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:41.248771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bec6a-a400-4e20-b81e-daa4d51f4d26 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:41.255627 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db5f97-38e3-4486-81f7-2262d31479a5 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:41.293644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897aba5-65ce-4e4e-8853-3a72a857c20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:41.294520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897aba5-65ce-4e4e-8853-3a72a857c20a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:41.294808 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897aba5-65ce-4e4e-8853-3a72a857c20a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:41.295088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897aba5-65ce-4e4e-8853-3a72a857c20a None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:41.296727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897aba5-65ce-4e4e-8853-3a72a857c20a None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:41.298896 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897aba5-65ce-4e4e-8853-3a72a857c20a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:41.300635 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 124/250] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:41 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:41.306423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897aba5-65ce-4e4e-8853-3a72a857c20a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:41.355918 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:41.360800 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bec6a-a400-4e20-b81e-daa4d51f4d26 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:41.382925 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:41.397271 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9873078-374d-46c1-ae11-e9392d487cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:41.398727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9873078-374d-46c1-ae11-e9392d487cf7 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:41.399203 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9873078-374d-46c1-ae11-e9392d487cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:41.399699 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9873078-374d-46c1-ae11-e9392d487cf7 None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:41.401064 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9873078-374d-46c1-ae11-e9392d487cf7 None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:41.402724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9873078-374d-46c1-ae11-e9392d487cf7 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:41.405112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 127/251] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:41 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:41.410864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9873078-374d-46c1-ae11-e9392d487cf7 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:41.418170 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897aba5-65ce-4e4e-8853-3a72a857c20a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:41.454566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98c4ba8-424d-4533-8584-e7899f262ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:41.455233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c4ba8-424d-4533-8584-e7899f262ca5 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:41.455523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c4ba8-424d-4533-8584-e7899f262ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:41.455838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98c4ba8-424d-4533-8584-e7899f262ca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:41.456683 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c4ba8-424d-4533-8584-e7899f262ca5 None admin] RBAC: Adding query filter params (role.id=c022b2199d7449faa0831ed802c403d3, scope.project.id=36535f8090e64641b80e339c1590bf71, user.id=5ab0ad8318854715989ba962ebb9a4a3) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:41.457006 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c4ba8-424d-4533-8584-e7899f262ca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:41.458466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98c4ba8-424d-4533-8584-e7899f262ca5 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:41.464678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 125/252] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:41 2022] GET /identity/v3/role_assignments?user.id=5ab0ad8318854715989ba962ebb9a4a3&scope.project.id=36535f8090e64641b80e339c1590bf71&role.id=c022b2199d7449faa0831ed802c403d3 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:41.535567 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9873078-374d-46c1-ae11-e9392d487cf7 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:41.569510 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cddfe1-3b62-45f2-9bde-8a4c8e35c485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:41.570472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cddfe1-3b62-45f2-9bde-8a4c8e35c485 None admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:41.570759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cddfe1-3b62-45f2-9bde-8a4c8e35c485 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:41.571037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cddfe1-3b62-45f2-9bde-8a4c8e35c485 None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71/users/858e97306c234649bd838005411bc7e7/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:41.573180 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cddfe1-3b62-45f2-9bde-8a4c8e35c485 None admin] RBAC: Authorizing `identity:create_grant(project_id=36535f8090e64641b80e339c1590bf71, user_id=858e97306c234649bd838005411bc7e7, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:41.574683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cddfe1-3b62-45f2-9bde-8a4c8e35c485 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:41.660441 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf08ab-06ef-42b1-8f52-8deb1cecb675 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:41.660778 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf08ab-06ef-42b1-8f52-8deb1cecb675 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:41.661012 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf08ab-06ef-42b1-8f52-8deb1cecb675 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:41.662395 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 126/253] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:32:41.664725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 128/254] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:32:41 2022] PUT /identity/v3/projects/36535f8090e64641b80e339c1590bf71/users/858e97306c234649bd838005411bc7e7/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:32:41.671087 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb96a7-41e9-4190-af04-644c7605ea7e None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:41.671380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb96a7-41e9-4190-af04-644c7605ea7e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:41.671697 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fb96a7-41e9-4190-af04-644c7605ea7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:41.689895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-24fb96a7-41e9-4190-af04-644c7605ea7e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:41.691137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-24fb96a7-41e9-4190-af04-644c7605ea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:41.778623 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 127/255] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:41.803693 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cddfe1-3b62-45f2-9bde-8a4c8e35c485 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:41.815416 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6223765-b5c9-42f3-84b6-f05c5e1eb302 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:41.816766 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6223765-b5c9-42f3-84b6-f05c5e1eb302 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:41.817054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6223765-b5c9-42f3-84b6-f05c5e1eb302 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:41.821211 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 128/256] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:41.826528 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902cfbb-0229-4fb2-b8e8-237c0d50f538 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:41.826813 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902cfbb-0229-4fb2-b8e8-237c0d50f538 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:41.827095 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902cfbb-0229-4fb2-b8e8-237c0d50f538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:41.859984 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:41.860487 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-3902cfbb-0229-4fb2-b8e8-237c0d50f538 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:41.861734 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3902cfbb-0229-4fb2-b8e8-237c0d50f538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:41.987725 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:42.000999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cddfe1-3b62-45f2-9bde-8a4c8e35c485 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:42.004327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 129/257] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:42.042733 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35299833-647c-45ef-b13d-55fbe734575b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:42.043569 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35299833-647c-45ef-b13d-55fbe734575b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:42.043851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35299833-647c-45ef-b13d-55fbe734575b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:42.044128 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35299833-647c-45ef-b13d-55fbe734575b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:42.056699 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35299833-647c-45ef-b13d-55fbe734575b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:42.065169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-35299833-647c-45ef-b13d-55fbe734575b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:42.065169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:42.065169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:42.065169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:42.065169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:42.065169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:42.065169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:42.065169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:42.065169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:42.065169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:42.065169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:42.065169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:42.065169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:42.065169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:42.065169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:42.065169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:42.067176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:42.067176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:42.067176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:42.067176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:42.067176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:42.067176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:42.067176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:42.067176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:42.067176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:42.067176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:42.067176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:42.067176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:42.067176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:42.067176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:42.067176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:42.067176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:42.069100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:42.069100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:42.069100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:42.069100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:42.069100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:42.069100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:42.069100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:42.069100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:42.069100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:42.069100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:42.069100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:42.069100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:42.069100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 129/258] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:32:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:42.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902cfbb-0229-4fb2-b8e8-237c0d50f538 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:42.088232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35299833-647c-45ef-b13d-55fbe734575b None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:42.246269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:42.253409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902cfbb-0229-4fb2-b8e8-237c0d50f538 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:42.262663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35299833-647c-45ef-b13d-55fbe734575b None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:42.301033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b6dcb-650b-42d2-b021-6146fccd677d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:42.301851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b6dcb-650b-42d2-b021-6146fccd677d None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:42.302134 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b6dcb-650b-42d2-b021-6146fccd677d None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:42.302410 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b6dcb-650b-42d2-b021-6146fccd677d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:42.314478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b6dcb-650b-42d2-b021-6146fccd677d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:42.324336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-f56b6dcb-650b-42d2-b021-6146fccd677d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:42.324336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:42.324336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:42.324336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:42.324336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:42.324336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:42.324336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:42.324336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:42.324336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:42.324336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:42.324336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:42.324336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:42.324336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:42.324336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:42.324336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:42.324336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:42.325223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:42.325223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:42.325223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:42.325223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:42.325223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:42.325223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:42.325223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:42.325223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:42.325223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:42.325223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:42.325223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:42.325223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:42.325223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:42.325223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:42.325223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:42.325223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:42.326043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:42.326043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:42.326043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:42.326043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:42.326043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:42.326043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:42.326043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:42.326043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:42.326043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:42.326043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:42.326043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:42.326043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:42.330746 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 130/259] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:32:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:42.332357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b6dcb-650b-42d2-b021-6146fccd677d None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:42.353580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e545db6-21a8-4bd2-bcaa-ffacfd7dd255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:42.354578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e545db6-21a8-4bd2-bcaa-ffacfd7dd255 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:42.354866 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e545db6-21a8-4bd2-bcaa-ffacfd7dd255 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:42.355146 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e545db6-21a8-4bd2-bcaa-ffacfd7dd255 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:42.356748 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e545db6-21a8-4bd2-bcaa-ffacfd7dd255 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:42.357070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e545db6-21a8-4bd2-bcaa-ffacfd7dd255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:42.361642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e545db6-21a8-4bd2-bcaa-ffacfd7dd255 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:42.375957 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 130/260] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:42.381546 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e545db6-21a8-4bd2-bcaa-ffacfd7dd255 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:42.463939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:42.466892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b6dcb-650b-42d2-b021-6146fccd677d None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:42.515481 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e545db6-21a8-4bd2-bcaa-ffacfd7dd255 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:42.520829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdeb35-7487-47b8-b746-274bb4e917ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:42.521518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdeb35-7487-47b8-b746-274bb4e917ae None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:42.521797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdeb35-7487-47b8-b746-274bb4e917ae None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:42.522070 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdeb35-7487-47b8-b746-274bb4e917ae None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:42.522824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdeb35-7487-47b8-b746-274bb4e917ae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:42.523135 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdeb35-7487-47b8-b746-274bb4e917ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:42.529920 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdeb35-7487-47b8-b746-274bb4e917ae None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:42.538708 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 131/261] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:32:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:42.552452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdeb35-7487-47b8-b746-274bb4e917ae None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:42.561297 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c78a5-97c4-4306-9054-1e1f53eca5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:42.567606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c78a5-97c4-4306-9054-1e1f53eca5da None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:42.567606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c78a5-97c4-4306-9054-1e1f53eca5da None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:42.567606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4c78a5-97c4-4306-9054-1e1f53eca5da None admin] PATH_INFO: `/v3/users/e76e94e438314b8c826639f550dc05cd` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:42.567606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c78a5-97c4-4306-9054-1e1f53eca5da None admin] RBAC: Authorizing `identity:get_user(user_id=e76e94e438314b8c826639f550dc05cd)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:42.567606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4c78a5-97c4-4306-9054-1e1f53eca5da None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:42.567606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 131/262] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:42 2022] GET /identity/v3/users/e76e94e438314b8c826639f550dc05cd => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:42.578109 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c78a5-97c4-4306-9054-1e1f53eca5da None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:42.578976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:42.749313 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdeb35-7487-47b8-b746-274bb4e917ae None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:42.777310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4c78a5-97c4-4306-9054-1e1f53eca5da None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:42.819247 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae5c7e-8b35-497d-b25e-13ef3f0c496a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:42.820360 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:42.821462 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae5c7e-8b35-497d-b25e-13ef3f0c496a None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:42.821999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae5c7e-8b35-497d-b25e-13ef3f0c496a None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:42.822451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae5c7e-8b35-497d-b25e-13ef3f0c496a None admin] PATH_INFO: `/v3/users/e76e94e438314b8c826639f550dc05cd` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:42.828641 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae5c7e-8b35-497d-b25e-13ef3f0c496a None admin] RBAC: Authorizing `identity:get_user(user_id=e76e94e438314b8c826639f550dc05cd)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:42.830332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae5c7e-8b35-497d-b25e-13ef3f0c496a None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:42.832193 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 132/263] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:42 2022] GET /identity/v3/users/e76e94e438314b8c826639f550dc05cd => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:42.838176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae5c7e-8b35-497d-b25e-13ef3f0c496a None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:42.839283 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa119b-f60a-4b72-957e-a8670e693d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:42.840419 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa119b-f60a-4b72-957e-a8670e693d9a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:42.840419 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa119b-f60a-4b72-957e-a8670e693d9a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:42.840582 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa119b-f60a-4b72-957e-a8670e693d9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:42.957792 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa119b-f60a-4b72-957e-a8670e693d9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:42.959268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa119b-f60a-4b72-957e-a8670e693d9a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:42.974008 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:43.027224 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae5c7e-8b35-497d-b25e-13ef3f0c496a None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:43.117246 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 132/264] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:43.121429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa119b-f60a-4b72-957e-a8670e693d9a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:43.125221 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29b465-6d9a-4e0c-ac96-0bfe8870b3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:43.126118 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29b465-6d9a-4e0c-ac96-0bfe8870b3a8 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:43.126620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29b465-6d9a-4e0c-ac96-0bfe8870b3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:43.127090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a29b465-6d9a-4e0c-ac96-0bfe8870b3a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:43.167905 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:43.235156 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa119b-f60a-4b72-957e-a8670e693d9a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:43.271108 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85cd5a7-d30c-4cb1-a15c-27eca7e1a207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:43.272371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cd5a7-d30c-4cb1-a15c-27eca7e1a207 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:43.273515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cd5a7-d30c-4cb1-a15c-27eca7e1a207 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:43.273515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cd5a7-d30c-4cb1-a15c-27eca7e1a207 None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:43.274778 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85cd5a7-d30c-4cb1-a15c-27eca7e1a207 None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:43.276225 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85cd5a7-d30c-4cb1-a15c-27eca7e1a207 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:43.278039 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 133/265] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:43 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:43.284029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85cd5a7-d30c-4cb1-a15c-27eca7e1a207 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:43.319997 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29b465-6d9a-4e0c-ac96-0bfe8870b3a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:43.321525 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a29b465-6d9a-4e0c-ac96-0bfe8870b3a8 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:43.465022 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:43.471877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:43.484267 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85cd5a7-d30c-4cb1-a15c-27eca7e1a207 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:43.511370 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 133/266] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:43.516935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29b465-6d9a-4e0c-ac96-0bfe8870b3a8 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:43.560811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d9a34-c0ed-4c24-8d53-905662b9a6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:43.561763 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d9a34-c0ed-4c24-8d53-905662b9a6d8 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:43.562192 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d9a34-c0ed-4c24-8d53-905662b9a6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:43.562608 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d9a34-c0ed-4c24-8d53-905662b9a6d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:43.563624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d9a34-c0ed-4c24-8d53-905662b9a6d8 None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=36535f8090e64641b80e339c1590bf71, user.id=e76e94e438314b8c826639f550dc05cd) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:43.564081 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d9a34-c0ed-4c24-8d53-905662b9a6d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:43.565699 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d9a34-c0ed-4c24-8d53-905662b9a6d8 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:43.577956 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 134/267] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:43 2022] GET /identity/v3/role_assignments?user.id=e76e94e438314b8c826639f550dc05cd&scope.project.id=36535f8090e64641b80e339c1590bf71&role.id=b156409c977248e1b23c26e589b1e04f => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:43.707969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a29b465-6d9a-4e0c-ac96-0bfe8870b3a8 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:43.768570 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffe983-1902-4203-acd8-0cdadf289268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:43.769716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffe983-1902-4203-acd8-0cdadf289268 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:43.770159 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffe983-1902-4203-acd8-0cdadf289268 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:43.770578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffe983-1902-4203-acd8-0cdadf289268 None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:43.772208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffe983-1902-4203-acd8-0cdadf289268 None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:43.773848 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffe983-1902-4203-acd8-0cdadf289268 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:43.775777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 134/268] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:43 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:43.782602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d9a34-c0ed-4c24-8d53-905662b9a6d8 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:43.896944 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d9a34-c0ed-4c24-8d53-905662b9a6d8 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:43.939051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ab2e1-e3ce-4ef7-a79e-baad23691da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:43.939979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ab2e1-e3ce-4ef7-a79e-baad23691da9 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:43.940404 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ab2e1-e3ce-4ef7-a79e-baad23691da9 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:43.940848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ab2e1-e3ce-4ef7-a79e-baad23691da9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:43.941868 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ab2e1-e3ce-4ef7-a79e-baad23691da9 None admin] RBAC: Adding query filter params (role.id=422c41a081a44a4e8b04f4d9ce6e8930, scope.project.id=36535f8090e64641b80e339c1590bf71, user.id=e76e94e438314b8c826639f550dc05cd) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:43.942322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ab2e1-e3ce-4ef7-a79e-baad23691da9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:43.943922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ab2e1-e3ce-4ef7-a79e-baad23691da9 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:43.951003 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 135/269] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:43 2022] GET /identity/v3/role_assignments?user.id=e76e94e438314b8c826639f550dc05cd&scope.project.id=36535f8090e64641b80e339c1590bf71&role.id=422c41a081a44a4e8b04f4d9ce6e8930 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:44.075001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbeac7-da16-4d14-8447-5e1900b216d4 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:44.075888 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbeac7-da16-4d14-8447-5e1900b216d4 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:44.076310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbeac7-da16-4d14-8447-5e1900b216d4 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:44.078130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 135/270] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:44.084636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96148a80-18ca-4d8a-8ec6-2c5de4ce9380 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:44.085231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96148a80-18ca-4d8a-8ec6-2c5de4ce9380 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:44.085682 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96148a80-18ca-4d8a-8ec6-2c5de4ce9380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:44.103899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-96148a80-18ca-4d8a-8ec6-2c5de4ce9380 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:44.105915 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-96148a80-18ca-4d8a-8ec6-2c5de4ce9380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:44.122794 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:44.138003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e7b27-9893-4d6f-a53a-4a066718f69a None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:44.138281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e7b27-9893-4d6f-a53a-4a066718f69a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:44.138600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e7b27-9893-4d6f-a53a-4a066718f69a None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:44.140006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 136/271] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:32:44.145340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3baf62-129d-4fa2-a31c-87ca6072d3f2 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:44.145623 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3baf62-129d-4fa2-a31c-87ca6072d3f2 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:44.145899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3baf62-129d-4fa2-a31c-87ca6072d3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:44.176075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-fd3baf62-129d-4fa2-a31c-87ca6072d3f2 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:44.177294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-fd3baf62-129d-4fa2-a31c-87ca6072d3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:44.212285 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 136/272] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:44.216996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d454db-11c3-4f70-ade8-11f84e7115c0 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:44.217284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d454db-11c3-4f70-ade8-11f84e7115c0 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:44.217564 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d454db-11c3-4f70-ade8-11f84e7115c0 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:44.219158 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 137/273] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:44.224355 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930de5d0-9117-46d6-83ff-56b6fd3f19d3 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:44.224639 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930de5d0-9117-46d6-83ff-56b6fd3f19d3 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:44.224914 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930de5d0-9117-46d6-83ff-56b6fd3f19d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:44.247738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:44.252017 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-930de5d0-9117-46d6-83ff-56b6fd3f19d3 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:44.252017 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-930de5d0-9117-46d6-83ff-56b6fd3f19d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:44.288668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 137/274] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:44.289534 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3baf62-129d-4fa2-a31c-87ca6072d3f2 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:44.342269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 138/275] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:44.343037 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930de5d0-9117-46d6-83ff-56b6fd3f19d3 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:44.426383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3baf62-129d-4fa2-a31c-87ca6072d3f2 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:44.431696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:44.452612 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930de5d0-9117-46d6-83ff-56b6fd3f19d3 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:44.461711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343387a7-23c1-4756-b31b-8d947ef2a142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:44.462508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343387a7-23c1-4756-b31b-8d947ef2a142 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:44.462784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343387a7-23c1-4756-b31b-8d947ef2a142 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:44.463061 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343387a7-23c1-4756-b31b-8d947ef2a142 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:44.464277 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343387a7-23c1-4756-b31b-8d947ef2a142 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:44.465787 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343387a7-23c1-4756-b31b-8d947ef2a142 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:44.467564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 138/276] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:32:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:44.468176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343387a7-23c1-4756-b31b-8d947ef2a142 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:44.498500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ff451-dc56-4ac7-8a84-4a3c51673b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:44.499343 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ff451-dc56-4ac7-8a84-4a3c51673b17 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:44.499918 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ff451-dc56-4ac7-8a84-4a3c51673b17 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:44.500024 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ff451-dc56-4ac7-8a84-4a3c51673b17 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:44.510407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ff451-dc56-4ac7-8a84-4a3c51673b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:44.517831 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:44.518216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-ab3ff451-dc56-4ac7-8a84-4a3c51673b17 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:44.518216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:44.518216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:44.518216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:44.518216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:44.518216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:44.518216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:44.518216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:44.518216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:44.518216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:44.518216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:44.518216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:44.518216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:44.518216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:44.518216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:44.518216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:44.519074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:44.519074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:44.519074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:44.519074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:44.519074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:44.519074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:44.519074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:44.519074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:44.519074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:44.519074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:44.519074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:44.519074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:44.519074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:44.519074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:44.519074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:44.519074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:44.519904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:44.519904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:44.519904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:44.519904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:44.519904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:44.519904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:44.519904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:44.519904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:44.519904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:44.519904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:44.519904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:44.519904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:44.519904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 139/277] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:44.520547 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ff451-dc56-4ac7-8a84-4a3c51673b17 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:44.581458 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343387a7-23c1-4756-b31b-8d947ef2a142 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:44.618379 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97930460-48d7-4052-a407-0c5a1eee14b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:44.619109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97930460-48d7-4052-a407-0c5a1eee14b4 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:44.619389 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97930460-48d7-4052-a407-0c5a1eee14b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:44.619723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97930460-48d7-4052-a407-0c5a1eee14b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:44.630125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ff451-dc56-4ac7-8a84-4a3c51673b17 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:44.630916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97930460-48d7-4052-a407-0c5a1eee14b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:44.638666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-97930460-48d7-4052-a407-0c5a1eee14b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:44.638666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:44.638666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:44.638666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:44.638666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:44.638666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:44.638666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:44.638666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:44.638666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:44.638666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:44.638666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:44.638666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:44.638666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:44.638666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:44.638666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:44.638666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:44.639628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:44.639628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:44.639628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:44.639628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:44.639628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:44.639628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:44.639628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:44.639628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:44.639628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:44.639628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:44.639628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:44.639628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:44.639628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:44.639628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:44.639628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:44.639628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:44.640418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:44.640418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:44.640418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:44.640418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:44.640418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:44.640418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:44.640418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:44.640418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:44.640418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:44.640418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:44.640418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:44.640418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:44.640418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 139/278] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:44.641067 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97930460-48d7-4052-a407-0c5a1eee14b4 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:44.671322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e19017-3ef9-4937-8e9d-84d283fa03da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:44.672292 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19017-3ef9-4937-8e9d-84d283fa03da None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:44.672576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19017-3ef9-4937-8e9d-84d283fa03da None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:44.672853 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19017-3ef9-4937-8e9d-84d283fa03da None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:44.673561 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e19017-3ef9-4937-8e9d-84d283fa03da None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:44.674998 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e19017-3ef9-4937-8e9d-84d283fa03da None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:44.685374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:44.746989 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97930460-48d7-4052-a407-0c5a1eee14b4 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:44.748710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:44.768398 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 140/279] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:32:44 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:32:44.777966 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e19017-3ef9-4937-8e9d-84d283fa03da None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:44.782303 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c2ed5-3369-40d6-ab70-a1eb1d9d8d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:44.787717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c2ed5-3369-40d6-ab70-a1eb1d9d8d51 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:44.787717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c2ed5-3369-40d6-ab70-a1eb1d9d8d51 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:44.787717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c2ed5-3369-40d6-ab70-a1eb1d9d8d51 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:44.787717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c2ed5-3369-40d6-ab70-a1eb1d9d8d51 None admin] RBAC: Adding query filter params (name=member) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:44.787717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c2ed5-3369-40d6-ab70-a1eb1d9d8d51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:44.787717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c2ed5-3369-40d6-ab70-a1eb1d9d8d51 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:44.797817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 140/280] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:44.803869 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c2ed5-3369-40d6-ab70-a1eb1d9d8d51 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:44.928560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e19017-3ef9-4937-8e9d-84d283fa03da None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:44.944697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c2ed5-3369-40d6-ab70-a1eb1d9d8d51 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:44.974631 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63e9f9-1652-415e-9817-9a1ca0273141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:44.975305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63e9f9-1652-415e-9817-9a1ca0273141 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:44.975626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63e9f9-1652-415e-9817-9a1ca0273141 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:44.975900 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63e9f9-1652-415e-9817-9a1ca0273141 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:44.976660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63e9f9-1652-415e-9817-9a1ca0273141 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:44.976961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63e9f9-1652-415e-9817-9a1ca0273141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:44.978352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63e9f9-1652-415e-9817-9a1ca0273141 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:44.987462 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 141/281] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:44.988871 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493b0ff-9f31-48c6-83a3-e94db486d024 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:44.989161 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493b0ff-9f31-48c6-83a3-e94db486d024 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:44.989439 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493b0ff-9f31-48c6-83a3-e94db486d024 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:44.990810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 142/282] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:44.995729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d26886-97d5-4147-a871-24e8a46fe14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:44.996095 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493b0ff-9f31-48c6-83a3-e94db486d024 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:44.996614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d26886-97d5-4147-a871-24e8a46fe14b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:44.996905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d26886-97d5-4147-a871-24e8a46fe14b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:44.998062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d26886-97d5-4147-a871-24e8a46fe14b None admin] PATH_INFO: `/v3/users/1d8cdd1fd7914ea6b4149a7d8cd882c6` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:45.013277 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d26886-97d5-4147-a871-24e8a46fe14b None admin] RBAC: Authorizing `identity:get_user(user_id=1d8cdd1fd7914ea6b4149a7d8cd882c6)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:45.014783 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d26886-97d5-4147-a871-24e8a46fe14b None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:45.016572 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 141/283] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:44 2022] GET /identity/v3/users/1d8cdd1fd7914ea6b4149a7d8cd882c6 => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:45.022563 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654e9a4-e328-41f9-9157-4cd853a9dfd7 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:45.022859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654e9a4-e328-41f9-9157-4cd853a9dfd7 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:45.023145 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b654e9a4-e328-41f9-9157-4cd853a9dfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:45.044494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-b654e9a4-e328-41f9-9157-4cd853a9dfd7 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:45.047732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b654e9a4-e328-41f9-9157-4cd853a9dfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:45.065749 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:45.075555 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:45.133517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493b0ff-9f31-48c6-83a3-e94db486d024 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:45.134526 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 142/284] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:45.137588 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654e9a4-e328-41f9-9157-4cd853a9dfd7 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:45.177385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f0326-75de-4178-87ea-aa0d2ee043de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:45.178426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f0326-75de-4178-87ea-aa0d2ee043de None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:45.178877 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f0326-75de-4178-87ea-aa0d2ee043de None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:45.179186 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f0326-75de-4178-87ea-aa0d2ee043de None admin] PATH_INFO: `/v3/users/5ab0ad8318854715989ba962ebb9a4a3` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:45.181669 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f0326-75de-4178-87ea-aa0d2ee043de None admin] RBAC: Authorizing `identity:get_user(user_id=5ab0ad8318854715989ba962ebb9a4a3)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:45.183813 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0f0326-75de-4178-87ea-aa0d2ee043de None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:45.190018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 143/285] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:44 2022] GET /identity/v3/users/5ab0ad8318854715989ba962ebb9a4a3 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:45.190018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f0326-75de-4178-87ea-aa0d2ee043de None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:45.268457 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b654e9a4-e328-41f9-9157-4cd853a9dfd7 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:45.314003 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f0326-75de-4178-87ea-aa0d2ee043de None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:45.314545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9fee8-8e31-4240-bbb4-afb64ddc2698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:45.315305 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9fee8-8e31-4240-bbb4-afb64ddc2698 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:45.315714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9fee8-8e31-4240-bbb4-afb64ddc2698 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:45.316386 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9fee8-8e31-4240-bbb4-afb64ddc2698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:45.318259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9fee8-8e31-4240-bbb4-afb64ddc2698 None admin] RBAC: Adding query filter params (role.id=5c4481f023774d67997d4ba28e07cff0, user.id=1d8cdd1fd7914ea6b4149a7d8cd882c6, scope.system=all) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:45.318682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9fee8-8e31-4240-bbb4-afb64ddc2698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:45.320333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9fee8-8e31-4240-bbb4-afb64ddc2698 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:45.328145 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 143/286] 10.222.0.36 () {56 vars in 1308 bytes} [Mon Jun 27 18:32:45 2022] GET /identity/v3/role_assignments?user.id=1d8cdd1fd7914ea6b4149a7d8cd882c6&scope.system=all&role.id=5c4481f023774d67997d4ba28e07cff0 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:45.329194 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9fee8-8e31-4240-bbb4-afb64ddc2698 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:45.352829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:45.373528 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:45.385964 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54019ba1-c635-4dd5-8809-e212aa7f6800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:45.386799 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54019ba1-c635-4dd5-8809-e212aa7f6800 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:45.387092 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54019ba1-c635-4dd5-8809-e212aa7f6800 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:45.387375 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54019ba1-c635-4dd5-8809-e212aa7f6800 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:45.403164 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54019ba1-c635-4dd5-8809-e212aa7f6800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:45.411035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-54019ba1-c635-4dd5-8809-e212aa7f6800 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:45.411035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:45.411035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:45.411035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:45.411035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:45.411035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:45.411035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:45.411035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:45.411035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:45.411035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:45.411035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:45.411035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:45.411035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:45.411035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:45.411035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:45.411035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:45.412091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:45.412091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:45.412091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:45.412091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:45.412091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:45.412091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:45.412091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:45.412091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:45.412091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:45.412091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:45.412091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:45.412091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:45.412091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:45.412091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:45.412091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:45.412091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:45.412890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:45.412890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:45.412890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:45.412890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:45.412890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:45.412890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:45.412890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:45.412890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:45.412890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:45.412890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:45.412890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:45.412890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:45.412890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 144/287] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:45.420148 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54019ba1-c635-4dd5-8809-e212aa7f6800 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:45.505095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9fee8-8e31-4240-bbb4-afb64ddc2698 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:45.573458 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690da43-8108-4463-81c1-369373c15b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:45.574387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690da43-8108-4463-81c1-369373c15b23 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:45.574679 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690da43-8108-4463-81c1-369373c15b23 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:45.574958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690da43-8108-4463-81c1-369373c15b23 None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:45.576420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690da43-8108-4463-81c1-369373c15b23 None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:45.577883 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690da43-8108-4463-81c1-369373c15b23 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:45.579779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 144/288] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:45 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:45.586219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690da43-8108-4463-81c1-369373c15b23 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:45.614535 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54019ba1-c635-4dd5-8809-e212aa7f6800 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:45.685932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3e774-e689-4239-917e-5a195e56901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:45.686614 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3e774-e689-4239-917e-5a195e56901c None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:45.686905 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3e774-e689-4239-917e-5a195e56901c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:45.687188 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3e774-e689-4239-917e-5a195e56901c None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:45.687981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3e774-e689-4239-917e-5a195e56901c None admin] RBAC: Adding query filter params (name=member) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:45.688300 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3e774-e689-4239-917e-5a195e56901c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:45.689706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3e774-e689-4239-917e-5a195e56901c None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:45.702617 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 145/289] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:45.709950 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3e774-e689-4239-917e-5a195e56901c None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:45.772035 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:45.792443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:45.806323 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690da43-8108-4463-81c1-369373c15b23 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:45.837044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3e774-e689-4239-917e-5a195e56901c None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:45.874262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c73d7-393a-4b2a-b882-dc7c096fcaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:45.875203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c73d7-393a-4b2a-b882-dc7c096fcaa8 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:45.875495 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c73d7-393a-4b2a-b882-dc7c096fcaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:45.875807 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c73d7-393a-4b2a-b882-dc7c096fcaa8 None admin] PATH_INFO: `/v3/users/858e97306c234649bd838005411bc7e7` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:45.877027 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c73d7-393a-4b2a-b882-dc7c096fcaa8 None admin] RBAC: Authorizing `identity:get_user(user_id=858e97306c234649bd838005411bc7e7)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:45.878485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c73d7-393a-4b2a-b882-dc7c096fcaa8 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:45.884689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 146/290] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:45 2022] GET /identity/v3/users/858e97306c234649bd838005411bc7e7 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:45.885958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c73d7-393a-4b2a-b882-dc7c096fcaa8 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:45.900246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d1a09-fde9-4753-8d09-eac7a43e3b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:45.901186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d1a09-fde9-4753-8d09-eac7a43e3b08 None admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:45.901468 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d1a09-fde9-4753-8d09-eac7a43e3b08 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:45.901740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d1a09-fde9-4753-8d09-eac7a43e3b08 None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71/users/5ab0ad8318854715989ba962ebb9a4a3/roles/c022b2199d7449faa0831ed802c403d3` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:45.903799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d1a09-fde9-4753-8d09-eac7a43e3b08 None admin] RBAC: Authorizing `identity:create_grant(project_id=36535f8090e64641b80e339c1590bf71, user_id=5ab0ad8318854715989ba962ebb9a4a3, role_id=c022b2199d7449faa0831ed802c403d3)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:45.905252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d1a09-fde9-4753-8d09-eac7a43e3b08 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:45.986675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 145/291] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:32:45 2022] PUT /identity/v3/projects/36535f8090e64641b80e339c1590bf71/users/5ab0ad8318854715989ba962ebb9a4a3/roles/c022b2199d7449faa0831ed802c403d3 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:32:46.018309 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c73d7-393a-4b2a-b882-dc7c096fcaa8 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:46.037032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:46.064238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2034e4-0704-4602-bde2-556f2d181ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:46.065105 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2034e4-0704-4602-bde2-556f2d181ec1 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:46.065395 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2034e4-0704-4602-bde2-556f2d181ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:46.065672 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2034e4-0704-4602-bde2-556f2d181ec1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:46.158205 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2034e4-0704-4602-bde2-556f2d181ec1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:46.160062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2034e4-0704-4602-bde2-556f2d181ec1 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:46.267126 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 147/292] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 18:32:46.272584 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d1a09-fde9-4753-8d09-eac7a43e3b08 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:46.381595 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d1a09-fde9-4753-8d09-eac7a43e3b08 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:46.423693 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308448eb-9115-40ce-8100-d1cdeaf0f5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:46.424970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308448eb-9115-40ce-8100-d1cdeaf0f5ce None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:46.425456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308448eb-9115-40ce-8100-d1cdeaf0f5ce None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:46.425931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308448eb-9115-40ce-8100-d1cdeaf0f5ce None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:46.427317 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308448eb-9115-40ce-8100-d1cdeaf0f5ce None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:46.429004 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308448eb-9115-40ce-8100-d1cdeaf0f5ce None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:46.430927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 146/293] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:46 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:46.437007 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2034e4-0704-4602-bde2-556f2d181ec1 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:46.458051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:46.578227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2034e4-0704-4602-bde2-556f2d181ec1 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:46.632350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b1d31-d772-4c8a-9f01-6f0ddf38a6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:46.632922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b1d31-d772-4c8a-9f01-6f0ddf38a6e9 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:46.633212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b1d31-d772-4c8a-9f01-6f0ddf38a6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:46.633491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b1d31-d772-4c8a-9f01-6f0ddf38a6e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:46.634339 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b1d31-d772-4c8a-9f01-6f0ddf38a6e9 None admin] RBAC: Adding query filter params (role.id=5c4481f023774d67997d4ba28e07cff0, scope.project.id=36535f8090e64641b80e339c1590bf71, user.id=858e97306c234649bd838005411bc7e7) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:46.634658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b1d31-d772-4c8a-9f01-6f0ddf38a6e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:46.636294 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9b1d31-d772-4c8a-9f01-6f0ddf38a6e9 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:46.642798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 148/294] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:46 2022] GET /identity/v3/role_assignments?user.id=858e97306c234649bd838005411bc7e7&scope.project.id=36535f8090e64641b80e339c1590bf71&role.id=5c4481f023774d67997d4ba28e07cff0 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:47.145674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f7265-a8a1-4815-9109-2c7104995294 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:47.146070 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f7265-a8a1-4815-9109-2c7104995294 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:47.146246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f7265-a8a1-4815-9109-2c7104995294 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:47.147796 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 147/295] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:47.153864 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc1b22-6d0f-43c3-bac6-ad6981a51d71 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:47.154306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc1b22-6d0f-43c3-bac6-ad6981a51d71 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:47.154474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc1b22-6d0f-43c3-bac6-ad6981a51d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:47.176589 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-d9bc1b22-6d0f-43c3-bac6-ad6981a51d71 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:47.178147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d9bc1b22-6d0f-43c3-bac6-ad6981a51d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:47.267632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 149/296] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:47.287919 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f7265-a8a1-4815-9109-2c7104995294 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:47.307377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:47.402036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f7265-a8a1-4815-9109-2c7104995294 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:47.438214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d3808-3a99-4849-9b10-9d0e0189964b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:47.439383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d3808-3a99-4849-9b10-9d0e0189964b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:47.439917 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d3808-3a99-4849-9b10-9d0e0189964b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:47.440399 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d3808-3a99-4849-9b10-9d0e0189964b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:47.452364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d3808-3a99-4849-9b10-9d0e0189964b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:47.460913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-9a1d3808-3a99-4849-9b10-9d0e0189964b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:47.460913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:47.460913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:47.460913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:47.460913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:47.460913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:47.460913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:47.460913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:47.460913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:47.460913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:47.460913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:47.460913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:47.460913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:47.460913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:47.460913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:47.460913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:47.461886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:47.461886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:47.461886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:47.461886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:47.461886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:47.461886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:47.461886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:47.461886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:47.461886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:47.461886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:47.461886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:47.461886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:47.461886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:47.461886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:47.461886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:47.461886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:47.462706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:47.462706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:47.462706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:47.462706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:47.462706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:47.462706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:47.462706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:47.462706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:47.462706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:47.462706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:47.462706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:47.462706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:47.470566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 148/297] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:47.472261 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc1b22-6d0f-43c3-bac6-ad6981a51d71 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:47.484588 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:47.534103 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079929e-910b-4bae-b47c-055323bd2a80 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:47.534652 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079929e-910b-4bae-b47c-055323bd2a80 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:47.535134 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079929e-910b-4bae-b47c-055323bd2a80 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:47.536961 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 149/298] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:47.542096 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c387c77-4296-44c7-a3e6-3526b79d941f None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:47.542544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c387c77-4296-44c7-a3e6-3526b79d941f None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:47.542993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c387c77-4296-44c7-a3e6-3526b79d941f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:47.561978 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-2c387c77-4296-44c7-a3e6-3526b79d941f None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:47.563178 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2c387c77-4296-44c7-a3e6-3526b79d941f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:47.583167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc1b22-6d0f-43c3-bac6-ad6981a51d71 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:47.619317 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27489913-a056-47d9-b7eb-d0ba7f57b597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:47.620945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27489913-a056-47d9-b7eb-d0ba7f57b597 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:47.621304 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27489913-a056-47d9-b7eb-d0ba7f57b597 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:47.621543 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27489913-a056-47d9-b7eb-d0ba7f57b597 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:47.622259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27489913-a056-47d9-b7eb-d0ba7f57b597 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:47.622619 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27489913-a056-47d9-b7eb-d0ba7f57b597 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:47.623987 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27489913-a056-47d9-b7eb-d0ba7f57b597 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:47.632497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 150/299] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:47.633705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fddf8-88d8-4a05-aa60-279dff7a0ff5 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:47.634002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fddf8-88d8-4a05-aa60-279dff7a0ff5 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:47.634282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213fddf8-88d8-4a05-aa60-279dff7a0ff5 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:47.636252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 151/300] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:47.638661 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 150/301] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:47.640802 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fddf8-88d8-4a05-aa60-279dff7a0ff5 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:47.645107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5033fa6-bc8c-4b3f-8640-d9e52f4a685e None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:47.645619 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5033fa6-bc8c-4b3f-8640-d9e52f4a685e None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:47.646159 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5033fa6-bc8c-4b3f-8640-d9e52f4a685e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:47.651703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:47.665311 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-a5033fa6-bc8c-4b3f-8640-d9e52f4a685e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:47.666095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a5033fa6-bc8c-4b3f-8640-d9e52f4a685e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:47.725257 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:47.734196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 151/302] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:47.735823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5033fa6-bc8c-4b3f-8640-d9e52f4a685e None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:47.763067 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213fddf8-88d8-4a05-aa60-279dff7a0ff5 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:47.797277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda2261-b164-479c-83a5-d90647e2a293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:47.798149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2261-b164-479c-83a5-d90647e2a293 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:47.798436 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2261-b164-479c-83a5-d90647e2a293 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:47.798716 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda2261-b164-479c-83a5-d90647e2a293 None admin] PATH_INFO: `/v3/users/3e335ba9170548eb91d13781a88afa54` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:47.813641 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda2261-b164-479c-83a5-d90647e2a293 None admin] RBAC: Authorizing `identity:get_user(user_id=3e335ba9170548eb91d13781a88afa54)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:47.815122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda2261-b164-479c-83a5-d90647e2a293 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:47.821382 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 152/303] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:47 2022] GET /identity/v3/users/3e335ba9170548eb91d13781a88afa54 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:47.821382 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda2261-b164-479c-83a5-d90647e2a293 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:47.858164 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5033fa6-bc8c-4b3f-8640-d9e52f4a685e None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:47.889824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:47.894710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c6404-9004-4968-9f1f-b771cee3c537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:47.895571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c6404-9004-4968-9f1f-b771cee3c537 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:47.895862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c6404-9004-4968-9f1f-b771cee3c537 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:47.896291 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c6404-9004-4968-9f1f-b771cee3c537 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:47.907478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c6404-9004-4968-9f1f-b771cee3c537 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:47.916027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-ce9c6404-9004-4968-9f1f-b771cee3c537 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:47.916027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:47.916027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:47.916027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:47.916027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:47.916027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:47.916027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:47.916027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:47.916027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:47.916027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:47.916027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:47.916027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:47.916027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:47.916027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:47.916027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:47.916027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:47.916935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:47.916935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:47.916935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:47.916935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:47.916935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:47.916935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:47.916935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:47.916935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:47.916935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:47.916935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:47.916935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:47.916935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:47.916935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:47.916935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:47.916935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:47.916935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:47.917715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:47.917715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:47.917715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:47.917715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:47.917715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:47.917715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:47.917715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:47.917715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:47.917715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:47.917715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:47.917715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:47.917715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:47.917715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 152/304] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:47.918365 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c6404-9004-4968-9f1f-b771cee3c537 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:47.923650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda2261-b164-479c-83a5-d90647e2a293 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:47.954840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:47.962197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377bbfd-9e97-4a9d-9b83-309bea545f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:47.962996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377bbfd-9e97-4a9d-9b83-309bea545f45 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:47.967006 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377bbfd-9e97-4a9d-9b83-309bea545f45 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:47.967006 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377bbfd-9e97-4a9d-9b83-309bea545f45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:47.967006 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377bbfd-9e97-4a9d-9b83-309bea545f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:47.968347 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377bbfd-9e97-4a9d-9b83-309bea545f45 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:47.970168 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 153/305] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:32:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:47.972400 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377bbfd-9e97-4a9d-9b83-309bea545f45 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:48.028611 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c6404-9004-4968-9f1f-b771cee3c537 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:48.063414 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eae931-5a1f-42f1-8892-da10d2bbc4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:48.064083 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eae931-5a1f-42f1-8892-da10d2bbc4c6 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:48.064369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eae931-5a1f-42f1-8892-da10d2bbc4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:48.064700 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eae931-5a1f-42f1-8892-da10d2bbc4c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:48.065524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eae931-5a1f-42f1-8892-da10d2bbc4c6 None admin] RBAC: Adding query filter params (role.id=c022b2199d7449faa0831ed802c403d3, user.id=3e335ba9170548eb91d13781a88afa54, scope.system=all) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:48.065886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eae931-5a1f-42f1-8892-da10d2bbc4c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:48.067399 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eae931-5a1f-42f1-8892-da10d2bbc4c6 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:48.073080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 153/306] 10.222.0.36 () {56 vars in 1308 bytes} [Mon Jun 27 18:32:47 2022] GET /identity/v3/role_assignments?user.id=3e335ba9170548eb91d13781a88afa54&scope.system=all&role.id=c022b2199d7449faa0831ed802c403d3 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:48.073698 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eae931-5a1f-42f1-8892-da10d2bbc4c6 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:48.083051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377bbfd-9e97-4a9d-9b83-309bea545f45 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:48.124763 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f76192-f3fd-4390-b32e-e7453935b7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:48.125450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f76192-f3fd-4390-b32e-e7453935b7d9 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:48.125741 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f76192-f3fd-4390-b32e-e7453935b7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:48.126018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f76192-f3fd-4390-b32e-e7453935b7d9 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:48.126797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f76192-f3fd-4390-b32e-e7453935b7d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:48.127108 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f76192-f3fd-4390-b32e-e7453935b7d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:48.128787 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f76192-f3fd-4390-b32e-e7453935b7d9 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:48.138437 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 154/307] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:48.144330 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f76192-f3fd-4390-b32e-e7453935b7d9 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:48.200837 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:48.218239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:48.239787 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eae931-5a1f-42f1-8892-da10d2bbc4c6 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:48.269576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f76192-f3fd-4390-b32e-e7453935b7d9 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:48.277754 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e7077-01b8-49a5-9045-059939904afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:48.278438 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e7077-01b8-49a5-9045-059939904afc None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:48.278725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e7077-01b8-49a5-9045-059939904afc None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:48.279003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e7077-01b8-49a5-9045-059939904afc None admin] PATH_INFO: `/v3/groups` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:48.279727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e7077-01b8-49a5-9045-059939904afc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:48.281363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e7077-01b8-49a5-9045-059939904afc None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:48.309313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316ca61-7813-450b-af6f-aff3e69191d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:48.310534 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316ca61-7813-450b-af6f-aff3e69191d7 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:48.311063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316ca61-7813-450b-af6f-aff3e69191d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:48.311562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316ca61-7813-450b-af6f-aff3e69191d7 None admin] PATH_INFO: `/v3/users/1d8cdd1fd7914ea6b4149a7d8cd882c6` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:48.313044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316ca61-7813-450b-af6f-aff3e69191d7 None admin] RBAC: Authorizing `identity:get_user(user_id=1d8cdd1fd7914ea6b4149a7d8cd882c6)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:48.314753 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316ca61-7813-450b-af6f-aff3e69191d7 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:48.321395 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 155/308] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:48 2022] GET /identity/v3/users/1d8cdd1fd7914ea6b4149a7d8cd882c6 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:48.322354 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316ca61-7813-450b-af6f-aff3e69191d7 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:48.354617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 154/309] 10.222.0.36 () {60 vars in 1134 bytes} [Mon Jun 27 18:32:48 2022] POST /identity/v3/groups => generated 229 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:32:48.424648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbe0ff-0f22-4ed5-a22c-29f1bcbd006e None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:48.425352 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbe0ff-0f22-4ed5-a22c-29f1bcbd006e None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:48.425831 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbe0ff-0f22-4ed5-a22c-29f1bcbd006e None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:48.427446 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 155/310] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:48.433609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51c46f-1310-428c-b7a7-200d0556e13e None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:48.434439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51c46f-1310-428c-b7a7-200d0556e13e None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:48.435436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51c46f-1310-428c-b7a7-200d0556e13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:48.441832 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316ca61-7813-450b-af6f-aff3e69191d7 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:48.458443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-4b51c46f-1310-428c-b7a7-200d0556e13e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:48.460944 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-4b51c46f-1310-428c-b7a7-200d0556e13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:48.475567 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:48.486618 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284311b-4cb2-4246-8102-a1c8ca4aa00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:48.491770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284311b-4cb2-4246-8102-a1c8ca4aa00b None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:48.491770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284311b-4cb2-4246-8102-a1c8ca4aa00b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:48.491770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284311b-4cb2-4246-8102-a1c8ca4aa00b None admin] PATH_INFO: `/v3/system/users/1d8cdd1fd7914ea6b4149a7d8cd882c6/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:48.491770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284311b-4cb2-4246-8102-a1c8ca4aa00b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1d8cdd1fd7914ea6b4149a7d8cd882c6, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:48.491770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284311b-4cb2-4246-8102-a1c8ca4aa00b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:48.551118 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 156/311] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:48.573999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51c46f-1310-428c-b7a7-200d0556e13e None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:48.591626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 156/312] 10.222.0.36 () {58 vars in 1334 bytes} [Mon Jun 27 18:32:48 2022] PUT /identity/v3/system/users/1d8cdd1fd7914ea6b4149a7d8cd882c6/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:32:48.626713 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:48.695323 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51c46f-1310-428c-b7a7-200d0556e13e None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:48.735415 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8be57c-6a1e-4822-a4e5-b89557dd99d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:48.736175 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8be57c-6a1e-4822-a4e5-b89557dd99d6 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:48.736455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8be57c-6a1e-4822-a4e5-b89557dd99d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:48.736730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8be57c-6a1e-4822-a4e5-b89557dd99d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:48.748282 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8be57c-6a1e-4822-a4e5-b89557dd99d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:48.756228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-4f8be57c-6a1e-4822-a4e5-b89557dd99d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:48.756228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:48.756228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:48.756228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:48.756228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:48.756228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:48.756228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:48.756228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:48.756228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:48.756228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:48.756228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:48.756228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:48.756228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:48.756228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:48.756228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:48.756228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:48.757124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:48.757124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:48.757124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:48.757124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:48.757124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:48.757124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:48.757124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:48.757124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:48.757124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:48.757124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:48.757124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:48.757124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:48.757124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:48.757124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:48.757124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:48.757124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:48.757911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:48.757911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:48.757911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:48.757911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:48.757911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:48.757911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:48.757911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:48.757911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:48.757911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:48.757911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:48.757911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:48.757911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:48.757911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 157/313] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:32:48.765242 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284311b-4cb2-4246-8102-a1c8ca4aa00b None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:48.871910 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284311b-4cb2-4246-8102-a1c8ca4aa00b None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:48.913606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be6049-5755-4bc6-833a-4902e7d7c988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:48.914559 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be6049-5755-4bc6-833a-4902e7d7c988 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:48.914984 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be6049-5755-4bc6-833a-4902e7d7c988 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:48.915432 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be6049-5755-4bc6-833a-4902e7d7c988 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:48.916398 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be6049-5755-4bc6-833a-4902e7d7c988 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:48.916848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be6049-5755-4bc6-833a-4902e7d7c988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:48.918353 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be6049-5755-4bc6-833a-4902e7d7c988 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:48.927059 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 157/314] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:48.932637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8be57c-6a1e-4822-a4e5-b89557dd99d6 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:49.042213 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8be57c-6a1e-4822-a4e5-b89557dd99d6 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:49.049702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:49.078551 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b38209-e31d-4aa2-9e48-2a932539fca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:49.079738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b38209-e31d-4aa2-9e48-2a932539fca6 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:49.080187 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b38209-e31d-4aa2-9e48-2a932539fca6 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:49.080604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b38209-e31d-4aa2-9e48-2a932539fca6 None admin] PATH_INFO: `/v3/users/5ab0ad8318854715989ba962ebb9a4a3` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:49.081996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b38209-e31d-4aa2-9e48-2a932539fca6 None admin] RBAC: Authorizing `identity:get_user(user_id=5ab0ad8318854715989ba962ebb9a4a3)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:49.083620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b38209-e31d-4aa2-9e48-2a932539fca6 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:49.085815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 158/315] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:48 2022] GET /identity/v3/users/5ab0ad8318854715989ba962ebb9a4a3 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:49.092909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be6049-5755-4bc6-833a-4902e7d7c988 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:49.152906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:49.199272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be6049-5755-4bc6-833a-4902e7d7c988 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:49.236036 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fe02f-b8ce-4e04-b3d7-5ed1a1d1f1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:49.236684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fe02f-b8ce-4e04-b3d7-5ed1a1d1f1fa None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:49.236959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fe02f-b8ce-4e04-b3d7-5ed1a1d1f1fa None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:49.237237 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fe02f-b8ce-4e04-b3d7-5ed1a1d1f1fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:49.308135 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fe02f-b8ce-4e04-b3d7-5ed1a1d1f1fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:49.309548 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71fe02f-b8ce-4e04-b3d7-5ed1a1d1f1fa None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:49.367925 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:49.412785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 158/316] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:49.418735 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b38209-e31d-4aa2-9e48-2a932539fca6 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:49.523868 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b38209-e31d-4aa2-9e48-2a932539fca6 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:49.562815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a769e968-bffa-475a-b19e-fd4045d17c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:49.564060 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769e968-bffa-475a-b19e-fd4045d17c87 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:49.564565 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769e968-bffa-475a-b19e-fd4045d17c87 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:49.565033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769e968-bffa-475a-b19e-fd4045d17c87 None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:49.566404 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769e968-bffa-475a-b19e-fd4045d17c87 None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:49.568077 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a769e968-bffa-475a-b19e-fd4045d17c87 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:49.569973 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 159/317] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:49 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:49.575920 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fe02f-b8ce-4e04-b3d7-5ed1a1d1f1fa None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:49.680481 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71fe02f-b8ce-4e04-b3d7-5ed1a1d1f1fa None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:49.716418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c41462e-19c3-4127-8ba9-221099f1d6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:49.717075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41462e-19c3-4127-8ba9-221099f1d6b7 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:49.717363 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41462e-19c3-4127-8ba9-221099f1d6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:49.717640 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c41462e-19c3-4127-8ba9-221099f1d6b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:49.718472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41462e-19c3-4127-8ba9-221099f1d6b7 None admin] RBAC: Adding query filter params (role.id=c022b2199d7449faa0831ed802c403d3, scope.project.id=36535f8090e64641b80e339c1590bf71, user.id=5ab0ad8318854715989ba962ebb9a4a3) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:49.718788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41462e-19c3-4127-8ba9-221099f1d6b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:49.720257 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c41462e-19c3-4127-8ba9-221099f1d6b7 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:49.726772 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 159/318] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:32:49 2022] GET /identity/v3/role_assignments?user.id=5ab0ad8318854715989ba962ebb9a4a3&scope.project.id=36535f8090e64641b80e339c1590bf71&role.id=c022b2199d7449faa0831ed802c403d3 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:50.176116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0979a0a-76e3-4865-8673-3680aa6ddb25 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:50.176491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0979a0a-76e3-4865-8673-3680aa6ddb25 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:50.176680 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0979a0a-76e3-4865-8673-3680aa6ddb25 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:50.178199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 160/319] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:50.183845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd5929-b4bd-4006-82eb-211f4759ef8e None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:50.184142 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd5929-b4bd-4006-82eb-211f4759ef8e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:50.184424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd5929-b4bd-4006-82eb-211f4759ef8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:50.201119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-cfdd5929-b4bd-4006-82eb-211f4759ef8e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:50.202313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-cfdd5929-b4bd-4006-82eb-211f4759ef8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:50.216113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:50.270028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 160/320] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:50.293321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0979a0a-76e3-4865-8673-3680aa6ddb25 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:50.342038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:50.404253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0979a0a-76e3-4865-8673-3680aa6ddb25 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:50.438643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6104d28-cd85-4d14-af50-3f31f7a9b558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:50.439370 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6104d28-cd85-4d14-af50-3f31f7a9b558 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:50.439680 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6104d28-cd85-4d14-af50-3f31f7a9b558 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:50.439957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6104d28-cd85-4d14-af50-3f31f7a9b558 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:50.450372 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6104d28-cd85-4d14-af50-3f31f7a9b558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:50.458445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-a6104d28-cd85-4d14-af50-3f31f7a9b558 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:50.458445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:50.458445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:50.458445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:50.458445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:50.458445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:50.458445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:50.458445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:50.458445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:50.458445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:50.458445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:50.458445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:50.458445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:50.458445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:50.458445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:50.458445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:50.459322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:50.459322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:50.459322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:50.459322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:50.459322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:50.459322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:50.459322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:50.459322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:50.459322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:50.459322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:50.459322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:50.459322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:50.459322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:50.459322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:50.459322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:50.459322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:50.460803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:50.460803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:50.460803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:50.460803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:50.460803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:50.460803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:50.460803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:50.460803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:50.460803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:50.460803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:50.460803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:50.460803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:50.460803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 161/321] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:50.465529 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd5929-b4bd-4006-82eb-211f4759ef8e None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:50.490160 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1509024-340c-4d97-b3e2-05c2a8f52d50 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:50.490464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1509024-340c-4d97-b3e2-05c2a8f52d50 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:50.490729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1509024-340c-4d97-b3e2-05c2a8f52d50 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:50.492912 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 162/322] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:32:50.499079 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc75bc-f31e-489e-bed7-99c915a579f1 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:50.499652 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc75bc-f31e-489e-bed7-99c915a579f1 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:50.499940 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc75bc-f31e-489e-bed7-99c915a579f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:50.519160 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-a9bc75bc-f31e-489e-bed7-99c915a579f1 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:50.520378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a9bc75bc-f31e-489e-bed7-99c915a579f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:50.568790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd5929-b4bd-4006-82eb-211f4759ef8e None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:50.597923 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 163/323] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:50.608557 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d154a-fd9c-41da-abf2-cece42a63a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:50.609307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d154a-fd9c-41da-abf2-cece42a63a89 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:50.609665 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d154a-fd9c-41da-abf2-cece42a63a89 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:50.610016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d154a-fd9c-41da-abf2-cece42a63a89 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:50.610842 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d154a-fd9c-41da-abf2-cece42a63a89 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:50.611242 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d154a-fd9c-41da-abf2-cece42a63a89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:50.612740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95d154a-fd9c-41da-abf2-cece42a63a89 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:50.621032 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc75bc-f31e-489e-bed7-99c915a579f1 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:50.623584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 161/324] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:50.626872 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d154a-fd9c-41da-abf2-cece42a63a89 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:50.640031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:50.651853 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:50.729645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d154a-fd9c-41da-abf2-cece42a63a89 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:50.730831 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc75bc-f31e-489e-bed7-99c915a579f1 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:50.765704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983513ed-c9f9-4abe-a9c3-c0f54a83ec40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:50.766222 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cee8e-28cc-46f1-8d75-7bf2413e85cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:50.766620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983513ed-c9f9-4abe-a9c3-c0f54a83ec40 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:50.766867 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cee8e-28cc-46f1-8d75-7bf2413e85cf None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:50.766964 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983513ed-c9f9-4abe-a9c3-c0f54a83ec40 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:50.767144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983513ed-c9f9-4abe-a9c3-c0f54a83ec40 None admin] PATH_INFO: `/v3/users/3e335ba9170548eb91d13781a88afa54` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:50.767236 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cee8e-28cc-46f1-8d75-7bf2413e85cf None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:50.767417 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cee8e-28cc-46f1-8d75-7bf2413e85cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:50.768390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983513ed-c9f9-4abe-a9c3-c0f54a83ec40 None admin] RBAC: Authorizing `identity:get_user(user_id=3e335ba9170548eb91d13781a88afa54)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:50.768644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cee8e-28cc-46f1-8d75-7bf2413e85cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:50.769856 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983513ed-c9f9-4abe-a9c3-c0f54a83ec40 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:50.770096 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cee8e-28cc-46f1-8d75-7bf2413e85cf None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:50.771706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 162/325] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:50 2022] GET /identity/v3/users/3e335ba9170548eb91d13781a88afa54 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:50.776710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 164/326] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:32:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:50.777528 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983513ed-c9f9-4abe-a9c3-c0f54a83ec40 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:50.781655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cee8e-28cc-46f1-8d75-7bf2413e85cf None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:50.858379 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:50.878913 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983513ed-c9f9-4abe-a9c3-c0f54a83ec40 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:50.879052 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:50.881819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cee8e-28cc-46f1-8d75-7bf2413e85cf None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:50.912560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d2fd0-772d-49e3-8f9b-279193c9437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:50.913412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d2fd0-772d-49e3-8f9b-279193c9437b None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:50.913704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d2fd0-772d-49e3-8f9b-279193c9437b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:50.913978 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d2fd0-772d-49e3-8f9b-279193c9437b None admin] PATH_INFO: `/v3/system/users/3e335ba9170548eb91d13781a88afa54/roles/c022b2199d7449faa0831ed802c403d3` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:50.915131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853081fa-d8d8-476e-b15f-c0ff413229d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:50.915523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d2fd0-772d-49e3-8f9b-279193c9437b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3e335ba9170548eb91d13781a88afa54, role_id=c022b2199d7449faa0831ed802c403d3)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:50.916240 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853081fa-d8d8-476e-b15f-c0ff413229d9 None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:50.916720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853081fa-d8d8-476e-b15f-c0ff413229d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:50.916876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d2fd0-772d-49e3-8f9b-279193c9437b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:50.917441 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853081fa-d8d8-476e-b15f-c0ff413229d9 None admin] PATH_INFO: `/v3/groups` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:50.918131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853081fa-d8d8-476e-b15f-c0ff413229d9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:50.919579 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853081fa-d8d8-476e-b15f-c0ff413229d9 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:50.978841 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 163/327] 10.222.0.36 () {58 vars in 1334 bytes} [Mon Jun 27 18:32:50 2022] PUT /identity/v3/system/users/3e335ba9170548eb91d13781a88afa54/roles/c022b2199d7449faa0831ed802c403d3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:32:50.982485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d10de-224d-46c8-9f52-f5fca3d03acc None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:50.982485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d10de-224d-46c8-9f52-f5fca3d03acc None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:50.982485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d10de-224d-46c8-9f52-f5fca3d03acc None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:50.982485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 164/328] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:50.988081 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52226ffc-6b06-4f83-82ae-fcb3a34ea99c None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:50.988372 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52226ffc-6b06-4f83-82ae-fcb3a34ea99c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:50.988658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52226ffc-6b06-4f83-82ae-fcb3a34ea99c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:51.006397 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-52226ffc-6b06-4f83-82ae-fcb3a34ea99c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:51.007629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-52226ffc-6b06-4f83-82ae-fcb3a34ea99c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:51.015168 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 165/329] 10.222.0.36 () {60 vars in 1134 bytes} [Mon Jun 27 18:32:50 2022] POST /identity/v3/groups => generated 226 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:32:51.100256 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 165/330] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:51.124172 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853081fa-d8d8-476e-b15f-c0ff413229d9 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:51.234438 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853081fa-d8d8-476e-b15f-c0ff413229d9 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:51.269529 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735ed8f-74b5-4e0b-9dbe-2d6b98e561a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:51.270331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735ed8f-74b5-4e0b-9dbe-2d6b98e561a4 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:51.270617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735ed8f-74b5-4e0b-9dbe-2d6b98e561a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:51.270893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735ed8f-74b5-4e0b-9dbe-2d6b98e561a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:51.283202 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735ed8f-74b5-4e0b-9dbe-2d6b98e561a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:51.291243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-7735ed8f-74b5-4e0b-9dbe-2d6b98e561a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:51.291243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:51.291243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:51.291243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:51.291243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:51.291243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:51.291243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:51.291243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:51.291243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:51.291243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:51.291243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:51.291243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:51.291243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:51.291243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:51.291243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:51.291243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:51.292632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:51.292632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:51.292632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:51.292632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:51.292632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:51.292632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:51.292632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:51.292632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:51.292632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:51.292632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:51.292632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:51.292632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:51.292632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:51.292632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:51.292632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:51.292632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:51.293433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:51.293433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:51.293433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:51.293433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:51.293433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:51.293433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:51.293433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:51.293433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:51.293433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:51.293433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:51.293433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:51.293433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:51.293433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 166/331] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:51.299905 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52226ffc-6b06-4f83-82ae-fcb3a34ea99c None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:51.377662 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:51.409660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52226ffc-6b06-4f83-82ae-fcb3a34ea99c None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:51.448641 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f502157-a81a-4e2f-958f-ef28ecb34567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:51.449316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f502157-a81a-4e2f-958f-ef28ecb34567 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:51.449603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f502157-a81a-4e2f-958f-ef28ecb34567 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:51.449960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f502157-a81a-4e2f-958f-ef28ecb34567 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:51.450724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f502157-a81a-4e2f-958f-ef28ecb34567 None admin] RBAC: Adding query filter params (name=member) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:51.451033 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f502157-a81a-4e2f-958f-ef28ecb34567 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:51.452474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f502157-a81a-4e2f-958f-ef28ecb34567 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:51.462865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 166/332] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:51.470144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735ed8f-74b5-4e0b-9dbe-2d6b98e561a4 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:51.500675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:51.591900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735ed8f-74b5-4e0b-9dbe-2d6b98e561a4 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:51.627184 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d679c-793c-49e2-b34d-6cc61861ae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:51.628095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d679c-793c-49e2-b34d-6cc61861ae03 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:51.628377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d679c-793c-49e2-b34d-6cc61861ae03 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:51.628654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d679c-793c-49e2-b34d-6cc61861ae03 None admin] PATH_INFO: `/v3/users/1d8cdd1fd7914ea6b4149a7d8cd882c6` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:51.629878 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d679c-793c-49e2-b34d-6cc61861ae03 None admin] RBAC: Authorizing `identity:get_user(user_id=1d8cdd1fd7914ea6b4149a7d8cd882c6)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:51.631337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7d679c-793c-49e2-b34d-6cc61861ae03 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:51.638304 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 167/333] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:51 2022] GET /identity/v3/users/1d8cdd1fd7914ea6b4149a7d8cd882c6 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:51.639683 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f502157-a81a-4e2f-958f-ef28ecb34567 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:51.753282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f502157-a81a-4e2f-958f-ef28ecb34567 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:51.790561 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf25b9-65c9-41e2-beba-bd2f867fdad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:51.791305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf25b9-65c9-41e2-beba-bd2f867fdad0 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:51.791613 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf25b9-65c9-41e2-beba-bd2f867fdad0 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:51.791896 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf25b9-65c9-41e2-beba-bd2f867fdad0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:51.792733 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf25b9-65c9-41e2-beba-bd2f867fdad0 None admin] RBAC: Adding query filter params (role.id=5c4481f023774d67997d4ba28e07cff0, user.id=1d8cdd1fd7914ea6b4149a7d8cd882c6, scope.system=all) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:51.793046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf25b9-65c9-41e2-beba-bd2f867fdad0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:51.794488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edf25b9-65c9-41e2-beba-bd2f867fdad0 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:51.799870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:51.811780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 167/334] 10.222.0.36 () {56 vars in 1308 bytes} [Mon Jun 27 18:32:51 2022] GET /identity/v3/role_assignments?user.id=1d8cdd1fd7914ea6b4149a7d8cd882c6&scope.system=all&role.id=5c4481f023774d67997d4ba28e07cff0 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:53.156407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab0c2d-94ad-43ca-9e4f-c51391ab2a04 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:53.156915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab0c2d-94ad-43ca-9e4f-c51391ab2a04 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:53.156991 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab0c2d-94ad-43ca-9e4f-c51391ab2a04 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:53.158546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 168/335] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:53.163948 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f013ea-495f-4b9e-a3c8-9327a1d84bad None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:53.164770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f013ea-495f-4b9e-a3c8-9327a1d84bad None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:53.165272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f013ea-495f-4b9e-a3c8-9327a1d84bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:53.187339 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-75f013ea-495f-4b9e-a3c8-9327a1d84bad None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:53.188914 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-75f013ea-495f-4b9e-a3c8-9327a1d84bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:53.265730 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 168/336] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:53.310240 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab0c2d-94ad-43ca-9e4f-c51391ab2a04 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:53.364748 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e076f2c-bd04-4a9d-87fd-a643010141d4 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:53.365405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e076f2c-bd04-4a9d-87fd-a643010141d4 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:53.365903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e076f2c-bd04-4a9d-87fd-a643010141d4 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:53.367489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 169/337] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:32:53.382513 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f947c-4bfb-42f0-bd9d-7043858e3ba8 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:53.383227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f947c-4bfb-42f0-bd9d-7043858e3ba8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:53.383777 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f947c-4bfb-42f0-bd9d-7043858e3ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:53.417243 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-3b6f947c-4bfb-42f0-bd9d-7043858e3ba8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:53.418891 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3b6f947c-4bfb-42f0-bd9d-7043858e3ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:53.437448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:53.459375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab0c2d-94ad-43ca-9e4f-c51391ab2a04 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:53.522568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a73db-c415-4491-baeb-eabd14e4d0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:53.523335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a73db-c415-4491-baeb-eabd14e4d0a8 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:53.523710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a73db-c415-4491-baeb-eabd14e4d0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:53.523984 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a73db-c415-4491-baeb-eabd14e4d0a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:53.543185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a73db-c415-4491-baeb-eabd14e4d0a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:53.549405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 170/338] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:32:53.555578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-190a73db-c415-4491-baeb-eabd14e4d0a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:53.555578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:53.555578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:53.555578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:53.555578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:53.555578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:53.555578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:53.555578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:53.555578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:53.555578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:53.555578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:53.555578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:53.555578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:53.555578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:53.555578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:53.555578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:53.556448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:53.556448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:53.556448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:53.556448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:53.556448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:53.556448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:53.556448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:53.556448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:53.556448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:53.556448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:53.556448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:53.556448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:53.556448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:53.556448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:53.556448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:53.556448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:53.557333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:53.557333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:53.557333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:53.557333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:53.557333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:53.557333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:53.557333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:53.557333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:53.557333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:53.557333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:53.557333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 27 18:32:53.557333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:53.557333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 169/339] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:53.559478 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f947c-4bfb-42f0-bd9d-7043858e3ba8 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:53.581715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a73db-c415-4491-baeb-eabd14e4d0a8 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:53.622663 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:53.675934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f947c-4bfb-42f0-bd9d-7043858e3ba8 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:53.741310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f059e8-5edb-4807-ac30-16ec1386fc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:53.741994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f059e8-5edb-4807-ac30-16ec1386fc43 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:53.742283 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f059e8-5edb-4807-ac30-16ec1386fc43 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:53.742565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f059e8-5edb-4807-ac30-16ec1386fc43 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:53.743328 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f059e8-5edb-4807-ac30-16ec1386fc43 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:53.743665 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f059e8-5edb-4807-ac30-16ec1386fc43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:53.745081 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f059e8-5edb-4807-ac30-16ec1386fc43 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:53.770973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 171/340] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:53.774130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a73db-c415-4491-baeb-eabd14e4d0a8 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:53.777016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f059e8-5edb-4807-ac30-16ec1386fc43 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:53.836282 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac404c-d1c7-4917-91d1-fa1960e34c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:53.837093 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac404c-d1c7-4917-91d1-fa1960e34c4d None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:53.837380 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac404c-d1c7-4917-91d1-fa1960e34c4d None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:53.837654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac404c-d1c7-4917-91d1-fa1960e34c4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:53.876204 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ac404c-d1c7-4917-91d1-fa1960e34c4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:53.886674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-a0ac404c-d1c7-4917-91d1-fa1960e34c4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:53.886674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:53.886674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:53.886674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:53.886674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:53.886674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:53.886674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:53.886674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:53.886674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:53.886674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:53.886674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:53.886674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:53.886674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:53.886674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:53.886674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:53.886674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:53.887608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:53.887608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:53.887608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:53.887608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:53.887608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:53.887608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:53.887608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:53.887608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:53.887608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:53.887608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:53.887608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:53.887608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:53.887608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:53.887608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:53.887608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:53.887608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:53.888398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:53.888398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:53.888398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:53.888398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:53.888398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:53.888398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:53.888398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:53.888398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:53.888398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:53.888398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:53.888398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:53.888398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:53.889525 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 170/341] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:53.894288 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac404c-d1c7-4917-91d1-fa1960e34c4d None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:53.924166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:54.017831 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f059e8-5edb-4807-ac30-16ec1386fc43 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:54.048938 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:54.101444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15dee7-062b-47aa-a6ea-ce91e656e421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:54.102332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15dee7-062b-47aa-a6ea-ce91e656e421 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:54.102618 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15dee7-062b-47aa-a6ea-ce91e656e421 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:54.102897 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c15dee7-062b-47aa-a6ea-ce91e656e421 None admin] PATH_INFO: `/v3/users/3e335ba9170548eb91d13781a88afa54` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:54.108314 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15dee7-062b-47aa-a6ea-ce91e656e421 None admin] RBAC: Authorizing `identity:get_user(user_id=3e335ba9170548eb91d13781a88afa54)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:54.109784 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c15dee7-062b-47aa-a6ea-ce91e656e421 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:54.111808 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 172/342] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:32:53 2022] GET /identity/v3/users/3e335ba9170548eb91d13781a88afa54 => generated 293 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:54.122806 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15dee7-062b-47aa-a6ea-ce91e656e421 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:54.130179 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac404c-d1c7-4917-91d1-fa1960e34c4d None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:54.208329 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3f640-f460-48bf-8201-d782daadf2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:54.209089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3f640-f460-48bf-8201-d782daadf2b2 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:54.209286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3f640-f460-48bf-8201-d782daadf2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:54.209566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3f640-f460-48bf-8201-d782daadf2b2 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:54.210328 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3f640-f460-48bf-8201-d782daadf2b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:54.210640 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3f640-f460-48bf-8201-d782daadf2b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:54.212081 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3f640-f460-48bf-8201-d782daadf2b2 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:54.237849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 171/343] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:54.242978 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3f640-f460-48bf-8201-d782daadf2b2 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:54.262735 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c15dee7-062b-47aa-a6ea-ce91e656e421 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:54.307099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48844707-9977-4659-a830-358ca9ed4998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:54.307633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844707-9977-4659-a830-358ca9ed4998 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:54.307923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844707-9977-4659-a830-358ca9ed4998 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:54.308201 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48844707-9977-4659-a830-358ca9ed4998 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:54.309742 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48844707-9977-4659-a830-358ca9ed4998 None admin] RBAC: Adding query filter params (role.id=c022b2199d7449faa0831ed802c403d3, user.id=3e335ba9170548eb91d13781a88afa54, scope.system=all) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:54.310064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48844707-9977-4659-a830-358ca9ed4998 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:54.312026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48844707-9977-4659-a830-358ca9ed4998 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:54.328812 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 173/344] 10.222.0.36 () {56 vars in 1308 bytes} [Mon Jun 27 18:32:54 2022] GET /identity/v3/role_assignments?user.id=3e335ba9170548eb91d13781a88afa54&scope.system=all&role.id=c022b2199d7449faa0831ed802c403d3 => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:54.330168 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbac49-ed5d-483a-bef2-e30ea4dd70b5 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:54.330461 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbac49-ed5d-483a-bef2-e30ea4dd70b5 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:54.330748 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bbac49-ed5d-483a-bef2-e30ea4dd70b5 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:54.332345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 174/345] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:54.333603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6f783-ec7b-41dd-ba01-a2995727e11e None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:54.333894 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6f783-ec7b-41dd-ba01-a2995727e11e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:54.334176 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6f783-ec7b-41dd-ba01-a2995727e11e None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:54.335585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 175/346] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:54.337999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92639cf9-2737-451a-b64b-531511cbc81b None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:54.338358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92639cf9-2737-451a-b64b-531511cbc81b None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:54.338716 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92639cf9-2737-451a-b64b-531511cbc81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:54.359071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-92639cf9-2737-451a-b64b-531511cbc81b None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:54.360679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-92639cf9-2737-451a-b64b-531511cbc81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:54.389683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:54.419927 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:54.447198 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 176/347] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:54.449012 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1ae79-ef73-4359-82fe-53679e48aac8 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:54.449308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1ae79-ef73-4359-82fe-53679e48aac8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:54.449737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1ae79-ef73-4359-82fe-53679e48aac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:54.469315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-13d1ae79-ef73-4359-82fe-53679e48aac8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:54.470560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-13d1ae79-ef73-4359-82fe-53679e48aac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:54.482691 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3f640-f460-48bf-8201-d782daadf2b2 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:54.552399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 177/348] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:54.553638 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1ae79-ef73-4359-82fe-53679e48aac8 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:54.592179 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb21cd-1f98-4564-a537-ef119c77d47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:54.592839 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb21cd-1f98-4564-a537-ef119c77d47c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:54.593126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb21cd-1f98-4564-a537-ef119c77d47c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:54.593407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb21cd-1f98-4564-a537-ef119c77d47c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:54.679892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:54.684454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d1ae79-ef73-4359-82fe-53679e48aac8 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:54.692093 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb21cd-1f98-4564-a537-ef119c77d47c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:54.693805 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb21cd-1f98-4564-a537-ef119c77d47c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:54.731943 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3d6ae-bd89-49c5-8933-965b432a2ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:54.733332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3d6ae-bd89-49c5-8933-965b432a2ed8 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:54.733621 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3d6ae-bd89-49c5-8933-965b432a2ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:54.734135 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3d6ae-bd89-49c5-8933-965b432a2ed8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:54.751973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b3d6ae-bd89-49c5-8933-965b432a2ed8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:54.760502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-84b3d6ae-bd89-49c5-8933-965b432a2ed8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:54.760502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:54.760502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:54.760502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:54.760502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:54.760502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:54.760502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:54.760502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:54.760502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:54.760502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:54.760502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:54.760502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:54.760502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:54.760502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:54.760502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:54.760502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:54.761604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:54.761604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:54.761604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:54.761604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:54.761604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:54.761604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:54.761604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:54.761604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:54.761604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:54.761604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:54.761604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:54.761604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:54.761604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:54.761604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:54.761604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:54.761604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:54.762630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:54.762630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:54.762630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:54.762630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:54.762630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:54.762630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:54.762630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:54.762630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:54.762630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:54.762630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:54.762630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:54.762630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:54.764894 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 178/349] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:32:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:54.765839 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3d6ae-bd89-49c5-8933-965b432a2ed8 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:54.782758 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:54.825459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 172/350] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:54.827032 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb21cd-1f98-4564-a537-ef119c77d47c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:54.893169 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3d6ae-bd89-49c5-8933-965b432a2ed8 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:54.935282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b299dd-ad1a-4715-a3ee-db1db090675c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:54.936501 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b299dd-ad1a-4715-a3ee-db1db090675c None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:54.937052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b299dd-ad1a-4715-a3ee-db1db090675c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:54.937530 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b299dd-ad1a-4715-a3ee-db1db090675c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:54.950710 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b299dd-ad1a-4715-a3ee-db1db090675c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:54.956521 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb21cd-1f98-4564-a537-ef119c77d47c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:54.959288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-89b299dd-ad1a-4715-a3ee-db1db090675c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:54.959288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:54.959288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:54.959288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:54.959288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:54.959288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:54.959288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:54.959288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:54.959288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:54.959288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:54.959288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:54.959288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:54.959288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:54.959288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:54.959288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:54.959288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:54.960203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:54.960203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:54.960203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:54.960203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:54.960203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:54.960203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:54.960203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:54.960203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:54.960203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:54.960203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:54.960203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:54.960203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:54.960203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:54.960203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:54.960203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:54.960203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:54.961058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:54.961058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:54.961058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:54.961058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:54.961058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:54.961058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:54.961058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:54.961058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:54.961058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:54.961058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:54.961058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:54.961058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:54.965273 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 179/351] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:54.966340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b299dd-ad1a-4715-a3ee-db1db090675c None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:54.993501 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:55.008905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d7dcd-7554-4f47-84eb-3a837483f9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:55.009654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d7dcd-7554-4f47-84eb-3a837483f9a9 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:55.010471 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d7dcd-7554-4f47-84eb-3a837483f9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:55.010753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d7dcd-7554-4f47-84eb-3a837483f9a9 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:55.011506 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d7dcd-7554-4f47-84eb-3a837483f9a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:55.011939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d7dcd-7554-4f47-84eb-3a837483f9a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:55.014295 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d7dcd-7554-4f47-84eb-3a837483f9a9 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:55.025518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 173/352] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:32:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:55.026370 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d7dcd-7554-4f47-84eb-3a837483f9a9 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:55.103912 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:55.107968 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b299dd-ad1a-4715-a3ee-db1db090675c None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:55.148966 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d7dcd-7554-4f47-84eb-3a837483f9a9 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:55.149783 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe518d84-c24e-4b92-80c5-2a5b86d64a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:55.151488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe518d84-c24e-4b92-80c5-2a5b86d64a05 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:55.152010 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe518d84-c24e-4b92-80c5-2a5b86d64a05 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:55.152469 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe518d84-c24e-4b92-80c5-2a5b86d64a05 None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:55.155699 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe518d84-c24e-4b92-80c5-2a5b86d64a05 None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:55.157348 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe518d84-c24e-4b92-80c5-2a5b86d64a05 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:55.159234 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 180/353] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:54 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:55.160680 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe518d84-c24e-4b92-80c5-2a5b86d64a05 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:55.193710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1580ee-669c-449b-9936-d54206e7272c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:55.194571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1580ee-669c-449b-9936-d54206e7272c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:55.194931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1580ee-669c-449b-9936-d54206e7272c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:55.195352 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1580ee-669c-449b-9936-d54206e7272c None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:55.196213 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1580ee-669c-449b-9936-d54206e7272c None admin] RBAC: Adding query filter params (name=member) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:55.196613 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1580ee-669c-449b-9936-d54206e7272c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:55.198707 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1580ee-669c-449b-9936-d54206e7272c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:55.209018 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 174/354] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:55.209927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1580ee-669c-449b-9936-d54206e7272c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:55.276960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:55.294010 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe518d84-c24e-4b92-80c5-2a5b86d64a05 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:55.319957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:55.332111 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1580ee-669c-449b-9936-d54206e7272c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:55.342518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4351da-16ea-4db1-a798-c05b656b13e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:55.343564 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4351da-16ea-4db1-a798-c05b656b13e6 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:55.344398 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4351da-16ea-4db1-a798-c05b656b13e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:55.344899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4351da-16ea-4db1-a798-c05b656b13e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:55.374964 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d695b7a-132b-4bee-aec7-1cf563d61ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:55.375916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d695b7a-132b-4bee-aec7-1cf563d61ffd None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:55.376212 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d695b7a-132b-4bee-aec7-1cf563d61ffd None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:55.376494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d695b7a-132b-4bee-aec7-1cf563d61ffd None admin] PATH_INFO: `/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:55.385759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d695b7a-132b-4bee-aec7-1cf563d61ffd None admin] RBAC: Authorizing `identity:get_group(group_id=b9ff32c0c6804a5e81910c436eb2ce9d)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:55.386922 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d695b7a-132b-4bee-aec7-1cf563d61ffd None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:55.389198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 175/355] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jun 27 18:32:55 2022] GET /identity/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:55.390336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d695b7a-132b-4bee-aec7-1cf563d61ffd None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:55.440748 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4351da-16ea-4db1-a798-c05b656b13e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:55.442285 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4351da-16ea-4db1-a798-c05b656b13e6 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:55.531794 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d695b7a-132b-4bee-aec7-1cf563d61ffd None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:55.572658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:55.575511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da3d1a-9b64-4ca0-89bd-5aeda89d382e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:55.576374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da3d1a-9b64-4ca0-89bd-5aeda89d382e None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:55.576872 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da3d1a-9b64-4ca0-89bd-5aeda89d382e None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:55.577151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da3d1a-9b64-4ca0-89bd-5aeda89d382e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:55.587161 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 181/356] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:55.591570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4351da-16ea-4db1-a798-c05b656b13e6 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:55.615390 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:55.670447 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da3d1a-9b64-4ca0-89bd-5aeda89d382e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:55.672013 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da3d1a-9b64-4ca0-89bd-5aeda89d382e None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:55.725676 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4351da-16ea-4db1-a798-c05b656b13e6 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:55.776837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c464c5-832a-4660-898b-be306a5a5c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:55.777762 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c464c5-832a-4660-898b-be306a5a5c8f None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:55.778121 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c464c5-832a-4660-898b-be306a5a5c8f None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:55.778400 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c464c5-832a-4660-898b-be306a5a5c8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:55.779252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c464c5-832a-4660-898b-be306a5a5c8f None admin] RBAC: Adding query filter params (group.id=b9ff32c0c6804a5e81910c436eb2ce9d, role.id=5c4481f023774d67997d4ba28e07cff0, scope.project.id=7cdc86a10dd449abbc708408ab6b0d78) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:55.779752 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c464c5-832a-4660-898b-be306a5a5c8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:55.781038 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c464c5-832a-4660-898b-be306a5a5c8f None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:55.787210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 182/357] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jun 27 18:32:55 2022] GET /identity/v3/role_assignments?group.id=b9ff32c0c6804a5e81910c436eb2ce9d&scope.project.id=7cdc86a10dd449abbc708408ab6b0d78&role.id=5c4481f023774d67997d4ba28e07cff0 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:55.788359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985fd53-e191-49b5-aba1-2b600c74bab4 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:55.788811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985fd53-e191-49b5-aba1-2b600c74bab4 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:55.788938 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985fd53-e191-49b5-aba1-2b600c74bab4 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:55.790319 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 183/358] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:55.791435 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985fd53-e191-49b5-aba1-2b600c74bab4 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:55.804915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 176/359] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:55.808012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f1eaa-e45e-48df-811b-86147354f799 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:55.808745 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f1eaa-e45e-48df-811b-86147354f799 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:55.813095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17f1eaa-e45e-48df-811b-86147354f799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:55.832954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-e17f1eaa-e45e-48df-811b-86147354f799 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:55.834205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e17f1eaa-e45e-48df-811b-86147354f799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:55.863922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:55.911412 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:55.919306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985fd53-e191-49b5-aba1-2b600c74bab4 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:55.930756 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 177/360] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:55.932245 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f1eaa-e45e-48df-811b-86147354f799 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:55.990124 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69a73a-fac0-4078-873b-70979871d40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:55.991253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69a73a-fac0-4078-873b-70979871d40e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:55.991729 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69a73a-fac0-4078-873b-70979871d40e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:55.992140 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69a73a-fac0-4078-873b-70979871d40e None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:55.993541 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69a73a-fac0-4078-873b-70979871d40e None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:55.995469 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69a73a-fac0-4078-873b-70979871d40e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:55.997387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 184/361] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:55 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:55.998131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69a73a-fac0-4078-873b-70979871d40e None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:56.058486 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17f1eaa-e45e-48df-811b-86147354f799 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:56.098345 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e883ce-813d-4471-954f-4410bc7e024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:56.099217 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e883ce-813d-4471-954f-4410bc7e024c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:56.099504 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e883ce-813d-4471-954f-4410bc7e024c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:56.099817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e883ce-813d-4471-954f-4410bc7e024c None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:56.102186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e883ce-813d-4471-954f-4410bc7e024c None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:56.104246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e883ce-813d-4471-954f-4410bc7e024c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:56.106678 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 178/362] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:55 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:56.108316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cd4bc-2cad-430d-aa9e-95febf071942 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:56.108608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cd4bc-2cad-430d-aa9e-95febf071942 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:56.108891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cd4bc-2cad-430d-aa9e-95febf071942 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:56.110051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69a73a-fac0-4078-873b-70979871d40e None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:56.111220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 179/363] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:56.111973 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cd4bc-2cad-430d-aa9e-95febf071942 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:56.146390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:56.163752 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3def732-7571-42f9-b800-47653c5037f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:56.164953 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3def732-7571-42f9-b800-47653c5037f3 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:56.165241 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3def732-7571-42f9-b800-47653c5037f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:56.165516 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3def732-7571-42f9-b800-47653c5037f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:56.182807 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:56.184960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3def732-7571-42f9-b800-47653c5037f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:56.194002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-d3def732-7571-42f9-b800-47653c5037f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:56.194002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:56.194002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:56.194002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:56.194002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:56.194002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:56.194002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:56.194002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:56.194002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:56.194002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:56.194002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:56.194002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:56.194002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:56.194002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:56.194002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:56.194002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:56.195063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:56.195063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:56.195063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:56.195063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:56.195063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:56.195063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:56.195063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:56.195063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:56.195063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:56.195063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:56.195063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:56.195063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:56.195063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:56.195063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:56.195063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:56.195063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:56.196679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:56.196679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:56.196679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:56.196679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:56.196679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:56.196679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:56.196679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:56.196679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:56.196679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:56.196679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:56.196679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:56.196679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:56.196679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 185/364] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:32:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:56.197407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd7d0e-ae43-48e8-ab3f-5b9d5a5fb5d9 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:56.197407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd7d0e-ae43-48e8-ab3f-5b9d5a5fb5d9 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:56.197407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd7d0e-ae43-48e8-ab3f-5b9d5a5fb5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:56.218716 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-40dd7d0e-ae43-48e8-ab3f-5b9d5a5fb5d9 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:56.219954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-40dd7d0e-ae43-48e8-ab3f-5b9d5a5fb5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:56.245050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cd4bc-2cad-430d-aa9e-95febf071942 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:56.289519 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf84c95-c8f4-423a-9523-ac46e04c42e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:56.290384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf84c95-c8f4-423a-9523-ac46e04c42e3 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:56.290663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf84c95-c8f4-423a-9523-ac46e04c42e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:56.291455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf84c95-c8f4-423a-9523-ac46e04c42e3 None admin] PATH_INFO: `/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:56.293465 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf84c95-c8f4-423a-9523-ac46e04c42e3 None admin] RBAC: Authorizing `identity:get_group(group_id=b9ff32c0c6804a5e81910c436eb2ce9d)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:56.294803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf84c95-c8f4-423a-9523-ac46e04c42e3 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:56.298312 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 180/365] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jun 27 18:32:56 2022] GET /identity/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:56.298312 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf84c95-c8f4-423a-9523-ac46e04c42e3 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:56.312622 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 186/366] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:56.314540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd7d0e-ae43-48e8-ab3f-5b9d5a5fb5d9 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:56.425233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf84c95-c8f4-423a-9523-ac46e04c42e3 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:56.439198 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd7d0e-ae43-48e8-ab3f-5b9d5a5fb5d9 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:56.452089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:56.453162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:56.469449 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08eb20-ce2d-4828-afc3-f5c2622163fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:56.470322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08eb20-ce2d-4828-afc3-f5c2622163fc None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:56.470608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08eb20-ce2d-4828-afc3-f5c2622163fc None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:56.470883 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08eb20-ce2d-4828-afc3-f5c2622163fc None admin] PATH_INFO: `/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:56.473503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08eb20-ce2d-4828-afc3-f5c2622163fc None admin] RBAC: Authorizing `identity:get_group(group_id=b9ff32c0c6804a5e81910c436eb2ce9d)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:56.474422 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08eb20-ce2d-4828-afc3-f5c2622163fc None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:56.476757 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 181/367] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jun 27 18:32:56 2022] GET /identity/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:56.477227 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08eb20-ce2d-4828-afc3-f5c2622163fc None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:56.485223 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554df32-42ba-4d0c-b1c6-abd094f77057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:56.486372 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554df32-42ba-4d0c-b1c6-abd094f77057 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:56.486914 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554df32-42ba-4d0c-b1c6-abd094f77057 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:56.487572 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554df32-42ba-4d0c-b1c6-abd094f77057 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:56.488453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554df32-42ba-4d0c-b1c6-abd094f77057 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:56.488921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554df32-42ba-4d0c-b1c6-abd094f77057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:56.490960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554df32-42ba-4d0c-b1c6-abd094f77057 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:56.502544 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 187/368] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:32:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:56.503333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554df32-42ba-4d0c-b1c6-abd094f77057 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:56.617635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08eb20-ce2d-4828-afc3-f5c2622163fc None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:56.638828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554df32-42ba-4d0c-b1c6-abd094f77057 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:56.659240 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed495b9-0dff-4e33-8734-b1944ad2432d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:56.659932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed495b9-0dff-4e33-8734-b1944ad2432d None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:56.660222 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed495b9-0dff-4e33-8734-b1944ad2432d None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:56.660504 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed495b9-0dff-4e33-8734-b1944ad2432d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:56.661347 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed495b9-0dff-4e33-8734-b1944ad2432d None admin] RBAC: Adding query filter params (group.id=b9ff32c0c6804a5e81910c436eb2ce9d, role.id=422c41a081a44a4e8b04f4d9ce6e8930, scope.project.id=7cdc86a10dd449abbc708408ab6b0d78) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:56.661666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed495b9-0dff-4e33-8734-b1944ad2432d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:56.663112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed495b9-0dff-4e33-8734-b1944ad2432d None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:56.669613 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 182/369] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jun 27 18:32:56 2022] GET /identity/v3/role_assignments?group.id=b9ff32c0c6804a5e81910c436eb2ce9d&scope.project.id=7cdc86a10dd449abbc708408ab6b0d78&role.id=422c41a081a44a4e8b04f4d9ce6e8930 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:56.670198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed495b9-0dff-4e33-8734-b1944ad2432d None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:56.678914 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b513a1b-b367-40b6-921e-2ee85fe5ed0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:56.679771 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b513a1b-b367-40b6-921e-2ee85fe5ed0e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:56.680777 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b513a1b-b367-40b6-921e-2ee85fe5ed0e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:56.681071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b513a1b-b367-40b6-921e-2ee85fe5ed0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:56.697737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b513a1b-b367-40b6-921e-2ee85fe5ed0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:56.709044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-0b513a1b-b367-40b6-921e-2ee85fe5ed0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:56.709044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:56.709044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:56.709044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:56.709044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:56.709044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:56.709044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:56.709044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:56.709044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:56.709044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:56.709044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:56.709044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:56.709044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:56.709044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:56.709044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:56.709044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:56.710090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:56.710090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:56.710090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:56.710090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:56.710090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:56.710090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:56.710090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:56.710090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:56.710090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:56.710090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:56.710090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:56.710090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:56.710090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:56.710090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:56.710090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:56.710090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:56.710932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:56.710932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:56.710932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:56.710932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:56.710932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:56.710932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:56.710932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:56.710932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:56.710932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:56.710932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:56.710932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:32:56.710932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:56.710932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 188/370] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:32:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:56.711792 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b513a1b-b367-40b6-921e-2ee85fe5ed0e None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:56.741830 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:56.760166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:56.798452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed495b9-0dff-4e33-8734-b1944ad2432d None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:56.840237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b5799-0b0e-4d96-84a0-d7730e1c44fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:56.841000 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b5799-0b0e-4d96-84a0-d7730e1c44fd None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:56.841396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b5799-0b0e-4d96-84a0-d7730e1c44fd None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:56.841783 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b5799-0b0e-4d96-84a0-d7730e1c44fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:56.842744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b5799-0b0e-4d96-84a0-d7730e1c44fd None admin] RBAC: Adding query filter params (group.id=b9ff32c0c6804a5e81910c436eb2ce9d, role.id=5c4481f023774d67997d4ba28e07cff0, scope.project.id=36535f8090e64641b80e339c1590bf71) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:56.843172 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b5799-0b0e-4d96-84a0-d7730e1c44fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:56.844804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b5799-0b0e-4d96-84a0-d7730e1c44fd None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:56.846838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b513a1b-b367-40b6-921e-2ee85fe5ed0e None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:56.852536 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 183/371] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jun 27 18:32:56 2022] GET /identity/v3/role_assignments?group.id=b9ff32c0c6804a5e81910c436eb2ce9d&scope.project.id=36535f8090e64641b80e339c1590bf71&role.id=5c4481f023774d67997d4ba28e07cff0 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:56.853921 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b5799-0b0e-4d96-84a0-d7730e1c44fd None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:56.889925 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326948f-d46e-44c8-ac01-e13933b21dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:56.890865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326948f-d46e-44c8-ac01-e13933b21dec None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:56.891308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326948f-d46e-44c8-ac01-e13933b21dec None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:56.892742 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326948f-d46e-44c8-ac01-e13933b21dec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:56.970898 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326948f-d46e-44c8-ac01-e13933b21dec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:56.974108 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326948f-d46e-44c8-ac01-e13933b21dec None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:57.016047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:57.081426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b5799-0b0e-4d96-84a0-d7730e1c44fd None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:57.108546 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 189/372] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:32:57.110072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:57.112318 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326948f-d46e-44c8-ac01-e13933b21dec None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:57.129545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9296c9-bd52-406f-a0bb-20940d8e0119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:57.130582 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9296c9-bd52-406f-a0bb-20940d8e0119 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:57.131127 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9296c9-bd52-406f-a0bb-20940d8e0119 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:57.131735 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9296c9-bd52-406f-a0bb-20940d8e0119 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:57.132826 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9296c9-bd52-406f-a0bb-20940d8e0119 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:57.133340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9296c9-bd52-406f-a0bb-20940d8e0119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:57.135481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9296c9-bd52-406f-a0bb-20940d8e0119 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:57.145389 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 184/373] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:57.151815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9296c9-bd52-406f-a0bb-20940d8e0119 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:57.224431 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326948f-d46e-44c8-ac01-e13933b21dec None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:57.258213 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:57.264104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9296c9-bd52-406f-a0bb-20940d8e0119 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:57.268458 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdd9a5-1b9e-4265-a659-d15b22296357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:57.268458 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdd9a5-1b9e-4265-a659-d15b22296357 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:57.268458 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdd9a5-1b9e-4265-a659-d15b22296357 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:57.268458 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdd9a5-1b9e-4265-a659-d15b22296357 None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:57.268834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdd9a5-1b9e-4265-a659-d15b22296357 None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:57.270116 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdd9a5-1b9e-4265-a659-d15b22296357 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:57.277397 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 190/374] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:57 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:32:57.278840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdd9a5-1b9e-4265-a659-d15b22296357 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:57.300090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f0209-f161-4a11-976a-a43da3d7fdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:57.300887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f0209-f161-4a11-976a-a43da3d7fdf5 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:57.301287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f0209-f161-4a11-976a-a43da3d7fdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:57.301668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f0209-f161-4a11-976a-a43da3d7fdf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:57.367959 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:57.381091 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f0209-f161-4a11-976a-a43da3d7fdf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:57.382644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f0209-f161-4a11-976a-a43da3d7fdf5 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:57.394646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdd9a5-1b9e-4265-a659-d15b22296357 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:57.436686 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a52de0-a746-4606-b136-99a8e08d4bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:57.438022 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a52de0-a746-4606-b136-99a8e08d4bdd None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:57.438309 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a52de0-a746-4606-b136-99a8e08d4bdd None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:57.438865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a52de0-a746-4606-b136-99a8e08d4bdd None admin] PATH_INFO: `/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:57.440392 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a52de0-a746-4606-b136-99a8e08d4bdd None admin] RBAC: Authorizing `identity:get_group(group_id=b9ff32c0c6804a5e81910c436eb2ce9d)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:57.442557 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a52de0-a746-4606-b136-99a8e08d4bdd None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:57.445193 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 191/375] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jun 27 18:32:57 2022] GET /identity/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:57.453811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a52de0-a746-4606-b136-99a8e08d4bdd None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:57.504098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 185/376] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:32:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 18:32:57.513933 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f0209-f161-4a11-976a-a43da3d7fdf5 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:57.532320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:57.567184 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a52de0-a746-4606-b136-99a8e08d4bdd None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:57.604981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a2836-2657-4aee-86e4-4bd336b9d43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:57.605888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a2836-2657-4aee-86e4-4bd336b9d43a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:57.606245 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a2836-2657-4aee-86e4-4bd336b9d43a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:57.606780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a2836-2657-4aee-86e4-4bd336b9d43a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:57.607790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a2836-2657-4aee-86e4-4bd336b9d43a None admin] RBAC: Adding query filter params (group.id=b9ff32c0c6804a5e81910c436eb2ce9d, role.id=422c41a081a44a4e8b04f4d9ce6e8930, scope.project.id=36535f8090e64641b80e339c1590bf71) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:57.608208 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a2836-2657-4aee-86e4-4bd336b9d43a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:57.609732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a2836-2657-4aee-86e4-4bd336b9d43a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:57.611153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:57.616221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 192/377] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jun 27 18:32:57 2022] GET /identity/v3/role_assignments?group.id=b9ff32c0c6804a5e81910c436eb2ce9d&scope.project.id=36535f8090e64641b80e339c1590bf71&role.id=422c41a081a44a4e8b04f4d9ce6e8930 => generated 260 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:57.632392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f0209-f161-4a11-976a-a43da3d7fdf5 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:57.672319 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ce087-ee5f-47b4-880b-2a8eee4e9254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:57.673480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ce087-ee5f-47b4-880b-2a8eee4e9254 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:57.673959 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ce087-ee5f-47b4-880b-2a8eee4e9254 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:57.674382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ce087-ee5f-47b4-880b-2a8eee4e9254 None admin] PATH_INFO: `/v3/projects/1f3d89cc168b4f4880cd82876788b05f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:57.675791 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ce087-ee5f-47b4-880b-2a8eee4e9254 None admin] RBAC: Authorizing `identity:get_project(project_id=1f3d89cc168b4f4880cd82876788b05f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:57.677411 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683ce087-ee5f-47b4-880b-2a8eee4e9254 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:57.679661 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 186/378] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:57 2022] GET /identity/v3/projects/1f3d89cc168b4f4880cd82876788b05f => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:57.685885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a2836-2657-4aee-86e4-4bd336b9d43a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:57.809550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a2836-2657-4aee-86e4-4bd336b9d43a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:57.846782 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:57.854606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88c3db-3a01-474d-9881-8dc3508064ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:57.855858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88c3db-3a01-474d-9881-8dc3508064ca None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:57.856287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88c3db-3a01-474d-9881-8dc3508064ca None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:57.856724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88c3db-3a01-474d-9881-8dc3508064ca None admin] PATH_INFO: `/v3/groups/5566d657c5854ce1b103e653b0e814a9` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:57.865255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88c3db-3a01-474d-9881-8dc3508064ca None admin] RBAC: Authorizing `identity:get_group(group_id=5566d657c5854ce1b103e653b0e814a9)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:57.867065 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88c3db-3a01-474d-9881-8dc3508064ca None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:57.869944 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 193/379] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jun 27 18:32:57 2022] GET /identity/v3/groups/5566d657c5854ce1b103e653b0e814a9 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:57.876020 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ce087-ee5f-47b4-880b-2a8eee4e9254 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:57.984292 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ce087-ee5f-47b4-880b-2a8eee4e9254 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:58.020045 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc15d4-5b95-4845-b10c-03cfadea7ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:58.020990 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc15d4-5b95-4845-b10c-03cfadea7ec8 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:58.021424 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc15d4-5b95-4845-b10c-03cfadea7ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:58.021854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc15d4-5b95-4845-b10c-03cfadea7ec8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:58.022823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc15d4-5b95-4845-b10c-03cfadea7ec8 None admin] RBAC: Adding query filter params (group.id=5566d657c5854ce1b103e653b0e814a9, role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=1f3d89cc168b4f4880cd82876788b05f) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:58.023291 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc15d4-5b95-4845-b10c-03cfadea7ec8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:58.024906 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc15d4-5b95-4845-b10c-03cfadea7ec8 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:58.035791 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 187/380] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jun 27 18:32:57 2022] GET /identity/v3/role_assignments?group.id=5566d657c5854ce1b103e653b0e814a9&scope.project.id=1f3d89cc168b4f4880cd82876788b05f&role.id=b156409c977248e1b23c26e589b1e04f => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:58.121220 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def58198-a2d1-4f64-a76f-4767081b169d None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:58.121435 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def58198-a2d1-4f64-a76f-4767081b169d None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:58.121749 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def58198-a2d1-4f64-a76f-4767081b169d None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:58.123434 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 194/381] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:58.129059 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25044af5-5494-4883-9e0c-332b13c0ce27 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:58.129355 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25044af5-5494-4883-9e0c-332b13c0ce27 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:58.129629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25044af5-5494-4883-9e0c-332b13c0ce27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:58.148498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-25044af5-5494-4883-9e0c-332b13c0ce27 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:58.149742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-25044af5-5494-4883-9e0c-332b13c0ce27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:58.161851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:58.236273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 188/382] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:58.260780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def58198-a2d1-4f64-a76f-4767081b169d None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:58.399718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def58198-a2d1-4f64-a76f-4767081b169d None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:58.449564 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead31dc3-f987-49dc-b225-fa80f450bfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:58.450363 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead31dc3-f987-49dc-b225-fa80f450bfad None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:58.450648 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead31dc3-f987-49dc-b225-fa80f450bfad None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:58.450923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead31dc3-f987-49dc-b225-fa80f450bfad None admin] PATH_INFO: `/v3/roles/member` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:58.464838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead31dc3-f987-49dc-b225-fa80f450bfad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:58.472658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-ead31dc3-f987-49dc-b225-fa80f450bfad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:58.472658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:58.472658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:58.472658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:58.472658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:58.472658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:58.472658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:58.472658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:58.472658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:58.472658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:58.472658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:58.472658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:58.472658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:58.472658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:58.472658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:58.472658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:58.473540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:58.473540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:58.473540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:58.473540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:58.473540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:58.473540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:58.473540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:58.473540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:58.473540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:58.473540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:58.473540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:58.473540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:58.473540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:58.473540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:58.473540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:58.473540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:58.474320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:58.474320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:58.474320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:58.474320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:58.474320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:58.474320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:58.474320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:58.474320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:58.474320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:58.474320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:58.474320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:32:58.474320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:32:58.479094 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 195/383] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:32:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:58.480434 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25044af5-5494-4883-9e0c-332b13c0ce27 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:58.618785 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25044af5-5494-4883-9e0c-332b13c0ce27 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:58.662428 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a776eb9-d7cc-40c7-ab41-f7e04ef889c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:58.663030 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a776eb9-d7cc-40c7-ab41-f7e04ef889c1 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:58.663316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a776eb9-d7cc-40c7-ab41-f7e04ef889c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:58.663631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a776eb9-d7cc-40c7-ab41-f7e04ef889c1 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:58.664392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a776eb9-d7cc-40c7-ab41-f7e04ef889c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:32:58.664702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a776eb9-d7cc-40c7-ab41-f7e04ef889c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:58.666717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a776eb9-d7cc-40c7-ab41-f7e04ef889c1 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:58.679165 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 189/384] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:32:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:58.685475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead31dc3-f987-49dc-b225-fa80f450bfad None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:58.779201 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:58.829176 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead31dc3-f987-49dc-b225-fa80f450bfad None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:58.870856 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77834ada-ddc3-466b-89f9-b8517ebf7a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:58.872117 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834ada-ddc3-466b-89f9-b8517ebf7a9e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:58.872620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834ada-ddc3-466b-89f9-b8517ebf7a9e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:58.873088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77834ada-ddc3-466b-89f9-b8517ebf7a9e None admin] PATH_INFO: `/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:58.874457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77834ada-ddc3-466b-89f9-b8517ebf7a9e None admin] RBAC: Authorizing `identity:get_group(group_id=b9ff32c0c6804a5e81910c436eb2ce9d)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:58.876138 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77834ada-ddc3-466b-89f9-b8517ebf7a9e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:58.877982 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 196/385] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jun 27 18:32:58 2022] GET /identity/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:58.883694 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a776eb9-d7cc-40c7-ab41-f7e04ef889c1 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:58.901259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:59.018910 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a776eb9-d7cc-40c7-ab41-f7e04ef889c1 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:59.054836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bff97-3a93-402f-9bd7-8b5b5ff3a89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:59.056112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bff97-3a93-402f-9bd7-8b5b5ff3a89d None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:59.056637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bff97-3a93-402f-9bd7-8b5b5ff3a89d None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:59.057117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bff97-3a93-402f-9bd7-8b5b5ff3a89d None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:59.058495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bff97-3a93-402f-9bd7-8b5b5ff3a89d None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:59.060159 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bff97-3a93-402f-9bd7-8b5b5ff3a89d None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:59.062161 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 190/386] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:32:58 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:32:59.067995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77834ada-ddc3-466b-89f9-b8517ebf7a9e None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:59.188027 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77834ada-ddc3-466b-89f9-b8517ebf7a9e None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:59.215911 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:59.229295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed1d6f-3a89-44f7-b400-15273ea74a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:59.230502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed1d6f-3a89-44f7-b400-15273ea74a72 None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:59.231029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed1d6f-3a89-44f7-b400-15273ea74a72 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:59.231498 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed1d6f-3a89-44f7-b400-15273ea74a72 None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78/groups/b9ff32c0c6804a5e81910c436eb2ce9d/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:59.233969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed1d6f-3a89-44f7-b400-15273ea74a72 None admin] RBAC: Authorizing `identity:create_grant(project_id=7cdc86a10dd449abbc708408ab6b0d78, group_id=b9ff32c0c6804a5e81910c436eb2ce9d, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:32:59.235703 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed1d6f-3a89-44f7-b400-15273ea74a72 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:32:59.312584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 197/387] 10.222.0.36 () {58 vars in 1442 bytes} [Mon Jun 27 18:32:59 2022] PUT /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78/groups/b9ff32c0c6804a5e81910c436eb2ce9d/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:32:59.661212 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaacb6-cebe-4ec3-8a51-c97236b7110b None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:59.661877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaacb6-cebe-4ec3-8a51-c97236b7110b None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:59.661877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beaacb6-cebe-4ec3-8a51-c97236b7110b None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:59.663198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 191/388] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:32:59.669304 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da095a23-582b-4793-8570-ca75f0d5e8dd None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:59.669792 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da095a23-582b-4793-8570-ca75f0d5e8dd None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:59.669943 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da095a23-582b-4793-8570-ca75f0d5e8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:59.688462 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-da095a23-582b-4793-8570-ca75f0d5e8dd None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:32:59.689654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-da095a23-582b-4793-8570-ca75f0d5e8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:32:59.763838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 198/389] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:32:59.785790 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beaacb6-cebe-4ec3-8a51-c97236b7110b None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:32:59.871771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:32:59.904386 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beaacb6-cebe-4ec3-8a51-c97236b7110b None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:32:59.942899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ebef7-c8ab-42fd-9281-d42cfb3539c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:32:59.943666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ebef7-c8ab-42fd-9281-d42cfb3539c7 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:32:59.943952 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ebef7-c8ab-42fd-9281-d42cfb3539c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:32:59.944226 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ebef7-c8ab-42fd-9281-d42cfb3539c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:32:59.959696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ebef7-c8ab-42fd-9281-d42cfb3539c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:32:59.968808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-e29ebef7-c8ab-42fd-9281-d42cfb3539c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:59.968808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:32:59.968808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:32:59.968808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:32:59.968808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:32:59.968808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:32:59.968808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:32:59.968808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:32:59.968808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:32:59.968808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:32:59.968808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:32:59.968808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:32:59.968808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:32:59.968808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:32:59.968808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:32:59.968808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:32:59.969718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:32:59.969718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:32:59.969718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:32:59.969718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:32:59.969718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:32:59.969718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:32:59.969718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:32:59.969718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:32:59.969718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:32:59.969718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:32:59.969718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:32:59.969718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:32:59.969718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:32:59.969718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:32:59.969718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:32:59.969718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:32:59.970552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:32:59.970552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:32:59.970552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:32:59.970552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:32:59.970552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:32:59.970552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:32:59.970552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:32:59.970552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:32:59.970552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:32:59.970552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:32:59.970552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:32:59.970552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:32:59.970552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 192/390] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:32:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:32:59.976184 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da095a23-582b-4793-8570-ca75f0d5e8dd None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:00.086724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc59f8f-9777-46a5-a8a2-9954f0a816aa None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:00.087422 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc59f8f-9777-46a5-a8a2-9954f0a816aa None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:00.088503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc59f8f-9777-46a5-a8a2-9954f0a816aa None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:00.093873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 193/391] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:00.096210 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b77a78-8957-4178-8dcb-df3af377281a None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:00.096701 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b77a78-8957-4178-8dcb-df3af377281a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:00.097171 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b77a78-8957-4178-8dcb-df3af377281a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:00.124573 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da095a23-582b-4793-8570-ca75f0d5e8dd None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:00.125506 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-18b77a78-8957-4178-8dcb-df3af377281a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:00.126924 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-18b77a78-8957-4178-8dcb-df3af377281a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:00.153359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:00.164152 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3cd10-82c5-4f4b-b232-1fb7beedd57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:00.164918 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3cd10-82c5-4f4b-b232-1fb7beedd57d None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:00.166069 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3cd10-82c5-4f4b-b232-1fb7beedd57d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:00.166553 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3cd10-82c5-4f4b-b232-1fb7beedd57d None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:00.167497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3cd10-82c5-4f4b-b232-1fb7beedd57d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:00.167984 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3cd10-82c5-4f4b-b232-1fb7beedd57d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:00.169516 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3cd10-82c5-4f4b-b232-1fb7beedd57d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:00.178317 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 199/392] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:32:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:00.185069 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3cd10-82c5-4f4b-b232-1fb7beedd57d None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:00.208853 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 194/393] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:33:00.247522 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b77a78-8957-4178-8dcb-df3af377281a None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:00.295040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3cd10-82c5-4f4b-b232-1fb7beedd57d None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:00.339180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde82d78-1ae4-4404-98fd-34d1b0775ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:00.340651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde82d78-1ae4-4404-98fd-34d1b0775ad9 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:00.341654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde82d78-1ae4-4404-98fd-34d1b0775ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:00.342887 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde82d78-1ae4-4404-98fd-34d1b0775ad9 None admin] PATH_INFO: `/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:00.345102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde82d78-1ae4-4404-98fd-34d1b0775ad9 None admin] RBAC: Authorizing `identity:get_group(group_id=b9ff32c0c6804a5e81910c436eb2ce9d)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:00.348169 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde82d78-1ae4-4404-98fd-34d1b0775ad9 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:00.350167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 200/394] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jun 27 18:33:00 2022] GET /identity/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:00.360930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde82d78-1ae4-4404-98fd-34d1b0775ad9 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:00.362778 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:00.447846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b77a78-8957-4178-8dcb-df3af377281a None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:00.459949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:00.512285 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb90b6b-421f-47cd-9260-6528c471a5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:00.512285 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb90b6b-421f-47cd-9260-6528c471a5ff None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:00.512584 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb90b6b-421f-47cd-9260-6528c471a5ff None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:00.512655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb90b6b-421f-47cd-9260-6528c471a5ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:00.534531 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb90b6b-421f-47cd-9260-6528c471a5ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:00.542976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-8eb90b6b-421f-47cd-9260-6528c471a5ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:33:00.542976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:00.542976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:00.542976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:00.542976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:00.542976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:00.542976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:00.542976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:00.542976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:00.542976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:00.542976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:00.542976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:00.542976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:00.542976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:00.542976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:00.542976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:00.543905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:00.543905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:00.543905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:00.543905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:00.543905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:00.543905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:00.543905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:00.543905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:00.543905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:00.543905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:00.543905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:00.543905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:00.543905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:00.543905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:00.543905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:00.543905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:00.544727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:00.544727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:00.544727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:00.544727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:00.544727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:00.544727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:00.544727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:00.544727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:00.544727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:00.544727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:00.544727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:33:00.544727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:00.553606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde82d78-1ae4-4404-98fd-34d1b0775ad9 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:00.556077 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 195/395] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:33:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:00.565449 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb90b6b-421f-47cd-9260-6528c471a5ff None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:00.632022 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a3f09-3dfc-4ea7-9e54-138f8c55034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:00.632899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a3f09-3dfc-4ea7-9e54-138f8c55034a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:00.633186 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a3f09-3dfc-4ea7-9e54-138f8c55034a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:00.633469 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a3f09-3dfc-4ea7-9e54-138f8c55034a None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:00.636915 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a3f09-3dfc-4ea7-9e54-138f8c55034a None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:00.638390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a3f09-3dfc-4ea7-9e54-138f8c55034a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:00.649156 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 201/396] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:33:00 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:00.650554 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a3f09-3dfc-4ea7-9e54-138f8c55034a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:00.721391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb90b6b-421f-47cd-9260-6528c471a5ff None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:00.747919 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:00.759177 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7de16-197a-47e5-9450-365370c17728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:00.760038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7de16-197a-47e5-9450-365370c17728 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:00.760769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7de16-197a-47e5-9450-365370c17728 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:00.761604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7de16-197a-47e5-9450-365370c17728 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:00.762802 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7de16-197a-47e5-9450-365370c17728 None admin] RBAC: Adding query filter params (name=member) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:00.763503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7de16-197a-47e5-9450-365370c17728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:00.765805 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7de16-197a-47e5-9450-365370c17728 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:00.767097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a3f09-3dfc-4ea7-9e54-138f8c55034a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:00.778025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 196/397] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:33:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:00.785859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfcf31-e6fe-470e-a54d-592918d75a7c None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:00.785859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfcf31-e6fe-470e-a54d-592918d75a7c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:00.785859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfcf31-e6fe-470e-a54d-592918d75a7c None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:00.786101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 197/398] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:00.786826 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:00.791478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfcf31-e6fe-470e-a54d-592918d75a7c None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:00.811636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0767e-d498-4545-af67-c85d832c042a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:00.812763 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0767e-d498-4545-af67-c85d832c042a None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:00.813052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0767e-d498-4545-af67-c85d832c042a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:00.813333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0767e-d498-4545-af67-c85d832c042a None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78/groups/b9ff32c0c6804a5e81910c436eb2ce9d/roles/422c41a081a44a4e8b04f4d9ce6e8930` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:00.815943 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0767e-d498-4545-af67-c85d832c042a None admin] RBAC: Authorizing `identity:create_grant(project_id=7cdc86a10dd449abbc708408ab6b0d78, group_id=b9ff32c0c6804a5e81910c436eb2ce9d, role_id=422c41a081a44a4e8b04f4d9ce6e8930)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:00.817041 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0767e-d498-4545-af67-c85d832c042a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:00.871387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 202/399] 10.222.0.36 () {58 vars in 1442 bytes} [Mon Jun 27 18:33:00 2022] PUT /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78/groups/b9ff32c0c6804a5e81910c436eb2ce9d/roles/422c41a081a44a4e8b04f4d9ce6e8930 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:33:00.879792 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa2200-efab-43d0-80a1-256fb9a789a8 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:00.879792 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa2200-efab-43d0-80a1-256fb9a789a8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:00.879792 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa2200-efab-43d0-80a1-256fb9a789a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:00.891136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-c6fa2200-efab-43d0-80a1-256fb9a789a8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:00.892661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c6fa2200-efab-43d0-80a1-256fb9a789a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:00.918394 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfcf31-e6fe-470e-a54d-592918d75a7c None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:00.962055 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e6498-937b-41fd-8456-296c67052161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:00.963296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e6498-937b-41fd-8456-296c67052161 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:00.963731 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e6498-937b-41fd-8456-296c67052161 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:00.964199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e6498-937b-41fd-8456-296c67052161 None admin] PATH_INFO: `/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:00.965668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e6498-937b-41fd-8456-296c67052161 None admin] RBAC: Authorizing `identity:get_group(group_id=b9ff32c0c6804a5e81910c436eb2ce9d)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:00.967368 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e6498-937b-41fd-8456-296c67052161 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:00.974033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 198/400] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jun 27 18:33:00 2022] GET /identity/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:00.975648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11338007-8065-48cb-b0a1-74ae6cb2ff73 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:00.976061 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11338007-8065-48cb-b0a1-74ae6cb2ff73 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:00.976452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11338007-8065-48cb-b0a1-74ae6cb2ff73 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:00.978705 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 199/401] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:00.979594 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11338007-8065-48cb-b0a1-74ae6cb2ff73 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:00.980960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 203/402] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:00.989311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62932d8-e067-4dd4-a428-24dec310fb37 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:00.989598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62932d8-e067-4dd4-a428-24dec310fb37 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:00.989877 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62932d8-e067-4dd4-a428-24dec310fb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:01.024231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-b62932d8-e067-4dd4-a428-24dec310fb37 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:01.025762 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b62932d8-e067-4dd4-a428-24dec310fb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:01.054401 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:01.108574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11338007-8065-48cb-b0a1-74ae6cb2ff73 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:01.111618 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 204/403] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:01.112507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62932d8-e067-4dd4-a428-24dec310fb37 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:01.158695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:01.162895 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b914edd-534d-4352-8664-553083e3985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:01.163816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b914edd-534d-4352-8664-553083e3985d None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:01.164101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b914edd-534d-4352-8664-553083e3985d None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:01.164398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b914edd-534d-4352-8664-553083e3985d None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:01.166310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b914edd-534d-4352-8664-553083e3985d None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:01.167981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b914edd-534d-4352-8664-553083e3985d None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:01.169924 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 200/404] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:33:00 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:01.170571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b914edd-534d-4352-8664-553083e3985d None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:01.238207 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62932d8-e067-4dd4-a428-24dec310fb37 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:01.274134 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82194e8d-cd25-47d8-8f5a-94f0dcc62067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:01.275480 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82194e8d-cd25-47d8-8f5a-94f0dcc62067 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:01.275796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82194e8d-cd25-47d8-8f5a-94f0dcc62067 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:01.276075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82194e8d-cd25-47d8-8f5a-94f0dcc62067 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:01.287255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82194e8d-cd25-47d8-8f5a-94f0dcc62067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:01.296324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-82194e8d-cd25-47d8-8f5a-94f0dcc62067 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:33:01.296324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:01.296324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:01.296324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:01.296324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:01.296324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:01.296324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:01.296324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:01.296324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:01.296324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:01.296324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:01.296324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:01.296324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:01.296324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:01.296324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:01.296324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:01.297203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:01.297203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:01.297203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:01.297203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:01.297203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:01.297203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:01.297203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:01.297203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:01.297203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:01.297203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:01.297203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:01.297203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:01.297203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:01.297203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:01.297203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:01.297203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:01.298019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:01.298019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:01.298019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:01.298019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:01.298019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:01.298019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:01.298019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:01.298019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:01.298019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:01.298019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:01.298019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:33:01.298019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:01.298019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 205/405] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:33:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:01.298682 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82194e8d-cd25-47d8-8f5a-94f0dcc62067 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:01.307241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b914edd-534d-4352-8664-553083e3985d None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:01.339116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:01.355298 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261339d-16c7-4b26-b749-3ef053917d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:01.357262 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261339d-16c7-4b26-b749-3ef053917d7e None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:01.357815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261339d-16c7-4b26-b749-3ef053917d7e None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:01.358486 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261339d-16c7-4b26-b749-3ef053917d7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:01.373844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261339d-16c7-4b26-b749-3ef053917d7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:01.384082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-0261339d-16c7-4b26-b749-3ef053917d7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:33:01.384082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:01.384082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:01.384082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:01.384082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:01.384082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:01.384082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:01.384082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:01.384082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:01.384082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:01.384082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:01.384082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:01.384082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:01.384082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:01.384082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:01.384082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:01.385524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:01.385524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:01.385524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:01.385524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:01.385524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:01.385524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:01.385524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:01.385524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:01.385524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:01.385524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:01.385524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:01.385524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:01.385524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:01.385524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:01.385524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:01.385524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:01.386360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:01.386360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:01.386360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:01.386360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:01.386360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:01.386360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:01.386360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:01.386360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:01.386360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:01.386360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:01.386360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:33:01.386360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:01.386360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 201/406] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:33:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:01.387008 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261339d-16c7-4b26-b749-3ef053917d7e None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:01.408151 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:01.419522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82194e8d-cd25-47d8-8f5a-94f0dcc62067 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:01.466008 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01900b-27c6-450e-b5ed-6554a7c11969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:01.466900 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01900b-27c6-450e-b5ed-6554a7c11969 None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:01.467184 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01900b-27c6-450e-b5ed-6554a7c11969 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:01.467979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01900b-27c6-450e-b5ed-6554a7c11969 None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71/groups/b9ff32c0c6804a5e81910c436eb2ce9d/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:01.470689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01900b-27c6-450e-b5ed-6554a7c11969 None admin] RBAC: Authorizing `identity:create_grant(project_id=36535f8090e64641b80e339c1590bf71, group_id=b9ff32c0c6804a5e81910c436eb2ce9d, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:01.472515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01900b-27c6-450e-b5ed-6554a7c11969 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:01.492902 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261339d-16c7-4b26-b749-3ef053917d7e None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:01.534435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6844e4e-05d3-4cc3-91fd-86919b15ac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:01.535104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6844e4e-05d3-4cc3-91fd-86919b15ac34 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:01.535391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6844e4e-05d3-4cc3-91fd-86919b15ac34 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:01.535702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6844e4e-05d3-4cc3-91fd-86919b15ac34 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:01.536445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6844e4e-05d3-4cc3-91fd-86919b15ac34 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:01.536850 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6844e4e-05d3-4cc3-91fd-86919b15ac34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:01.538168 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6844e4e-05d3-4cc3-91fd-86919b15ac34 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:01.551391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 202/407] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:01.551391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6844e4e-05d3-4cc3-91fd-86919b15ac34 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:01.579880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 206/408] 10.222.0.36 () {58 vars in 1442 bytes} [Mon Jun 27 18:33:01 2022] PUT /identity/v3/projects/36535f8090e64641b80e339c1590bf71/groups/b9ff32c0c6804a5e81910c436eb2ce9d/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:33:01.581235 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01900b-27c6-450e-b5ed-6554a7c11969 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:01.643961 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:01.762598 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6844e4e-05d3-4cc3-91fd-86919b15ac34 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:01.797325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01900b-27c6-450e-b5ed-6554a7c11969 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:01.803724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7ce09-33ab-472e-9e34-92df3ad5d3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:01.804398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7ce09-33ab-472e-9e34-92df3ad5d3c5 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:01.804781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7ce09-33ab-472e-9e34-92df3ad5d3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:01.805062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7ce09-33ab-472e-9e34-92df3ad5d3c5 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:01.806482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7ce09-33ab-472e-9e34-92df3ad5d3c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:01.806806 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7ce09-33ab-472e-9e34-92df3ad5d3c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:01.808987 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7ce09-33ab-472e-9e34-92df3ad5d3c5 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:01.819360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 203/409] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:33:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:01.820538 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486c8bb-c691-448e-8c21-33451ea72356 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:01.820827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486c8bb-c691-448e-8c21-33451ea72356 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:01.821107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486c8bb-c691-448e-8c21-33451ea72356 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:01.823055 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 204/410] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:01.831454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffb06d-906d-4562-8971-d5a5d2931720 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:01.831454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffb06d-906d-4562-8971-d5a5d2931720 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:01.831454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffb06d-906d-4562-8971-d5a5d2931720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:01.841592 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a3122-09cd-4fd6-af4b-bee473a9f621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:01.842599 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a3122-09cd-4fd6-af4b-bee473a9f621 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:01.842797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a3122-09cd-4fd6-af4b-bee473a9f621 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:01.843046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a3122-09cd-4fd6-af4b-bee473a9f621 None admin] PATH_INFO: `/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:01.844286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a3122-09cd-4fd6-af4b-bee473a9f621 None admin] RBAC: Authorizing `identity:get_group(group_id=b9ff32c0c6804a5e81910c436eb2ce9d)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:01.845721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a3122-09cd-4fd6-af4b-bee473a9f621 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:01.847586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 207/411] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jun 27 18:33:01 2022] GET /identity/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:01.847694 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-ebffb06d-906d-4562-8971-d5a5d2931720 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:01.848131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a3122-09cd-4fd6-af4b-bee473a9f621 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:01.848965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ebffb06d-906d-4562-8971-d5a5d2931720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:01.875607 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:01.943916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 205/412] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:01.945298 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffb06d-906d-4562-8971-d5a5d2931720 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:01.983073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a3122-09cd-4fd6-af4b-bee473a9f621 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:01.996955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:02.031337 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209477c3-682b-4d18-8598-ef905e775e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:02.032559 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209477c3-682b-4d18-8598-ef905e775e47 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:02.033040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209477c3-682b-4d18-8598-ef905e775e47 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:02.033938 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209477c3-682b-4d18-8598-ef905e775e47 None admin] PATH_INFO: `/v3/groups/5566d657c5854ce1b103e653b0e814a9` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:02.035988 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209477c3-682b-4d18-8598-ef905e775e47 None admin] RBAC: Authorizing `identity:get_group(group_id=5566d657c5854ce1b103e653b0e814a9)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:02.038143 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209477c3-682b-4d18-8598-ef905e775e47 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:02.041818 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 208/413] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jun 27 18:33:01 2022] GET /identity/v3/groups/5566d657c5854ce1b103e653b0e814a9 => generated 229 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:02.042923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209477c3-682b-4d18-8598-ef905e775e47 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:02.077094 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffb06d-906d-4562-8971-d5a5d2931720 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:02.122192 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212204a2-048e-4a52-a878-cd16d00e3911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:02.123401 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212204a2-048e-4a52-a878-cd16d00e3911 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:02.123913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212204a2-048e-4a52-a878-cd16d00e3911 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:02.124438 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212204a2-048e-4a52-a878-cd16d00e3911 None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:02.125959 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212204a2-048e-4a52-a878-cd16d00e3911 None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:02.127685 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212204a2-048e-4a52-a878-cd16d00e3911 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:02.129808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 206/414] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:33:01 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:02.130812 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212204a2-048e-4a52-a878-cd16d00e3911 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:02.147732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:02.161942 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209477c3-682b-4d18-8598-ef905e775e47 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:02.197138 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca2f34-d7f8-4f03-a339-31b8a4b61475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:02.198175 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca2f34-d7f8-4f03-a339-31b8a4b61475 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:02.198284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca2f34-d7f8-4f03-a339-31b8a4b61475 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:02.198472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca2f34-d7f8-4f03-a339-31b8a4b61475 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:02.211189 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca2f34-d7f8-4f03-a339-31b8a4b61475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:02.219903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-78ca2f34-d7f8-4f03-a339-31b8a4b61475 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:33:02.219903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:02.219903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:02.219903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:02.219903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:02.219903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:02.219903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:02.219903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:02.219903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:02.219903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:02.219903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:02.219903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:02.219903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:02.219903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:02.219903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:02.219903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:02.220923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:02.220923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:02.220923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:02.220923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:02.220923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:02.220923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:02.220923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:02.220923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:02.220923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:02.220923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:02.220923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:02.220923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:02.220923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:02.220923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:02.220923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:02.220923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:02.221732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:02.221732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:02.221732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:02.221732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:02.221732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:02.221732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:02.221732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:02.221732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:02.221732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:02.221732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:02.221732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:33:02.221732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:02.221732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 209/415] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:33:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:02.222405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca2f34-d7f8-4f03-a339-31b8a4b61475 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:02.251687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212204a2-048e-4a52-a878-cd16d00e3911 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:02.254293 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:02.289378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20974a1a-e890-4fb9-a9be-0614a35abb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:02.290741 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20974a1a-e890-4fb9-a9be-0614a35abb5e None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:02.291411 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20974a1a-e890-4fb9-a9be-0614a35abb5e None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:02.292276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20974a1a-e890-4fb9-a9be-0614a35abb5e None admin] PATH_INFO: `/v3/projects/1f3d89cc168b4f4880cd82876788b05f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:02.293625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20974a1a-e890-4fb9-a9be-0614a35abb5e None admin] RBAC: Authorizing `identity:get_project(project_id=1f3d89cc168b4f4880cd82876788b05f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:02.295347 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20974a1a-e890-4fb9-a9be-0614a35abb5e None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:02.297791 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 207/416] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:33:02 2022] GET /identity/v3/projects/1f3d89cc168b4f4880cd82876788b05f => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:02.298720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20974a1a-e890-4fb9-a9be-0614a35abb5e None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:02.332459 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca2f34-d7f8-4f03-a339-31b8a4b61475 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:02.369271 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b669b-01c7-4380-98c8-31fff6d20a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:02.370319 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b669b-01c7-4380-98c8-31fff6d20a6a None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:02.370689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b669b-01c7-4380-98c8-31fff6d20a6a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:02.371092 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b669b-01c7-4380-98c8-31fff6d20a6a None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71/groups/b9ff32c0c6804a5e81910c436eb2ce9d/roles/422c41a081a44a4e8b04f4d9ce6e8930` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:02.373532 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b669b-01c7-4380-98c8-31fff6d20a6a None admin] RBAC: Authorizing `identity:create_grant(project_id=36535f8090e64641b80e339c1590bf71, group_id=b9ff32c0c6804a5e81910c436eb2ce9d, role_id=422c41a081a44a4e8b04f4d9ce6e8930)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:02.375107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b669b-01c7-4380-98c8-31fff6d20a6a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:02.410586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20974a1a-e890-4fb9-a9be-0614a35abb5e None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:02.449124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a9888-5c00-4729-94f4-857595a7351a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:02.450152 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a9888-5c00-4729-94f4-857595a7351a None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:02.450695 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a9888-5c00-4729-94f4-857595a7351a None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:02.451188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a9888-5c00-4729-94f4-857595a7351a None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:02.452219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a9888-5c00-4729-94f4-857595a7351a None admin] RBAC: Adding query filter params (name=member) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:02.452739 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a9888-5c00-4729-94f4-857595a7351a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:02.454454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a9888-5c00-4729-94f4-857595a7351a None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:02.455817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 210/417] 10.222.0.36 () {58 vars in 1442 bytes} [Mon Jun 27 18:33:02 2022] PUT /identity/v3/projects/36535f8090e64641b80e339c1590bf71/groups/b9ff32c0c6804a5e81910c436eb2ce9d/roles/422c41a081a44a4e8b04f4d9ce6e8930 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:33:02.457509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b669b-01c7-4380-98c8-31fff6d20a6a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:02.467054 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 208/418] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:33:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:02.478926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:02.481443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a9888-5c00-4729-94f4-857595a7351a None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:02.546723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:02.582323 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b669b-01c7-4380-98c8-31fff6d20a6a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:02.619691 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922de050-1f8c-47c1-8f8f-d2c9884f7ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:02.622071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922de050-1f8c-47c1-8f8f-d2c9884f7ee6 None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:02.622071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922de050-1f8c-47c1-8f8f-d2c9884f7ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:02.622071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922de050-1f8c-47c1-8f8f-d2c9884f7ee6 None admin] PATH_INFO: `/v3/projects/1f3d89cc168b4f4880cd82876788b05f/groups/5566d657c5854ce1b103e653b0e814a9/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:02.623342 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922de050-1f8c-47c1-8f8f-d2c9884f7ee6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f3d89cc168b4f4880cd82876788b05f, group_id=5566d657c5854ce1b103e653b0e814a9, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:02.624993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922de050-1f8c-47c1-8f8f-d2c9884f7ee6 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:02.652552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a9888-5c00-4729-94f4-857595a7351a None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:02.697128 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f76d7-d53e-4497-bf56-ef3bed239a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:02.697788 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f76d7-d53e-4497-bf56-ef3bed239a4f None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:02.698077 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f76d7-d53e-4497-bf56-ef3bed239a4f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:02.698359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f76d7-d53e-4497-bf56-ef3bed239a4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:02.743740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 211/419] 10.222.0.36 () {58 vars in 1442 bytes} [Mon Jun 27 18:33:02 2022] PUT /identity/v3/projects/1f3d89cc168b4f4880cd82876788b05f/groups/5566d657c5854ce1b103e653b0e814a9/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:33:02.790015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f76d7-d53e-4497-bf56-ef3bed239a4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:02.792304 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f76d7-d53e-4497-bf56-ef3bed239a4f None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:02.829780 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:02.913754 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 209/420] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 27 18:33:02.915069 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922de050-1f8c-47c1-8f8f-d2c9884f7ee6 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:03.019566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:03.061358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922de050-1f8c-47c1-8f8f-d2c9884f7ee6 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:03.072852 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b61507-8c0e-4456-a790-dfb0743450d4 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:03.073144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b61507-8c0e-4456-a790-dfb0743450d4 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:03.073428 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b61507-8c0e-4456-a790-dfb0743450d4 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:03.075121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 210/421] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:03.080725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83c282-35b7-49ff-b9d7-d791474a64ae None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:03.080938 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83c282-35b7-49ff-b9d7-d791474a64ae None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:03.081219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83c282-35b7-49ff-b9d7-d791474a64ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:03.099734 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-1c83c282-35b7-49ff-b9d7-d791474a64ae None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:03.101362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-1c83c282-35b7-49ff-b9d7-d791474a64ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:03.112099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a81666-4373-4d69-a218-07eb347d5bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:03.112983 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a81666-4373-4d69-a218-07eb347d5bf0 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:03.113271 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a81666-4373-4d69-a218-07eb347d5bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:03.113553 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a81666-4373-4d69-a218-07eb347d5bf0 None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:03.119104 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a81666-4373-4d69-a218-07eb347d5bf0 None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:03.120745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a81666-4373-4d69-a218-07eb347d5bf0 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:03.122926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 212/422] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:33:02 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:03.128790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a81666-4373-4d69-a218-07eb347d5bf0 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:03.209262 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 211/423] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:03.258210 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83c282-35b7-49ff-b9d7-d791474a64ae None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:03.262683 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a81666-4373-4d69-a218-07eb347d5bf0 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:03.343997 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:03.344296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541efd5-ce86-4612-8bc4-586a7187a02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:03.345118 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541efd5-ce86-4612-8bc4-586a7187a02a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:03.345407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541efd5-ce86-4612-8bc4-586a7187a02a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:03.345703 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541efd5-ce86-4612-8bc4-586a7187a02a None admin] PATH_INFO: `/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:03.352283 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541efd5-ce86-4612-8bc4-586a7187a02a None admin] RBAC: Authorizing `identity:get_group(group_id=b9ff32c0c6804a5e81910c436eb2ce9d)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:03.354298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541efd5-ce86-4612-8bc4-586a7187a02a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:03.356365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 213/424] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jun 27 18:33:03 2022] GET /identity/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:03.363065 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541efd5-ce86-4612-8bc4-586a7187a02a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:03.380693 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:03.391328 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83c282-35b7-49ff-b9d7-d791474a64ae None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:03.452840 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7a9e3-991f-44a9-8207-3b602b280614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:03.453655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7a9e3-991f-44a9-8207-3b602b280614 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:03.453936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7a9e3-991f-44a9-8207-3b602b280614 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:03.454208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7a9e3-991f-44a9-8207-3b602b280614 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:03.473521 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7a9e3-991f-44a9-8207-3b602b280614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:03.482586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-7ed7a9e3-991f-44a9-8207-3b602b280614 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:33:03.482586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:03.482586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:03.482586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:03.482586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:03.482586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:03.482586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:03.482586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:03.482586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:03.482586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:03.482586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:03.482586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:03.482586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:03.482586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:03.482586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:03.482586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:03.483513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:03.483513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:03.483513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:03.483513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:03.483513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:03.483513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:03.483513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:03.483513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:03.483513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:03.483513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:03.483513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:03.483513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:03.483513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:03.483513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:03.483513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:03.483513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:03.484343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:03.484343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:03.484343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:03.484343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:03.484343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:03.484343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:03.484343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:03.484343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:03.484343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:03.484343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:03.484343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:33:03.484343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:03.484976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 212/425] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:33:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:03.491714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7a9e3-991f-44a9-8207-3b602b280614 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:03.609743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7a9e3-991f-44a9-8207-3b602b280614 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:03.635435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:03.637806 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541efd5-ce86-4612-8bc4-586a7187a02a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:03.653439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f47d0-c480-4640-8f0c-155ff08783f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:03.654118 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f47d0-c480-4640-8f0c-155ff08783f0 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:03.656166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f47d0-c480-4640-8f0c-155ff08783f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:03.656166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f47d0-c480-4640-8f0c-155ff08783f0 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:03.656166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f47d0-c480-4640-8f0c-155ff08783f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:03.656166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f47d0-c480-4640-8f0c-155ff08783f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:03.657113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f47d0-c480-4640-8f0c-155ff08783f0 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:03.676142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 213/426] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:03.681891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f47d0-c480-4640-8f0c-155ff08783f0 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:03.711628 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5b9e01-1e5f-4472-8e25-d0d92b1de0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:03.712954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b9e01-1e5f-4472-8e25-d0d92b1de0be None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:03.713393 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b9e01-1e5f-4472-8e25-d0d92b1de0be None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:03.713850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5b9e01-1e5f-4472-8e25-d0d92b1de0be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:03.714719 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b9e01-1e5f-4472-8e25-d0d92b1de0be None admin] RBAC: Adding query filter params (group.id=b9ff32c0c6804a5e81910c436eb2ce9d, role.id=5c4481f023774d67997d4ba28e07cff0, scope.project.id=7cdc86a10dd449abbc708408ab6b0d78) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:03.715046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b9e01-1e5f-4472-8e25-d0d92b1de0be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:03.717003 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5b9e01-1e5f-4472-8e25-d0d92b1de0be None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:03.735189 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 214/427] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jun 27 18:33:03 2022] GET /identity/v3/role_assignments?group.id=b9ff32c0c6804a5e81910c436eb2ce9d&scope.project.id=7cdc86a10dd449abbc708408ab6b0d78&role.id=5c4481f023774d67997d4ba28e07cff0 => generated 611 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:03.837242 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f47d0-c480-4640-8f0c-155ff08783f0 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:03.879355 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c53c0-4d36-489a-be0a-fe8b12b68e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:03.880042 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c53c0-4d36-489a-be0a-fe8b12b68e63 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:03.880338 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c53c0-4d36-489a-be0a-fe8b12b68e63 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:03.880614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c53c0-4d36-489a-be0a-fe8b12b68e63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:03.889970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f498f43-23ad-47ed-89c7-9f517530975e None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:03.890597 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f498f43-23ad-47ed-89c7-9f517530975e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:03.891181 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f498f43-23ad-47ed-89c7-9f517530975e None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:03.893114 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 215/428] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:33:03.901840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3a37a-89be-4f67-91f4-e1f27c516c76 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:03.902475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3a37a-89be-4f67-91f4-e1f27c516c76 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:03.902974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3a37a-89be-4f67-91f4-e1f27c516c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:03.933219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-f8e3a37a-89be-4f67-91f4-e1f27c516c76 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:03.935305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-f8e3a37a-89be-4f67-91f4-e1f27c516c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:03.951367 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:03.970404 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c53c0-4d36-489a-be0a-fe8b12b68e63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:03.972013 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096c53c0-4d36-489a-be0a-fe8b12b68e63 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:04.023174 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:04.030628 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 216/429] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:04.060582 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3a37a-89be-4f67-91f4-e1f27c516c76 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:04.112744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 214/430] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:33:04.118947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c53c0-4d36-489a-be0a-fe8b12b68e63 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:04.214093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3a37a-89be-4f67-91f4-e1f27c516c76 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:04.229266 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:04.247312 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c53c0-4d36-489a-be0a-fe8b12b68e63 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:04.261226 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5634f-58a0-465f-941c-0312e7d76456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:04.262378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5634f-58a0-465f-941c-0312e7d76456 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:04.262841 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5634f-58a0-465f-941c-0312e7d76456 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:04.263688 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5634f-58a0-465f-941c-0312e7d76456 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:04.277952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e5634f-58a0-465f-941c-0312e7d76456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:04.288418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-12e5634f-58a0-465f-941c-0312e7d76456 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:33:04.288418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:04.288418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:04.288418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:04.288418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:04.288418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:04.288418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:04.288418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:04.288418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:04.288418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:04.288418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:04.288418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:04.288418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:04.288418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:04.288418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:04.288418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:04.289311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:04.289311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:04.289311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:04.289311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:04.289311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:04.289311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:04.289311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:04.289311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:04.289311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:04.289311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:04.289311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:04.289311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:04.289311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:04.289311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:04.289311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:04.289311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:04.290102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:04.290102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:04.290102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:04.290102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:04.290102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:04.290102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:04.290102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:04.290102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:04.290102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:04.290102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:04.290102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 27 18:33:04.290102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:04.292679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 217/431] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:33:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:04.292792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829660d4-dec9-4e50-b93e-2490b5188b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:04.295552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829660d4-dec9-4e50-b93e-2490b5188b44 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:04.295552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829660d4-dec9-4e50-b93e-2490b5188b44 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:04.295552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829660d4-dec9-4e50-b93e-2490b5188b44 None admin] PATH_INFO: `/v3/projects/7cdc86a10dd449abbc708408ab6b0d78` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:04.295856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829660d4-dec9-4e50-b93e-2490b5188b44 None admin] RBAC: Authorizing `identity:get_project(project_id=7cdc86a10dd449abbc708408ab6b0d78)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:04.297406 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829660d4-dec9-4e50-b93e-2490b5188b44 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:04.299076 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5634f-58a0-465f-941c-0312e7d76456 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:04.299715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 215/432] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:33:04 2022] GET /identity/v3/projects/7cdc86a10dd449abbc708408ab6b0d78 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:04.304971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829660d4-dec9-4e50-b93e-2490b5188b44 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:04.380376 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:04.425908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829660d4-dec9-4e50-b93e-2490b5188b44 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:04.435288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5634f-58a0-465f-941c-0312e7d76456 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:04.466115 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72297853-5be7-46d1-ad2e-6b31adabec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:04.467255 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72297853-5be7-46d1-ad2e-6b31adabec3f None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:04.467635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72297853-5be7-46d1-ad2e-6b31adabec3f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:04.468018 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72297853-5be7-46d1-ad2e-6b31adabec3f None admin] PATH_INFO: `/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:04.469371 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72297853-5be7-46d1-ad2e-6b31adabec3f None admin] RBAC: Authorizing `identity:get_group(group_id=b9ff32c0c6804a5e81910c436eb2ce9d)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:04.471155 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72297853-5be7-46d1-ad2e-6b31adabec3f None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:04.473262 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 216/433] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jun 27 18:33:04 2022] GET /identity/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:04.479596 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72297853-5be7-46d1-ad2e-6b31adabec3f None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:04.480288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9105d7a-c7dd-4b27-84dc-cd8899c7666f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:04.481178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9105d7a-c7dd-4b27-84dc-cd8899c7666f None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:04.481639 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9105d7a-c7dd-4b27-84dc-cd8899c7666f None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:04.482346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9105d7a-c7dd-4b27-84dc-cd8899c7666f None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:04.483274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9105d7a-c7dd-4b27-84dc-cd8899c7666f None admin] RBAC: Adding query filter params (name=member) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:04.483797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9105d7a-c7dd-4b27-84dc-cd8899c7666f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:04.485678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9105d7a-c7dd-4b27-84dc-cd8899c7666f None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:04.498365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 218/434] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:33:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:04.504846 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9105d7a-c7dd-4b27-84dc-cd8899c7666f None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:04.513711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:04.608265 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72297853-5be7-46d1-ad2e-6b31adabec3f None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:04.644009 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9105d7a-c7dd-4b27-84dc-cd8899c7666f None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:04.655098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874906c6-a190-4a0c-8f3d-87f16ab426d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:04.656120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874906c6-a190-4a0c-8f3d-87f16ab426d5 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:04.656622 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874906c6-a190-4a0c-8f3d-87f16ab426d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:04.657113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874906c6-a190-4a0c-8f3d-87f16ab426d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:04.658143 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874906c6-a190-4a0c-8f3d-87f16ab426d5 None admin] RBAC: Adding query filter params (group.id=b9ff32c0c6804a5e81910c436eb2ce9d, role.id=422c41a081a44a4e8b04f4d9ce6e8930, scope.project.id=7cdc86a10dd449abbc708408ab6b0d78) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:04.658657 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874906c6-a190-4a0c-8f3d-87f16ab426d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:04.660343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874906c6-a190-4a0c-8f3d-87f16ab426d5 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:04.669280 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 217/435] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jun 27 18:33:04 2022] GET /identity/v3/role_assignments?group.id=b9ff32c0c6804a5e81910c436eb2ce9d&scope.project.id=7cdc86a10dd449abbc708408ab6b0d78&role.id=422c41a081a44a4e8b04f4d9ce6e8930 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:04.670646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:04.691509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708d8534-3542-40ab-9614-f4ed8a9e8d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:04.692460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d8534-3542-40ab-9614-f4ed8a9e8d6f None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:04.692897 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d8534-3542-40ab-9614-f4ed8a9e8d6f None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:04.693321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d8534-3542-40ab-9614-f4ed8a9e8d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:04.772527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d8534-3542-40ab-9614-f4ed8a9e8d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:04.774277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708d8534-3542-40ab-9614-f4ed8a9e8d6f None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:04.889324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 219/436] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:33:04.895324 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874906c6-a190-4a0c-8f3d-87f16ab426d5 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:04.992322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:05.008065 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874906c6-a190-4a0c-8f3d-87f16ab426d5 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:05.045208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c568228-b25a-4b3c-8aa6-fcc004254500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:05.046390 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c568228-b25a-4b3c-8aa6-fcc004254500 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:05.046681 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c568228-b25a-4b3c-8aa6-fcc004254500 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:05.046962 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c568228-b25a-4b3c-8aa6-fcc004254500 None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:05.047060 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cb8e5-cce8-49c6-b323-42e19921784f None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:05.047467 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cb8e5-cce8-49c6-b323-42e19921784f None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:05.047563 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cb8e5-cce8-49c6-b323-42e19921784f None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:05.048396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c568228-b25a-4b3c-8aa6-fcc004254500 None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:05.050072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c568228-b25a-4b3c-8aa6-fcc004254500 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:05.050181 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 220/437] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:05.052054 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 218/438] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:33:04 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:05.054521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66675fdb-b2b1-4046-a8ba-2739a377c612 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:05.054810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66675fdb-b2b1-4046-a8ba-2739a377c612 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:05.055089 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66675fdb-b2b1-4046-a8ba-2739a377c612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:05.057529 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c568228-b25a-4b3c-8aa6-fcc004254500 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:05.074070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-66675fdb-b2b1-4046-a8ba-2739a377c612 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:05.075278 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-66675fdb-b2b1-4046-a8ba-2739a377c612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:05.095327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:05.159173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 221/439] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:05.166864 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee84ce-475c-464e-be7b-34b680bebd13 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:05.167157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee84ce-475c-464e-be7b-34b680bebd13 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:05.167436 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee84ce-475c-464e-be7b-34b680bebd13 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:05.168784 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 222/440] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:33:05.173727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2009188-184f-4536-b9e1-e01aa23a2518 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:05.174013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2009188-184f-4536-b9e1-e01aa23a2518 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:05.174290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2009188-184f-4536-b9e1-e01aa23a2518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:05.185750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c568228-b25a-4b3c-8aa6-fcc004254500 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:05.192448 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-d2009188-184f-4536-b9e1-e01aa23a2518 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:05.193637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d2009188-184f-4536-b9e1-e01aa23a2518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:05.220709 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18228818-81f2-4749-a34d-60e7f3a8755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:05.221568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18228818-81f2-4749-a34d-60e7f3a8755b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:05.221854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18228818-81f2-4749-a34d-60e7f3a8755b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:05.222135 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18228818-81f2-4749-a34d-60e7f3a8755b None admin] PATH_INFO: `/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:05.223318 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18228818-81f2-4749-a34d-60e7f3a8755b None admin] RBAC: Authorizing `identity:get_group(group_id=b9ff32c0c6804a5e81910c436eb2ce9d)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:05.224782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18228818-81f2-4749-a34d-60e7f3a8755b None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:05.226393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 219/441] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jun 27 18:33:05 2022] GET /identity/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:05.227145 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18228818-81f2-4749-a34d-60e7f3a8755b None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:05.251671 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:05.263598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 223/442] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:05.264252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2009188-184f-4536-b9e1-e01aa23a2518 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:05.326858 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18228818-81f2-4749-a34d-60e7f3a8755b None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:05.342301 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:05.359442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d3832-9629-457e-aeb0-29fa0e6ba809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:05.360269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d3832-9629-457e-aeb0-29fa0e6ba809 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:05.360601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d3832-9629-457e-aeb0-29fa0e6ba809 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:05.360873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d3832-9629-457e-aeb0-29fa0e6ba809 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:05.361052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2009188-184f-4536-b9e1-e01aa23a2518 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:05.371386 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d3832-9629-457e-aeb0-29fa0e6ba809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:05.379562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-358d3832-9629-457e-aeb0-29fa0e6ba809 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:33:05.379562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:05.379562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:05.379562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:05.379562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:05.379562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:05.379562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:05.379562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:05.379562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:05.379562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:05.379562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:05.379562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:05.379562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:05.379562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:05.379562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:05.379562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:05.380541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:05.380541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:05.380541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:05.380541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:05.380541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:05.380541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:05.380541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:05.380541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:05.380541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:05.380541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:05.380541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:05.380541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:05.380541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:05.380541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:05.380541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:05.380541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:05.381395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:05.381395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:05.381395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:05.381395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:05.381395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:05.381395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:05.381395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:05.381395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:05.381395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:05.381395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:05.381395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:33:05.381395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:05.381395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 220/443] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:33:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:05.382125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d3832-9629-457e-aeb0-29fa0e6ba809 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:05.396611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70273d41-3150-420a-a2f3-66d22ac6ef14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:05.397273 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70273d41-3150-420a-a2f3-66d22ac6ef14 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:05.397570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70273d41-3150-420a-a2f3-66d22ac6ef14 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:05.397853 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70273d41-3150-420a-a2f3-66d22ac6ef14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:05.398688 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70273d41-3150-420a-a2f3-66d22ac6ef14 None admin] RBAC: Adding query filter params (group.id=b9ff32c0c6804a5e81910c436eb2ce9d, role.id=5c4481f023774d67997d4ba28e07cff0, scope.project.id=36535f8090e64641b80e339c1590bf71) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:05.399009 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70273d41-3150-420a-a2f3-66d22ac6ef14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:05.400532 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70273d41-3150-420a-a2f3-66d22ac6ef14 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:05.406211 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 224/444] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jun 27 18:33:05 2022] GET /identity/v3/role_assignments?group.id=b9ff32c0c6804a5e81910c436eb2ce9d&scope.project.id=36535f8090e64641b80e339c1590bf71&role.id=5c4481f023774d67997d4ba28e07cff0 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:05.406980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70273d41-3150-420a-a2f3-66d22ac6ef14 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:05.474475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:05.497066 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d3832-9629-457e-aeb0-29fa0e6ba809 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:05.520764 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70273d41-3150-420a-a2f3-66d22ac6ef14 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:05.537736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25a9cd-ca74-4431-b527-e4a7b642911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:05.538566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25a9cd-ca74-4431-b527-e4a7b642911e None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:05.538858 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25a9cd-ca74-4431-b527-e4a7b642911e None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:05.539144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25a9cd-ca74-4431-b527-e4a7b642911e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:05.551392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25a9cd-ca74-4431-b527-e4a7b642911e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:05.559388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-de25a9cd-ca74-4431-b527-e4a7b642911e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:33:05.559388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:05.559388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:05.559388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:05.559388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:05.559388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:05.559388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:05.559388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:05.559388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:05.559388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:05.559388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:05.559388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:05.559388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:05.559388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:05.559388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:05.559388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:05.560687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:05.560687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:05.560687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:05.560687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:05.560687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:05.560687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:05.560687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:05.560687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:05.560687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:05.560687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:05.560687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:05.560687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:05.560687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:05.560687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:05.560687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:05.560687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:05.561470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:05.561470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:05.561470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:05.561470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:05.561470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:05.561470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:05.561470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:05.561470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:05.561470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:05.561470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:05.561470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:33:05.561470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:05.561470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 221/445] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:33:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:05.565934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef79499-321d-4031-a89a-a9eb6fcc16e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:05.566638 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25a9cd-ca74-4431-b527-e4a7b642911e None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:05.566849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef79499-321d-4031-a89a-a9eb6fcc16e3 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:05.567103 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef79499-321d-4031-a89a-a9eb6fcc16e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:05.567374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef79499-321d-4031-a89a-a9eb6fcc16e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:05.568161 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef79499-321d-4031-a89a-a9eb6fcc16e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:05.568471 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef79499-321d-4031-a89a-a9eb6fcc16e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:05.569854 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef79499-321d-4031-a89a-a9eb6fcc16e3 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:05.582893 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 225/446] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:05.589960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef79499-321d-4031-a89a-a9eb6fcc16e3 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:05.599827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:05.687523 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25a9cd-ca74-4431-b527-e4a7b642911e None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:05.702274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef79499-321d-4031-a89a-a9eb6fcc16e3 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:05.730381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97a3ee-f900-49f0-a48d-74ec553443e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:05.731640 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97a3ee-f900-49f0-a48d-74ec553443e3 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:05.731640 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97a3ee-f900-49f0-a48d-74ec553443e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:05.731640 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97a3ee-f900-49f0-a48d-74ec553443e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:05.733161 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97a3ee-f900-49f0-a48d-74ec553443e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:05.733161 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97a3ee-f900-49f0-a48d-74ec553443e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:05.734323 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97a3ee-f900-49f0-a48d-74ec553443e3 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:05.744257 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 222/447] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:33:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:05.748299 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b7101-cf29-4976-9c81-137eba51ac5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:05.749051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b7101-cf29-4976-9c81-137eba51ac5e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:05.749407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b7101-cf29-4976-9c81-137eba51ac5e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:05.749759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b7101-cf29-4976-9c81-137eba51ac5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:05.750517 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97a3ee-f900-49f0-a48d-74ec553443e3 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:05.754384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:05.829701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b7101-cf29-4976-9c81-137eba51ac5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:05.831186 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b7101-cf29-4976-9c81-137eba51ac5e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:05.838763 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:05.855195 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97a3ee-f900-49f0-a48d-74ec553443e3 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:05.889414 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a1b8e-4e67-4f10-8bfe-519d8d1cbf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:05.890059 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a1b8e-4e67-4f10-8bfe-519d8d1cbf54 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:05.890342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a1b8e-4e67-4f10-8bfe-519d8d1cbf54 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:05.890627 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a1b8e-4e67-4f10-8bfe-519d8d1cbf54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:05.927456 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 226/448] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:33:05.933542 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b7101-cf29-4976-9c81-137eba51ac5e None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:05.958740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a1b8e-4e67-4f10-8bfe-519d8d1cbf54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:05.960270 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a1b8e-4e67-4f10-8bfe-519d8d1cbf54 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:05.962861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:06.028343 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b7101-cf29-4976-9c81-137eba51ac5e None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:06.035326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:06.056763 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 223/449] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:33:06.062199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a1b8e-4e67-4f10-8bfe-519d8d1cbf54 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:06.062765 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240825ae-0cdf-4250-89e3-0a53593ec0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:06.063654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240825ae-0cdf-4250-89e3-0a53593ec0da None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:06.063947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240825ae-0cdf-4250-89e3-0a53593ec0da None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:06.064228 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240825ae-0cdf-4250-89e3-0a53593ec0da None admin] PATH_INFO: `/v3/projects/36535f8090e64641b80e339c1590bf71` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:06.065412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240825ae-0cdf-4250-89e3-0a53593ec0da None admin] RBAC: Authorizing `identity:get_project(project_id=36535f8090e64641b80e339c1590bf71)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:06.066853 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240825ae-0cdf-4250-89e3-0a53593ec0da None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:06.068643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 227/450] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:33:05 2022] GET /identity/v3/projects/36535f8090e64641b80e339c1590bf71 => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:06.074108 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240825ae-0cdf-4250-89e3-0a53593ec0da None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:06.163990 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a1b8e-4e67-4f10-8bfe-519d8d1cbf54 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:06.166685 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:06.172469 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240825ae-0cdf-4250-89e3-0a53593ec0da None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:06.198000 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13343ce8-b4b0-492d-abec-6a8d59964dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:06.198849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13343ce8-b4b0-492d-abec-6a8d59964dea None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:06.199137 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13343ce8-b4b0-492d-abec-6a8d59964dea None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:06.199413 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13343ce8-b4b0-492d-abec-6a8d59964dea None admin] PATH_INFO: `/v3/projects/1f3d89cc168b4f4880cd82876788b05f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:06.200634 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13343ce8-b4b0-492d-abec-6a8d59964dea None admin] RBAC: Authorizing `identity:get_project(project_id=1f3d89cc168b4f4880cd82876788b05f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:06.202063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13343ce8-b4b0-492d-abec-6a8d59964dea None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:06.203922 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 224/451] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:33:06 2022] GET /identity/v3/projects/1f3d89cc168b4f4880cd82876788b05f => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:06.206353 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed784b-8297-4748-8c50-1c23801dcd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:06.207211 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed784b-8297-4748-8c50-1c23801dcd64 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:06.207500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed784b-8297-4748-8c50-1c23801dcd64 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:06.207810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fed784b-8297-4748-8c50-1c23801dcd64 None admin] PATH_INFO: `/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:06.208980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13343ce8-b4b0-492d-abec-6a8d59964dea None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:06.209091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed784b-8297-4748-8c50-1c23801dcd64 None admin] RBAC: Authorizing `identity:get_group(group_id=b9ff32c0c6804a5e81910c436eb2ce9d)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:06.210517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fed784b-8297-4748-8c50-1c23801dcd64 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:06.216841 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 228/452] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jun 27 18:33:06 2022] GET /identity/v3/groups/b9ff32c0c6804a5e81910c436eb2ce9d => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:06.217676 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed784b-8297-4748-8c50-1c23801dcd64 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:06.261192 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:06.307509 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13343ce8-b4b0-492d-abec-6a8d59964dea None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:06.317050 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fed784b-8297-4748-8c50-1c23801dcd64 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:06.341082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbfb28-0a35-4e14-9e57-6820da196735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:06.341939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbfb28-0a35-4e14-9e57-6820da196735 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:06.342225 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbfb28-0a35-4e14-9e57-6820da196735 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:06.342511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbbfb28-0a35-4e14-9e57-6820da196735 None admin] PATH_INFO: `/v3/groups/5566d657c5854ce1b103e653b0e814a9` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:06.343732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbfb28-0a35-4e14-9e57-6820da196735 None admin] RBAC: Authorizing `identity:get_group(group_id=5566d657c5854ce1b103e653b0e814a9)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:06.345173 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbbfb28-0a35-4e14-9e57-6820da196735 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:06.346789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 225/453] 10.222.0.36 () {56 vars in 1180 bytes} [Mon Jun 27 18:33:06 2022] GET /identity/v3/groups/5566d657c5854ce1b103e653b0e814a9 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:06.351718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de3d88c-6062-4cb6-a8de-05666d0b08cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:06.351718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3d88c-6062-4cb6-a8de-05666d0b08cc None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:06.351718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3d88c-6062-4cb6-a8de-05666d0b08cc None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:06.351718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de3d88c-6062-4cb6-a8de-05666d0b08cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:06.352036 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3d88c-6062-4cb6-a8de-05666d0b08cc None admin] RBAC: Adding query filter params (group.id=b9ff32c0c6804a5e81910c436eb2ce9d, role.id=422c41a081a44a4e8b04f4d9ce6e8930, scope.project.id=36535f8090e64641b80e339c1590bf71) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:06.352209 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3d88c-6062-4cb6-a8de-05666d0b08cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:06.352370 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbfb28-0a35-4e14-9e57-6820da196735 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:06.354255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de3d88c-6062-4cb6-a8de-05666d0b08cc None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:06.364761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 229/454] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jun 27 18:33:06 2022] GET /identity/v3/role_assignments?group.id=b9ff32c0c6804a5e81910c436eb2ce9d&scope.project.id=36535f8090e64641b80e339c1590bf71&role.id=422c41a081a44a4e8b04f4d9ce6e8930 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:06.396579 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:06.456748 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbbfb28-0a35-4e14-9e57-6820da196735 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:06.492336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ff8e0-c733-4a41-b5ff-1641cbb16300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:06.493002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ff8e0-c733-4a41-b5ff-1641cbb16300 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:06.493318 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ff8e0-c733-4a41-b5ff-1641cbb16300 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:06.493596 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ff8e0-c733-4a41-b5ff-1641cbb16300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:06.494431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ff8e0-c733-4a41-b5ff-1641cbb16300 None admin] RBAC: Adding query filter params (group.id=5566d657c5854ce1b103e653b0e814a9, role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=1f3d89cc168b4f4880cd82876788b05f) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:06.494746 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ff8e0-c733-4a41-b5ff-1641cbb16300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:06.496227 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2ff8e0-c733-4a41-b5ff-1641cbb16300 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:06.502465 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 226/455] 10.222.0.36 () {56 vars in 1376 bytes} [Mon Jun 27 18:33:06 2022] GET /identity/v3/role_assignments?group.id=5566d657c5854ce1b103e653b0e814a9&scope.project.id=1f3d89cc168b4f4880cd82876788b05f&role.id=b156409c977248e1b23c26e589b1e04f => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:09.158103 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06da1e6-7bc0-4e1a-8d1f-70ee6c0342d4 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:09.159163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06da1e6-7bc0-4e1a-8d1f-70ee6c0342d4 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:09.159689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06da1e6-7bc0-4e1a-8d1f-70ee6c0342d4 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:09.161518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 230/456] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:09.167152 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98bbbf-6ec4-4d18-a1f7-cc0229bc5b39 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:09.167591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98bbbf-6ec4-4d18-a1f7-cc0229bc5b39 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:09.167770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98bbbf-6ec4-4d18-a1f7-cc0229bc5b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:09.189742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-ad98bbbf-6ec4-4d18-a1f7-cc0229bc5b39 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:09.190962 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ad98bbbf-6ec4-4d18-a1f7-cc0229bc5b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:09.263805 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 227/457] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:09.269134 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82e7d9-13af-4405-a985-c43e48532bbc None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:09.269665 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82e7d9-13af-4405-a985-c43e48532bbc None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:09.270181 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82e7d9-13af-4405-a985-c43e48532bbc None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:09.272212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 231/458] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:09.281460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d88e2-2144-479e-8d22-e5a5fbc6f08e None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:09.281761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d88e2-2144-479e-8d22-e5a5fbc6f08e None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:09.282033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d88e2-2144-479e-8d22-e5a5fbc6f08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:09.292723 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82e7d9-13af-4405-a985-c43e48532bbc None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:09.309373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-671d88e2-2144-479e-8d22-e5a5fbc6f08e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:09.310573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-671d88e2-2144-479e-8d22-e5a5fbc6f08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:09.344002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:09.402021 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 228/459] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:09.403666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71b634-a548-4864-87b7-878c23311bdf None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:09.404748 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71b634-a548-4864-87b7-878c23311bdf None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:09.405090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71b634-a548-4864-87b7-878c23311bdf None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:09.406479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 229/460] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:09.413602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc665d-8b3d-4e6e-92fd-59fe68fd099c None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:09.413845 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc665d-8b3d-4e6e-92fd-59fe68fd099c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:09.414131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc665d-8b3d-4e6e-92fd-59fe68fd099c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:09.434921 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-cccc665d-8b3d-4e6e-92fd-59fe68fd099c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:09.437070 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-cccc665d-8b3d-4e6e-92fd-59fe68fd099c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:09.448035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82e7d9-13af-4405-a985-c43e48532bbc None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:09.456723 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:09.485380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3534c-5afe-41ac-941d-fad5c77a2cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:09.487513 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3534c-5afe-41ac-941d-fad5c77a2cf6 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:09.488037 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3534c-5afe-41ac-941d-fad5c77a2cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:09.488540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3534c-5afe-41ac-941d-fad5c77a2cf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:09.500067 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3534c-5afe-41ac-941d-fad5c77a2cf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:09.501775 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3534c-5afe-41ac-941d-fad5c77a2cf6 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:09.526354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 230/461] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:33:09.526354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc665d-8b3d-4e6e-92fd-59fe68fd099c None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:09.529678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-a8c3534c-5afe-41ac-941d-fad5c77a2cf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:09.529678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:09.529678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:09.529678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:09.529678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:09.529678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:09.529678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:09.529678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:09.529678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:09.529678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:09.529678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:09.529678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:09.529678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:09.529678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:09.529678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:09.530522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:09.530522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:09.530522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:09.530522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:09.530522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:09.530522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:09.530522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:09.530522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:09.530522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:09.530522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:09.530522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:09.530522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:09.530522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:09.530522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:09.530522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:09.530522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:09.530522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:09.531371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:09.531371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:09.531371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:09.531371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:09.533544 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 232/462] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:09.544771 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3534c-5afe-41ac-941d-fad5c77a2cf6 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:09.631762 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:09.640362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc665d-8b3d-4e6e-92fd-59fe68fd099c None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:09.653918 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3534c-5afe-41ac-941d-fad5c77a2cf6 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:09.679703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38879b-75c4-4c6a-8ac0-7f0d10000da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:09.680449 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38879b-75c4-4c6a-8ac0-7f0d10000da7 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:09.681260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38879b-75c4-4c6a-8ac0-7f0d10000da7 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:09.681693 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38879b-75c4-4c6a-8ac0-7f0d10000da7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:09.688941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcbf482-e9d0-4e36-954a-8b5d33f2c947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:09.689591 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbf482-e9d0-4e36-954a-8b5d33f2c947 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:09.689880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbf482-e9d0-4e36-954a-8b5d33f2c947 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:09.690153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcbf482-e9d0-4e36-954a-8b5d33f2c947 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:09.690871 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbf482-e9d0-4e36-954a-8b5d33f2c947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:09.691179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbf482-e9d0-4e36-954a-8b5d33f2c947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:09.692469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38879b-75c4-4c6a-8ac0-7f0d10000da7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:09.692600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcbf482-e9d0-4e36-954a-8b5d33f2c947 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:09.694203 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38879b-75c4-4c6a-8ac0-7f0d10000da7 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:09.704464 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 233/463] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:09.705637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550b765-d14a-4ad1-91e6-781e1e7fdb09 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:09.705927 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550b765-d14a-4ad1-91e6-781e1e7fdb09 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:09.706204 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550b765-d14a-4ad1-91e6-781e1e7fdb09 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:09.707561 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 234/464] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:09.712084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550b765-d14a-4ad1-91e6-781e1e7fdb09 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:09.719562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-da38879b-75c4-4c6a-8ac0-7f0d10000da7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:09.719562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:09.719562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:09.719562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:09.719562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:09.719562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:09.719562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:09.719562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:09.719562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:09.719562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:09.719562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:09.719562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:09.719562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:09.719562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:09.719562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:09.720439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:09.720439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:09.720439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:09.720439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:09.720439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:09.720439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:09.720439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:09.720439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:09.720439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:09.720439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:09.720439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:09.720439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:09.720439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:09.720439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:09.720439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:09.720439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:09.720439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:09.721294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:09.721294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:09.721294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:09.721294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:09.721294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 231/465] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:09.721574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38879b-75c4-4c6a-8ac0-7f0d10000da7 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:09.737674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:09.825468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550b765-d14a-4ad1-91e6-781e1e7fdb09 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:09.826194 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38879b-75c4-4c6a-8ac0-7f0d10000da7 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:09.860416 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb81975-06f2-43c8-8dbb-cf4208775c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:09.861224 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb81975-06f2-43c8-8dbb-cf4208775c14 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:09.861517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb81975-06f2-43c8-8dbb-cf4208775c14 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:09.861823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb81975-06f2-43c8-8dbb-cf4208775c14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:09.864654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1acadd-8486-4489-a50e-798790f4e449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:09.865312 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1acadd-8486-4489-a50e-798790f4e449 None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:09.865597 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1acadd-8486-4489-a50e-798790f4e449 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:09.865875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1acadd-8486-4489-a50e-798790f4e449 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:09.866573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1acadd-8486-4489-a50e-798790f4e449 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:09.868630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1acadd-8486-4489-a50e-798790f4e449 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:09.873564 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb81975-06f2-43c8-8dbb-cf4208775c14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:09.875041 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb81975-06f2-43c8-8dbb-cf4208775c14 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:09.892861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-2eb81975-06f2-43c8-8dbb-cf4208775c14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:09.892861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:09.892861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:09.892861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:09.892861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:09.892861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:09.892861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:09.892861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:09.892861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:09.892861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:09.892861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:09.892861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:09.892861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:09.892861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:09.892861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:09.893888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:09.893888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:09.893888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:09.893888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:09.893888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:09.893888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:09.893888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:09.893888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:09.893888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:09.893888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:09.893888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:09.893888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:09.893888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:09.893888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:09.893888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:09.893888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:09.893888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:09.894797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:09.894797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:09.894797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:09.894797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:09.894797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 235/466] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:09.895281 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e7a4b-b2bb-4dae-982b-4742dd3bdab2 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:09.895522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e7a4b-b2bb-4dae-982b-4742dd3bdab2 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:09.895821 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0e7a4b-b2bb-4dae-982b-4742dd3bdab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:09.912558 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-ff0e7a4b-b2bb-4dae-982b-4742dd3bdab2 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:09.913731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ff0e7a4b-b2bb-4dae-982b-4742dd3bdab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:09.975772 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:09.980921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 236/467] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:09.981562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e7a4b-b2bb-4dae-982b-4742dd3bdab2 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:09.987807 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 232/468] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:33:09 2022] POST /identity/v3/users => generated 246 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:33:09.990134 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1acadd-8486-4489-a50e-798790f4e449 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:09.993978 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:10.124352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0e7a4b-b2bb-4dae-982b-4742dd3bdab2 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:10.132748 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1acadd-8486-4489-a50e-798790f4e449 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:10.166040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc9c9a-7eb6-4104-ab08-fb906ee9c1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:10.167383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc9c9a-7eb6-4104-ab08-fb906ee9c1b2 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:10.167865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc9c9a-7eb6-4104-ab08-fb906ee9c1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:10.168289 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc9c9a-7eb6-4104-ab08-fb906ee9c1b2 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:10.169158 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc9c9a-7eb6-4104-ab08-fb906ee9c1b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:10.169611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc9c9a-7eb6-4104-ab08-fb906ee9c1b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:10.171145 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc9c9a-7eb6-4104-ab08-fb906ee9c1b2 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:10.171319 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60ece1-54e0-4110-a502-d267a113c215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:10.172019 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60ece1-54e0-4110-a502-d267a113c215 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:10.172303 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60ece1-54e0-4110-a502-d267a113c215 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:10.172579 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60ece1-54e0-4110-a502-d267a113c215 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:10.173301 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60ece1-54e0-4110-a502-d267a113c215 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:10.173617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60ece1-54e0-4110-a502-d267a113c215 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:10.175158 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60ece1-54e0-4110-a502-d267a113c215 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:10.185080 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 237/469] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:10.186233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc9c9a-7eb6-4104-ab08-fb906ee9c1b2 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:10.193606 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 233/470] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:10.194412 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60ece1-54e0-4110-a502-d267a113c215 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:10.257824 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:10.274057 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:10.305287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc9c9a-7eb6-4104-ab08-fb906ee9c1b2 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:10.327059 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60ece1-54e0-4110-a502-d267a113c215 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:10.341170 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394e1be-7ac2-4b1e-a00a-9665428e32d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:10.342254 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394e1be-7ac2-4b1e-a00a-9665428e32d7 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:10.342543 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394e1be-7ac2-4b1e-a00a-9665428e32d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:10.342822 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394e1be-7ac2-4b1e-a00a-9665428e32d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:10.359688 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394e1be-7ac2-4b1e-a00a-9665428e32d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:10.361683 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b394e1be-7ac2-4b1e-a00a-9665428e32d7 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:10.370236 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321db26e-09ca-464f-bfab-c34b2ee2c844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:10.370915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321db26e-09ca-464f-bfab-c34b2ee2c844 None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:10.371200 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321db26e-09ca-464f-bfab-c34b2ee2c844 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:10.371480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321db26e-09ca-464f-bfab-c34b2ee2c844 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:10.372238 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321db26e-09ca-464f-bfab-c34b2ee2c844 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:10.373688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321db26e-09ca-464f-bfab-c34b2ee2c844 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:10.380445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-b394e1be-7ac2-4b1e-a00a-9665428e32d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:10.380445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:10.380445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:10.380445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:10.380445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:10.380445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:10.380445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:10.380445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:10.380445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:10.380445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:10.380445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:10.380445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:10.380445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:10.380445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:10.380445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:10.381284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:10.381284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:10.381284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:10.381284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:10.381284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:10.381284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:10.381284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:10.381284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:10.381284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:10.381284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:10.381284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:10.381284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:10.381284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:10.381284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:10.381284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:10.381284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:10.381284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:10.382141 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:10.382141 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:10.382141 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:10.382141 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:10.382141 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 238/471] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:10.382399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394e1be-7ac2-4b1e-a00a-9665428e32d7 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:10.447706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 234/472] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:33:10 2022] POST /identity/v3/users => generated 248 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:33:10.449005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527bd3-a692-4752-a35b-ac871fd017c3 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:10.449296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527bd3-a692-4752-a35b-ac871fd017c3 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:10.449577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527bd3-a692-4752-a35b-ac871fd017c3 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:10.455444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 235/473] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:10.455444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb527bd3-a692-4752-a35b-ac871fd017c3 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:10.509876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b394e1be-7ac2-4b1e-a00a-9665428e32d7 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:10.530085 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:10.553853 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fa23c-1e6f-44d3-9ea8-11b57041151b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:10.554737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fa23c-1e6f-44d3-9ea8-11b57041151b None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:10.555076 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fa23c-1e6f-44d3-9ea8-11b57041151b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:10.555300 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fa23c-1e6f-44d3-9ea8-11b57041151b None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:10.556671 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fa23c-1e6f-44d3-9ea8-11b57041151b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:10.558135 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fa23c-1e6f-44d3-9ea8-11b57041151b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:10.600893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb527bd3-a692-4752-a35b-ac871fd017c3 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:10.621942 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:10.638762 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524db11c-dafc-49ee-af2d-72a6c69c8338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:10.639436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524db11c-dafc-49ee-af2d-72a6c69c8338 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:10.639757 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524db11c-dafc-49ee-af2d-72a6c69c8338 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:10.640040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524db11c-dafc-49ee-af2d-72a6c69c8338 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:10.640880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524db11c-dafc-49ee-af2d-72a6c69c8338 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:10.641194 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524db11c-dafc-49ee-af2d-72a6c69c8338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:10.642597 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524db11c-dafc-49ee-af2d-72a6c69c8338 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:10.657684 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 236/474] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:10.668790 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503995f6-e59b-4402-97ba-ea268449cf10 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:10.668790 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503995f6-e59b-4402-97ba-ea268449cf10 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:10.668790 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503995f6-e59b-4402-97ba-ea268449cf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:10.669032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 239/475] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:33:10 2022] POST /identity/v3/users => generated 248 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:33:10.669032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fa23c-1e6f-44d3-9ea8-11b57041151b None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:10.692768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-503995f6-e59b-4402-97ba-ea268449cf10 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:10.694741 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-503995f6-e59b-4402-97ba-ea268449cf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:10.806331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 237/476] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:10.832616 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503995f6-e59b-4402-97ba-ea268449cf10 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:10.842084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fa23c-1e6f-44d3-9ea8-11b57041151b None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:10.891435 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f542e-f6d0-44c9-939a-859deccfb23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:10.892175 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f542e-f6d0-44c9-939a-859deccfb23a None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:10.892499 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f542e-f6d0-44c9-939a-859deccfb23a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:10.892713 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f542e-f6d0-44c9-939a-859deccfb23a None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:10.893428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f542e-f6d0-44c9-939a-859deccfb23a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:10.894876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4f542e-f6d0-44c9-939a-859deccfb23a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:10.952146 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503995f6-e59b-4402-97ba-ea268449cf10 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:10.962693 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:10.989715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e383d-0254-41d3-96de-f36e96db0ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:10.990394 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e383d-0254-41d3-96de-f36e96db0ba5 None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:10.990727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e383d-0254-41d3-96de-f36e96db0ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:10.991007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e383d-0254-41d3-96de-f36e96db0ba5 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:10.991787 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e383d-0254-41d3-96de-f36e96db0ba5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:10.993197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e383d-0254-41d3-96de-f36e96db0ba5 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:11.027096 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 240/477] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:33:10 2022] POST /identity/v3/users => generated 249 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:33:11.042196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.sql.core [None req-5e5e383d-0254-41d3-96de-f36e96db0ba5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 27 18:33:11.042196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 27 18:33:11.042196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [parameters: {'id': '3fc95e25706d49198f50698d2a6c4df1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 27 18:33:11.042196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86869) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 27 18:33:11.063887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-5e5e383d-0254-41d3-96de-f36e96db0ba5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 27 18:33:11.063887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:11.063887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 18:33:11.063887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 18:33:11.063887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 18:33:11.063887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 18:33:11.063887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 18:33:11.063887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 18:33:11.063887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 18:33:11.063887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application conn.query(q) Jun 27 18:33:11.063887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 18:33:11.063887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 18:33:11.063887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 18:33:11.063887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application result.read() Jun 27 18:33:11.063887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return ref.to_dict() Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 18:33:11.064814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application next(self.gen) Jun 27 18:33:11.065999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 27 18:33:11.065999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application yield resource Jun 27 18:33:11.065999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 18:33:11.065999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application next(self.gen) Jun 27 18:33:11.065999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 27 18:33:11.065999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self.session.rollback() Jun 27 18:33:11.065999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 27 18:33:11.065999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self.force_reraise() Jun 27 18:33:11.065999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 27 18:33:11.065999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise self.value Jun 27 18:33:11.065999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 27 18:33:11.065999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 27 18:33:11.065999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 27 18:33:11.065999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application session.commit() Jun 27 18:33:11.065999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 27 18:33:11.065999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 27 18:33:11.065999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 27 18:33:11.067006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._prepare_impl() Jun 27 18:33:11.067006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 27 18:33:11.067006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self.session.flush() Jun 27 18:33:11.067006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 27 18:33:11.067006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._flush(objects) Jun 27 18:33:11.067006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 27 18:33:11.067006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 27 18:33:11.067006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 27 18:33:11.067006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application compat.raise_( Jun 27 18:33:11.067006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 18:33:11.067006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception Jun 27 18:33:11.067006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 27 18:33:11.067006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application flush_context.execute() Jun 27 18:33:11.067006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 27 18:33:11.067006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rec.execute(self) Jun 27 18:33:11.067006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 27 18:33:11.067006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 27 18:33:11.068503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 27 18:33:11.068503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 27 18:33:11.068503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 27 18:33:11.068503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 27 18:33:11.068503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 27 18:33:11.068503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 27 18:33:11.068503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 27 18:33:11.068503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 27 18:33:11.068503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 27 18:33:11.068503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 27 18:33:11.068503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 27 18:33:11.068503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 27 18:33:11.068503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 27 18:33:11.068503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 27 18:33:11.068503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 18:33:11.068503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception Jun 27 18:33:11.069316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 18:33:11.069316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 18:33:11.069316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 18:33:11.069316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 18:33:11.069316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 18:33:11.069316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 18:33:11.069316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 18:33:11.069316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application conn.query(q) Jun 27 18:33:11.069316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 18:33:11.069316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 18:33:11.069316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 18:33:11.069316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application result.read() Jun 27 18:33:11.069316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 18:33:11.069316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 18:33:11.069316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 18:33:11.069316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 18:33:11.071296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 18:33:11.071296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 18:33:11.071296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 18:33:11.071296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 18:33:11.071296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 27 18:33:11.071296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 27 18:33:11.071296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [parameters: {'id': '3fc95e25706d49198f50698d2a6c4df1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 27 18:33:11.071296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 27 18:33:11.071296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:11.071296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:33:11.071296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:11.071296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:11.071296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:11.071296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:11.071296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:11.071296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:11.073363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:11.073363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:11.073363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:11.073363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:11.073363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:11.073363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:11.073363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 27 18:33:11.073363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 27 18:33:11.073363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:11.073363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:11.073363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 27 18:33:11.073363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 27 18:33:11.073363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 27 18:33:11.073363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 27 18:33:11.073363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 27 18:33:11.073363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:11.077931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 238/478] 10.222.0.36 () {60 vars in 1131 bytes} [Mon Jun 27 18:33:10 2022] POST /identity/v3/roles => generated 144 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:11.078074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f542e-f6d0-44c9-939a-859deccfb23a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:11.118274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:11.205115 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f542e-f6d0-44c9-939a-859deccfb23a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:11.242230 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871735d-d2f5-41df-87e3-c473de15bcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:11.243150 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871735d-d2f5-41df-87e3-c473de15bcce None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:11.243452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871735d-d2f5-41df-87e3-c473de15bcce None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:11.243774 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871735d-d2f5-41df-87e3-c473de15bcce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:11.256949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871735d-d2f5-41df-87e3-c473de15bcce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:11.266119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-8871735d-d2f5-41df-87e3-c473de15bcce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:33:11.266119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:11.266119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:11.266119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:11.266119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:11.266119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:11.266119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:11.266119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:11.266119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:11.266119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:11.266119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:11.266119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:11.266119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:11.266119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:11.266119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:11.266119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:11.267110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:11.267110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:11.267110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:11.267110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:11.267110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:11.267110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:11.267110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:11.267110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:11.267110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:11.267110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:11.267110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:11.267110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:11.267110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:11.267110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:11.267110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:11.267110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:11.268240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:11.268240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:11.268240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:11.268240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:11.268240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:11.268240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:11.268240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:11.268240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:11.268240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:11.268240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:11.268240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 27 18:33:11.268240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:11.268240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 241/479] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:33:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:11.273453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e383d-0254-41d3-96de-f36e96db0ba5 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:11.389345 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e383d-0254-41d3-96de-f36e96db0ba5 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:11.429808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a0755-7cf8-4e54-80d3-c6cdb6918855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:11.431036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a0755-7cf8-4e54-80d3-c6cdb6918855 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:11.431325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a0755-7cf8-4e54-80d3-c6cdb6918855 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:11.431629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a0755-7cf8-4e54-80d3-c6cdb6918855 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:11.432387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a0755-7cf8-4e54-80d3-c6cdb6918855 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:11.432700 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a0755-7cf8-4e54-80d3-c6cdb6918855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:11.434087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a0755-7cf8-4e54-80d3-c6cdb6918855 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:11.442669 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 239/480] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:12.310214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f7b70-cb62-45dc-b8b4-9f61663c2115 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:12.310739 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f7b70-cb62-45dc-b8b4-9f61663c2115 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:12.310815 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f7b70-cb62-45dc-b8b4-9f61663c2115 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:12.312613 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 242/481] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:12.323704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d585db-0d1e-47e7-a578-1717cc0dad2b None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:12.324173 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d585db-0d1e-47e7-a578-1717cc0dad2b None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:12.324247 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d585db-0d1e-47e7-a578-1717cc0dad2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:12.350105 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-05d585db-0d1e-47e7-a578-1717cc0dad2b None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:12.351319 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-05d585db-0d1e-47e7-a578-1717cc0dad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:12.379602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:12.427995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 240/482] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:12.464055 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f7b70-cb62-45dc-b8b4-9f61663c2115 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:12.584924 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:12.610569 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f7b70-cb62-45dc-b8b4-9f61663c2115 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:12.660406 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7622e9-5215-4fe7-9e93-97f40e005538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:12.661216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7622e9-5215-4fe7-9e93-97f40e005538 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:12.661506 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7622e9-5215-4fe7-9e93-97f40e005538 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:12.661789 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7622e9-5215-4fe7-9e93-97f40e005538 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:12.681040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7622e9-5215-4fe7-9e93-97f40e005538 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:12.688980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-9d7622e9-5215-4fe7-9e93-97f40e005538 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:12.688980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:12.688980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:12.688980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:12.688980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:12.688980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:12.688980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:12.688980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:12.688980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:12.688980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:12.688980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:12.688980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:12.688980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:12.688980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:12.688980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:12.688980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:12.689870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:12.689870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:12.689870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:12.689870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:12.689870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:12.689870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:12.689870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:12.689870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:12.689870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:12.689870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:12.689870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:12.689870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:12.689870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:12.689870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:12.689870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:12.689870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:12.690890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:12.690890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:12.690890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:12.690890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:12.690890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:12.690890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:12.690890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:12.690890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:12.690890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:12.690890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:12.690890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:12.690890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:12.690890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 243/483] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:12.696140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d585db-0d1e-47e7-a578-1717cc0dad2b None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:12.847435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d585db-0d1e-47e7-a578-1717cc0dad2b None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:12.894752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6ebcb-2721-4a25-ac75-3cbbfda2d9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:12.895428 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6ebcb-2721-4a25-ac75-3cbbfda2d9eb None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:12.895741 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6ebcb-2721-4a25-ac75-3cbbfda2d9eb None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:12.896022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6ebcb-2721-4a25-ac75-3cbbfda2d9eb None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:12.896784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6ebcb-2721-4a25-ac75-3cbbfda2d9eb None admin] RBAC: Adding query filter params (name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:12.897094 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6ebcb-2721-4a25-ac75-3cbbfda2d9eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:12.898487 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6ebcb-2721-4a25-ac75-3cbbfda2d9eb None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:12.914040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 241/484] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:12.919953 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7622e9-5215-4fe7-9e93-97f40e005538 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:13.087502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7622e9-5215-4fe7-9e93-97f40e005538 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:13.166725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412146b-a8de-4850-9b76-7048497e012a None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:13.167015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412146b-a8de-4850-9b76-7048497e012a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:13.167210 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412146b-a8de-4850-9b76-7048497e012a None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:13.168926 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 242/485] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:33:13.174307 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85837c02-ab0f-42b7-9859-970a73fd0d96 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:13.174593 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85837c02-ab0f-42b7-9859-970a73fd0d96 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:13.174871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85837c02-ab0f-42b7-9859-970a73fd0d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:13.193683 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfba405-b01d-4251-9976-9908d2192bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:13.194540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfba405-b01d-4251-9976-9908d2192bbf None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:13.194823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfba405-b01d-4251-9976-9908d2192bbf None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:13.195094 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfba405-b01d-4251-9976-9908d2192bbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:13.196555 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-85837c02-ab0f-42b7-9859-970a73fd0d96 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:13.197808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-85837c02-ab0f-42b7-9859-970a73fd0d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:13.209598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfba405-b01d-4251-9976-9908d2192bbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:13.211077 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfba405-b01d-4251-9976-9908d2192bbf None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:13.215629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:13.232179 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:13.235086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-7bfba405-b01d-4251-9976-9908d2192bbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:13.235086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:13.235086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:13.235086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:13.235086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:13.235086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:13.235086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:13.235086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:13.235086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:13.235086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:13.235086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:13.235086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:13.235086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:13.235086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:13.235086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:13.239102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:13.239102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:13.239102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:13.239102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:13.239102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:13.239102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:13.239102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:13.239102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:13.239102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:13.239102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:13.239102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:13.239102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:13.239102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:13.239102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:13.239102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:13.239102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:13.239102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:13.239986 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:13.239986 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:13.239986 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:13.239986 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:13.239986 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 244/486] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:13.239986 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0511b9-9979-4811-a9e2-5ab5b32e7148 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:13.239986 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0511b9-9979-4811-a9e2-5ab5b32e7148 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:13.239986 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0511b9-9979-4811-a9e2-5ab5b32e7148 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:13.244560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 245/487] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:13.245514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0511b9-9979-4811-a9e2-5ab5b32e7148 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:13.359289 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0511b9-9979-4811-a9e2-5ab5b32e7148 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:13.371986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 243/488] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jun 27 18:33:13.373786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aeb2e4-4889-4ddd-8669-d6d343918d04 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:13.376387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aeb2e4-4889-4ddd-8669-d6d343918d04 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:13.378827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aeb2e4-4889-4ddd-8669-d6d343918d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:13.420659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5147f0-2797-4947-b427-10fde09144db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:13.421251 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5147f0-2797-4947-b427-10fde09144db None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:13.421548 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5147f0-2797-4947-b427-10fde09144db None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:13.421930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5147f0-2797-4947-b427-10fde09144db None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:13.422666 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5147f0-2797-4947-b427-10fde09144db None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:13.422978 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5147f0-2797-4947-b427-10fde09144db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:13.424654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5147f0-2797-4947-b427-10fde09144db None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:13.425766 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-13aeb2e4-4889-4ddd-8669-d6d343918d04 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:13.429379 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-13aeb2e4-4889-4ddd-8669-d6d343918d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:13.438637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 246/489] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:13.439302 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5147f0-2797-4947-b427-10fde09144db None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:13.512873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 244/490] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:13.514086 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aeb2e4-4889-4ddd-8669-d6d343918d04 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:13.522137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:13.582068 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5147f0-2797-4947-b427-10fde09144db None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:13.620968 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb436d-74c6-41f5-9924-d704b1e8a729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:13.622188 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb436d-74c6-41f5-9924-d704b1e8a729 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:13.622865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb436d-74c6-41f5-9924-d704b1e8a729 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:13.623346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb436d-74c6-41f5-9924-d704b1e8a729 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:13.638179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbb436d-74c6-41f5-9924-d704b1e8a729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:13.643121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:13.648537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-edbb436d-74c6-41f5-9924-d704b1e8a729 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:13.648537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:13.648537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:13.648537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:13.648537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:13.648537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:13.648537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:13.648537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:13.648537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:13.648537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:13.648537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:13.648537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:13.648537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:13.648537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:13.648537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:13.648537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:13.650214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:13.650214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:13.650214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:13.650214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:13.650214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:13.650214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:13.650214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:13.650214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:13.650214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:13.650214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:13.650214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:13.650214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:13.650214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:13.650214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:13.650214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:13.650214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:13.651163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:13.651163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:13.651163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:13.651163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:13.651163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:13.651163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:13.651163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:13.651163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:13.651163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:13.651163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:13.651163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:13.651163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:13.655805 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 247/491] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:13.659088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb436d-74c6-41f5-9924-d704b1e8a729 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:13.666992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aeb2e4-4889-4ddd-8669-d6d343918d04 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:13.705821 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743354e-0a63-42ac-ace7-e3e520483e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:13.706541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743354e-0a63-42ac-ace7-e3e520483e25 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:13.706826 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743354e-0a63-42ac-ace7-e3e520483e25 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:13.707103 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743354e-0a63-42ac-ace7-e3e520483e25 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:13.715358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743354e-0a63-42ac-ace7-e3e520483e25 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:13.717078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1743354e-0a63-42ac-ace7-e3e520483e25 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:13.733620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-1743354e-0a63-42ac-ace7-e3e520483e25 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:33:13.733620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:13.733620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:13.733620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:13.733620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:13.733620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:13.733620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:13.733620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:13.733620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:13.733620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:13.733620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:13.733620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:13.733620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:13.733620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:13.733620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:13.733620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:13.734576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:13.735512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:13.735512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:13.735512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:13.735512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:13.735512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:13.735512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:13.735512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:13.735512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:13.735512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:33:13.735512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:13.735512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 245/492] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jun 27 18:33:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:13.736118 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743354e-0a63-42ac-ace7-e3e520483e25 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:13.795119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb436d-74c6-41f5-9924-d704b1e8a729 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:13.814288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:13.834497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53c40d-571b-4b28-bed9-6c164ee83fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:13.835302 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53c40d-571b-4b28-bed9-6c164ee83fc1 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:13.835632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53c40d-571b-4b28-bed9-6c164ee83fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:13.835921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53c40d-571b-4b28-bed9-6c164ee83fc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:13.847874 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53c40d-571b-4b28-bed9-6c164ee83fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:13.856088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-ba53c40d-571b-4b28-bed9-6c164ee83fc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:13.856088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:13.856088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:13.856088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:13.856088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:13.856088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:13.856088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:13.856088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:13.856088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:13.856088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:13.856088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:13.856088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:13.856088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:13.856088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:13.856088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:13.856088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:13.857279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:13.857279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:13.857279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:13.857279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:13.857279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:13.857279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:13.857279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:13.857279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:13.857279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:13.857279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:13.857279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:13.857279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:13.857279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:13.857279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:13.857279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:13.857279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:13.858079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:13.858079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:13.858079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:13.858079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:13.858079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:13.858079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:13.858079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:13.858079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:13.858079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:13.858079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:13.858079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:13.858079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:13.860906 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743354e-0a63-42ac-ace7-e3e520483e25 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:13.862521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 248/493] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:13.863414 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53c40d-571b-4b28-bed9-6c164ee83fc1 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:13.909424 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53c1a6-c2cd-45f0-bdfa-ac651fb2d1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:13.910861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53c1a6-c2cd-45f0-bdfa-ac651fb2d1ef None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:13.911662 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53c1a6-c2cd-45f0-bdfa-ac651fb2d1ef None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:13.912168 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c53c1a6-c2cd-45f0-bdfa-ac651fb2d1ef None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:13.913377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53c1a6-c2cd-45f0-bdfa-ac651fb2d1ef None admin] RBAC: Adding query filter params (name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:13.914371 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53c1a6-c2cd-45f0-bdfa-ac651fb2d1ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:13.916778 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c53c1a6-c2cd-45f0-bdfa-ac651fb2d1ef None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:13.927087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 246/494] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:13.927232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53c1a6-c2cd-45f0-bdfa-ac651fb2d1ef None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:13.941944 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:13.972006 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53c40d-571b-4b28-bed9-6c164ee83fc1 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:14.011669 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd6504-f758-4c17-8daa-ecc9f9c6693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:14.012337 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd6504-f758-4c17-8daa-ecc9f9c6693c None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:14.012986 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd6504-f758-4c17-8daa-ecc9f9c6693c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:14.013275 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd6504-f758-4c17-8daa-ecc9f9c6693c None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:14.014437 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd6504-f758-4c17-8daa-ecc9f9c6693c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:14.014918 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd6504-f758-4c17-8daa-ecc9f9c6693c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:14.016405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd6504-f758-4c17-8daa-ecc9f9c6693c None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:14.035811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c53c1a6-c2cd-45f0-bdfa-ac651fb2d1ef None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:14.056140 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 249/495] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jun 27 18:33:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:14.057461 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb1dfc-6e40-4256-b994-c889abcd6c81 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:14.057754 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb1dfc-6e40-4256-b994-c889abcd6c81 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:14.058040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb1dfc-6e40-4256-b994-c889abcd6c81 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:14.063638 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 250/496] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:14.063638 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb1dfc-6e40-4256-b994-c889abcd6c81 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:14.075939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdd511-59f2-48fe-a2fc-cb243af776ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:14.076614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd511-59f2-48fe-a2fc-cb243af776ba None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:14.076903 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd511-59f2-48fe-a2fc-cb243af776ba None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:14.077186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbdd511-59f2-48fe-a2fc-cb243af776ba None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:14.077939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdd511-59f2-48fe-a2fc-cb243af776ba None admin] RBAC: Adding query filter params (name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:14.078251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdd511-59f2-48fe-a2fc-cb243af776ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:14.079682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbdd511-59f2-48fe-a2fc-cb243af776ba None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:14.088809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 247/497] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:14.089602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdd511-59f2-48fe-a2fc-cb243af776ba None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:14.104481 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:14.160691 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:14.178873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb1dfc-6e40-4256-b994-c889abcd6c81 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:14.194680 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbdd511-59f2-48fe-a2fc-cb243af776ba None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:14.213814 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edaa14b-c690-4166-8b63-aec4a902bfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:14.214605 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaa14b-c690-4166-8b63-aec4a902bfbe None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:14.214893 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaa14b-c690-4166-8b63-aec4a902bfbe None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:14.215174 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaa14b-c690-4166-8b63-aec4a902bfbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:14.225311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edaa14b-c690-4166-8b63-aec4a902bfbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:14.226732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edaa14b-c690-4166-8b63-aec4a902bfbe None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:14.227589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93babab5-cade-47fe-929e-b3d471ef2865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:14.228229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93babab5-cade-47fe-929e-b3d471ef2865 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:14.228517 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93babab5-cade-47fe-929e-b3d471ef2865 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:14.228791 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93babab5-cade-47fe-929e-b3d471ef2865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:14.245452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-7edaa14b-c690-4166-8b63-aec4a902bfbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:14.245452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:14.245452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:14.245452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:14.245452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:14.245452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:14.245452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:14.245452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:14.245452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:14.245452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:14.245452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:14.245452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:14.245452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:14.245452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:14.245452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:14.246308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:14.246308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:14.246308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:14.246308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:14.246308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:14.246308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:14.246308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:14.246308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:14.246308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:14.246308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:14.246308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:14.246308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:14.246308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:14.246308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:14.246308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:14.246308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:14.246308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:14.247506 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:14.247506 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:14.247506 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:14.247506 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:14.247506 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 251/498] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:14.248149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1aaa1-d5ec-4895-b5e4-6785b51b1c82 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:14.248440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1aaa1-d5ec-4895-b5e4-6785b51b1c82 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:14.248721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf1aaa1-d5ec-4895-b5e4-6785b51b1c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:14.264372 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-3cf1aaa1-d5ec-4895-b5e4-6785b51b1c82 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:14.265573 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3cf1aaa1-d5ec-4895-b5e4-6785b51b1c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:14.300131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93babab5-cade-47fe-929e-b3d471ef2865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:14.301580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93babab5-cade-47fe-929e-b3d471ef2865 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:14.331167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 252/499] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:14.332043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1aaa1-d5ec-4895-b5e4-6785b51b1c82 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:14.348418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:14.377515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:14.410657 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 248/500] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:33:14.412269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1d50b-6b65-477d-814f-5427c8ba1a37 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:14.412703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1d50b-6b65-477d-814f-5427c8ba1a37 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:14.413286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1d50b-6b65-477d-814f-5427c8ba1a37 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:14.415084 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 249/501] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:14.415827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1d50b-6b65-477d-814f-5427c8ba1a37 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:14.436969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf1aaa1-d5ec-4895-b5e4-6785b51b1c82 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:14.469139 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e3d46-1d38-4d4c-a7ac-3abbfdbb1663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:14.469933 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e3d46-1d38-4d4c-a7ac-3abbfdbb1663 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:14.470219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e3d46-1d38-4d4c-a7ac-3abbfdbb1663 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:14.470507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e3d46-1d38-4d4c-a7ac-3abbfdbb1663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:14.481059 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e3d46-1d38-4d4c-a7ac-3abbfdbb1663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:14.482734 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e3d46-1d38-4d4c-a7ac-3abbfdbb1663 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:14.500645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-626e3d46-1d38-4d4c-a7ac-3abbfdbb1663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:14.500645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:14.500645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:14.500645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:14.500645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:14.500645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:14.500645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:14.500645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:14.500645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:14.500645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:14.500645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:14.500645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:14.500645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:14.500645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:14.500645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:14.501537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:14.501537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:14.501537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:14.501537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:14.501537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:14.501537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:14.501537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:14.501537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:14.501537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:14.501537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:14.501537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:14.501537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:14.501537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:14.501537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:14.501537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:14.501537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:14.501537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:14.502411 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:14.502411 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:14.502411 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:14.502411 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:14.502411 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 253/502] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:14.502672 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e3d46-1d38-4d4c-a7ac-3abbfdbb1663 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:14.520898 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1d50b-6b65-477d-814f-5427c8ba1a37 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:14.554986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd86cd9-835d-4818-b5cb-20458d0f6939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:14.555700 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd86cd9-835d-4818-b5cb-20458d0f6939 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:14.555979 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd86cd9-835d-4818-b5cb-20458d0f6939 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:14.556249 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd86cd9-835d-4818-b5cb-20458d0f6939 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:14.556984 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd86cd9-835d-4818-b5cb-20458d0f6939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:14.557289 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd86cd9-835d-4818-b5cb-20458d0f6939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:14.558653 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd86cd9-835d-4818-b5cb-20458d0f6939 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:14.569573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 250/503] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:14.569837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:14.570336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd86cd9-835d-4818-b5cb-20458d0f6939 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:14.600072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:14.607973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e3d46-1d38-4d4c-a7ac-3abbfdbb1663 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:14.641399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53119a-1e85-466c-8bed-84234b2c62d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:14.642190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53119a-1e85-466c-8bed-84234b2c62d3 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:14.642476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53119a-1e85-466c-8bed-84234b2c62d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:14.642753 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53119a-1e85-466c-8bed-84234b2c62d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:14.653123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53119a-1e85-466c-8bed-84234b2c62d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:14.660850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-ac53119a-1e85-466c-8bed-84234b2c62d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:14.660850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:14.660850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:14.660850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:14.660850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:14.660850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:14.660850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:14.660850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:14.660850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:14.660850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:14.660850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:14.660850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:14.660850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:14.660850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:14.660850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:14.660850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:14.661724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:14.661724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:14.661724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:14.661724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:14.661724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:14.661724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:14.661724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:14.661724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:14.661724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:14.661724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:14.661724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:14.661724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:14.661724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:14.661724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:14.661724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:14.661724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:14.667798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:14.667798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:14.667798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:14.667798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:14.667798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:14.667798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:14.667798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:14.667798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:14.667798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:14.667798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:14.667798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:14.667798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:14.667798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 254/504] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:14.667798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460a4f7-01a6-46e3-985e-70c619b67b4b None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:14.668512 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460a4f7-01a6-46e3-985e-70c619b67b4b None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:14.668512 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0460a4f7-01a6-46e3-985e-70c619b67b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:14.668967 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd86cd9-835d-4818-b5cb-20458d0f6939 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:14.683158 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-0460a4f7-01a6-46e3-985e-70c619b67b4b None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:14.684388 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0460a4f7-01a6-46e3-985e-70c619b67b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:14.702540 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be081b6-7835-4279-af0f-bd816383e04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:14.703317 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be081b6-7835-4279-af0f-bd816383e04f None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:14.703629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be081b6-7835-4279-af0f-bd816383e04f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:14.703904 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be081b6-7835-4279-af0f-bd816383e04f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:14.714380 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be081b6-7835-4279-af0f-bd816383e04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:14.715875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be081b6-7835-4279-af0f-bd816383e04f None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:14.733359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-4be081b6-7835-4279-af0f-bd816383e04f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:14.733359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:14.733359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:14.733359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:14.733359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:14.733359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:14.733359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:14.733359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:14.733359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:14.733359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:14.733359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:14.733359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:14.733359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:14.733359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:14.733359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:14.734378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:14.734378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:14.734378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:14.734378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:14.734378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:14.734378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:14.734378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:14.734378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:14.734378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:14.734378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:14.734378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:14.734378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:14.734378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:14.734378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:14.734378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:14.734378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:14.734378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:14.736375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:14.736375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:14.736375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:14.736375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:14.736375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 251/505] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:14.736375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be081b6-7835-4279-af0f-bd816383e04f None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:14.750904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 255/506] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:14.751753 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460a4f7-01a6-46e3-985e-70c619b67b4b None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:14.811163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:14.820076 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:14.837986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be081b6-7835-4279-af0f-bd816383e04f None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:14.851688 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0460a4f7-01a6-46e3-985e-70c619b67b4b None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:14.870909 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c92f5-2464-48ac-a092-e306d9700ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:14.871600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c92f5-2464-48ac-a092-e306d9700ede None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:14.871892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c92f5-2464-48ac-a092-e306d9700ede None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:14.872172 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c92f5-2464-48ac-a092-e306d9700ede None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:14.872894 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c92f5-2464-48ac-a092-e306d9700ede None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:14.873207 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c92f5-2464-48ac-a092-e306d9700ede None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:14.874638 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8c92f5-2464-48ac-a092-e306d9700ede None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:14.885515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80495b72-ee28-4d8d-b167-972ef15273cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:14.886307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80495b72-ee28-4d8d-b167-972ef15273cb None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:14.886593 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80495b72-ee28-4d8d-b167-972ef15273cb None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:14.886865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80495b72-ee28-4d8d-b167-972ef15273cb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:14.887742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 252/507] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:14.888516 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c92f5-2464-48ac-a092-e306d9700ede None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:14.894338 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80495b72-ee28-4d8d-b167-972ef15273cb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:14.895796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80495b72-ee28-4d8d-b167-972ef15273cb None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:14.911834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-80495b72-ee28-4d8d-b167-972ef15273cb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 18:33:14.911834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:14.911834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:14.911834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:14.911834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:14.911834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:14.911834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:14.911834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:14.911834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:14.911834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:14.911834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:14.911834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:14.911834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:14.911834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:14.911834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:14.911834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:14.912863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:14.913796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:14.913796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:14.913796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:14.913796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:14.913796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:14.913796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:14.913796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:14.913796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:14.913796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 18:33:14.913796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:14.913796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 256/508] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:33:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:14.913796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80495b72-ee28-4d8d-b167-972ef15273cb None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:14.990035 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8c92f5-2464-48ac-a092-e306d9700ede None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:15.012063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80495b72-ee28-4d8d-b167-972ef15273cb None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:15.022901 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20102f0f-5eba-48a5-97c3-304209563ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:15.023686 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20102f0f-5eba-48a5-97c3-304209563ebe None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:15.024598 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20102f0f-5eba-48a5-97c3-304209563ebe None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:15.024873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20102f0f-5eba-48a5-97c3-304209563ebe None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:15.025615 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20102f0f-5eba-48a5-97c3-304209563ebe None admin] RBAC: Adding query filter params (name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:15.025921 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20102f0f-5eba-48a5-97c3-304209563ebe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:15.027310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20102f0f-5eba-48a5-97c3-304209563ebe None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:15.029518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:15.035051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 253/509] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:15.035856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20102f0f-5eba-48a5-97c3-304209563ebe None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:15.042486 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:15.046242 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59df580-b9dd-4a0b-a59d-d604e3931deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:15.046988 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59df580-b9dd-4a0b-a59d-d604e3931deb None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:15.047278 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59df580-b9dd-4a0b-a59d-d604e3931deb None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:15.047590 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59df580-b9dd-4a0b-a59d-d604e3931deb None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:15.048359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59df580-b9dd-4a0b-a59d-d604e3931deb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:15.052455 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59df580-b9dd-4a0b-a59d-d604e3931deb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:15.052455 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59df580-b9dd-4a0b-a59d-d604e3931deb None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:15.061136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 257/510] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:15.061922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59df580-b9dd-4a0b-a59d-d604e3931deb None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:15.141394 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20102f0f-5eba-48a5-97c3-304209563ebe None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:15.159375 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59df580-b9dd-4a0b-a59d-d604e3931deb None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:15.173690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184ee30-ef24-4b09-bda6-3280801efa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:15.174465 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184ee30-ef24-4b09-bda6-3280801efa42 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:15.174743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184ee30-ef24-4b09-bda6-3280801efa42 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:15.175013 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184ee30-ef24-4b09-bda6-3280801efa42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:15.185096 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184ee30-ef24-4b09-bda6-3280801efa42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:15.186544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184ee30-ef24-4b09-bda6-3280801efa42 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:15.191865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e837b-d679-4873-a452-30c153908b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:15.192645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e837b-d679-4873-a452-30c153908b3b None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:15.192928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e837b-d679-4873-a452-30c153908b3b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:15.193209 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e837b-d679-4873-a452-30c153908b3b None admin] PATH_INFO: `/v3/users/glance` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:15.200993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e837b-d679-4873-a452-30c153908b3b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:15.202419 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e837b-d679-4873-a452-30c153908b3b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:15.204325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-4184ee30-ef24-4b09-bda6-3280801efa42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:15.204325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:15.204325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:15.204325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:15.204325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:15.204325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:15.204325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:15.204325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:15.204325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:15.204325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:15.204325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:15.204325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:15.204325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:15.204325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:15.204325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:15.205310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:15.205310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:15.205310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:15.205310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:15.205310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:15.205310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:15.205310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:15.205310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:15.205310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:15.205310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:15.205310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:15.205310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:15.205310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:15.205310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:15.205310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:15.205310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:15.205310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:15.206219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:15.206219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:15.206219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:15.206219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:15.206219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 254/511] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:15.206610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184ee30-ef24-4b09-bda6-3280801efa42 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:15.219288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-9c2e837b-d679-4873-a452-30c153908b3b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 27 18:33:15.219288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:15.219288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:15.219288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:15.219288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:15.219288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:15.219288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:15.219288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:15.219288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:15.219288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:15.219288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:15.219288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:15.219288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:15.219288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:15.219288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:15.219288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:15.220450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:15.221453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:15.221453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:15.221453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:15.221453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:15.221453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:15.221453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:15.221453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:15.221453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:15.221453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 27 18:33:15.221453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:15.221453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 258/512] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:33:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:15.221453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e837b-d679-4873-a452-30c153908b3b None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:15.263626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:15.266130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:15.308437 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184ee30-ef24-4b09-bda6-3280801efa42 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:15.327905 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e837b-d679-4873-a452-30c153908b3b None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:15.342420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcb48e-fa8e-4f95-b2af-7c498e867829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:15.343080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcb48e-fa8e-4f95-b2af-7c498e867829 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:15.343359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcb48e-fa8e-4f95-b2af-7c498e867829 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:15.343662 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcb48e-fa8e-4f95-b2af-7c498e867829 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:15.344499 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcb48e-fa8e-4f95-b2af-7c498e867829 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:15.344811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcb48e-fa8e-4f95-b2af-7c498e867829 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:15.346240 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcb48e-fa8e-4f95-b2af-7c498e867829 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:15.362377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44784b75-684a-4faf-858c-6ac840bd7246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:15.363159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784b75-684a-4faf-858c-6ac840bd7246 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:15.363446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784b75-684a-4faf-858c-6ac840bd7246 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:15.363759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44784b75-684a-4faf-858c-6ac840bd7246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:15.375242 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44784b75-684a-4faf-858c-6ac840bd7246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:15.376730 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44784b75-684a-4faf-858c-6ac840bd7246 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:15.382768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 255/513] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Jun 27 18:33:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:15.384249 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcb48e-fa8e-4f95-b2af-7c498e867829 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:15.394759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-44784b75-684a-4faf-858c-6ac840bd7246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:15.394759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:15.394759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:15.394759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:15.394759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:15.394759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:15.394759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:15.394759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:15.394759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:15.394759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:15.394759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:15.394759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:15.394759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:15.394759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:15.394759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:15.395684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:15.395684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:15.395684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:15.395684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:15.395684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:15.395684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:15.395684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:15.395684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:15.395684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:15.395684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:15.395684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:15.395684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:15.395684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:15.395684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:15.395684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:15.395684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:15.395684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:15.396578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:15.396578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:15.396578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:15.396578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:15.396578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 259/514] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:15.396837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44784b75-684a-4faf-858c-6ac840bd7246 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:15.484714 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:15.485331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcb48e-fa8e-4f95-b2af-7c498e867829 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:15.494357 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44784b75-684a-4faf-858c-6ac840bd7246 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:15.500246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:15.520343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d4ddf-c9e7-4119-938c-072ed731f4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:15.521068 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d4ddf-c9e7-4119-938c-072ed731f4ab None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:15.521350 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d4ddf-c9e7-4119-938c-072ed731f4ab None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:15.521629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d4ddf-c9e7-4119-938c-072ed731f4ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:15.528724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bd47d-ae69-4032-b0cd-74941c0b1441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:15.528853 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d4ddf-c9e7-4119-938c-072ed731f4ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:15.529318 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bd47d-ae69-4032-b0cd-74941c0b1441 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:15.529606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bd47d-ae69-4032-b0cd-74941c0b1441 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:15.529888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563bd47d-ae69-4032-b0cd-74941c0b1441 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:15.530218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d4ddf-c9e7-4119-938c-072ed731f4ab None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:15.530619 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bd47d-ae69-4032-b0cd-74941c0b1441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:15.530931 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bd47d-ae69-4032-b0cd-74941c0b1441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:15.532394 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563bd47d-ae69-4032-b0cd-74941c0b1441 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:15.544205 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 260/515] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:15.544990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bd47d-ae69-4032-b0cd-74941c0b1441 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:15.545191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-ca0d4ddf-c9e7-4119-938c-072ed731f4ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:15.545191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:15.545191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:15.545191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:15.545191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:15.545191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:15.545191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:15.545191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:15.545191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:15.545191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:15.545191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:15.545191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:15.545191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:15.545191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:15.545191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:15.546012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:15.546012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:15.546012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:15.546012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:15.546012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:15.546012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:15.546012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:15.546012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:15.546012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:15.546012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:15.546012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:15.546012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:15.546012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:15.546012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:15.546012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:15.546012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:15.546012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:15.546865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:15.546865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:15.546865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:15.546865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:15.546865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:15.546865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:15.546865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:15.546865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:15.546865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 256/516] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:15.547330 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d4ddf-c9e7-4119-938c-072ed731f4ab None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:15.646660 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d4ddf-c9e7-4119-938c-072ed731f4ab None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:15.647845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563bd47d-ae69-4032-b0cd-74941c0b1441 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:15.679484 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d4015-b22b-41c9-8d96-1ab13282bab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:15.680676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d4015-b22b-41c9-8d96-1ab13282bab0 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:15.680958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d4015-b22b-41c9-8d96-1ab13282bab0 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:15.681292 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d4015-b22b-41c9-8d96-1ab13282bab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:15.681867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc516bc-8196-47b3-a577-c649a7f8f488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:15.682556 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc516bc-8196-47b3-a577-c649a7f8f488 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:15.682841 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc516bc-8196-47b3-a577-c649a7f8f488 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:15.683118 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc516bc-8196-47b3-a577-c649a7f8f488 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:15.683984 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc516bc-8196-47b3-a577-c649a7f8f488 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:15.684296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc516bc-8196-47b3-a577-c649a7f8f488 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:15.685727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc516bc-8196-47b3-a577-c649a7f8f488 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:15.702444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 261/517] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Jun 27 18:33:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:15.703239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc516bc-8196-47b3-a577-c649a7f8f488 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:15.714870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:15.723324 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:15.748409 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d4015-b22b-41c9-8d96-1ab13282bab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:15.749953 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d4015-b22b-41c9-8d96-1ab13282bab0 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:15.800901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc516bc-8196-47b3-a577-c649a7f8f488 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:15.834574 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba203a0-77f8-48ac-8759-41a157cbaf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:15.835229 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba203a0-77f8-48ac-8759-41a157cbaf6e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:15.835517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba203a0-77f8-48ac-8759-41a157cbaf6e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:15.835830 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba203a0-77f8-48ac-8759-41a157cbaf6e None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:15.836553 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba203a0-77f8-48ac-8759-41a157cbaf6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:15.836859 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba203a0-77f8-48ac-8759-41a157cbaf6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:15.838227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba203a0-77f8-48ac-8759-41a157cbaf6e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:15.846540 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 257/518] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:33:15.848478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d4015-b22b-41c9-8d96-1ab13282bab0 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:15.849295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 262/519] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:15.849943 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba203a0-77f8-48ac-8759-41a157cbaf6e None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:15.912977 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:15.921751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:15.945726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d4015-b22b-41c9-8d96-1ab13282bab0 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:15.946427 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba203a0-77f8-48ac-8759-41a157cbaf6e None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:15.979090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f4c39-6059-43de-82de-e6993b3f06d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:15.979251 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a60089-d327-4c51-b1af-f2413287a74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:15.979783 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f4c39-6059-43de-82de-e6993b3f06d5 None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:15.979929 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a60089-d327-4c51-b1af-f2413287a74a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:15.980069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f4c39-6059-43de-82de-e6993b3f06d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:15.980217 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a60089-d327-4c51-b1af-f2413287a74a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:15.980346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f4c39-6059-43de-82de-e6993b3f06d5 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:15.980496 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a60089-d327-4c51-b1af-f2413287a74a None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:15.981048 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f4c39-6059-43de-82de-e6993b3f06d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:15.981284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a60089-d327-4c51-b1af-f2413287a74a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:15.981598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a60089-d327-4c51-b1af-f2413287a74a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:15.982726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f4c39-6059-43de-82de-e6993b3f06d5 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:15.983281 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a60089-d327-4c51-b1af-f2413287a74a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:16.002508 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 263/520] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:16.004886 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a60089-d327-4c51-b1af-f2413287a74a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:16.082082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 258/521] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:33:15 2022] POST /identity/v3/users => generated 247 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:33:16.082082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f4c39-6059-43de-82de-e6993b3f06d5 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:16.101967 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a60089-d327-4c51-b1af-f2413287a74a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:16.132022 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:16.140733 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3b0c8-7bef-4da0-987e-db735cbd11af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:16.141393 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3b0c8-7bef-4da0-987e-db735cbd11af None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:16.141678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3b0c8-7bef-4da0-987e-db735cbd11af None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:16.141952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3b0c8-7bef-4da0-987e-db735cbd11af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:16.196327 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f4c39-6059-43de-82de-e6993b3f06d5 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:16.222952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3b0c8-7bef-4da0-987e-db735cbd11af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:16.224747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3b0c8-7bef-4da0-987e-db735cbd11af None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:16.230951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:16.239601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd3a76-ce07-44c3-acc1-a49251d52376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:16.240402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd3a76-ce07-44c3-acc1-a49251d52376 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:16.240694 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd3a76-ce07-44c3-acc1-a49251d52376 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:16.240971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd3a76-ce07-44c3-acc1-a49251d52376 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:16.252181 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd3a76-ce07-44c3-acc1-a49251d52376 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:16.254715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd3a76-ce07-44c3-acc1-a49251d52376 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:16.278996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-55dd3a76-ce07-44c3-acc1-a49251d52376 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:16.278996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:16.278996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:16.278996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:16.278996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:16.278996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:16.278996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:16.278996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:16.278996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:16.278996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:16.278996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:16.278996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:16.278996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:16.278996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:16.278996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:16.279931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:16.279931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:16.279931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:16.279931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:16.279931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:16.279931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:16.279931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:16.279931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:16.279931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:16.279931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:16.279931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:16.279931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:16.279931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:16.279931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:16.279931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:16.279931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:16.279931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:16.280812 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:16.280812 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:16.280812 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:16.280812 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:16.280812 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 259/522] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:16.280812 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd3a76-ce07-44c3-acc1-a49251d52376 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:16.338712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 264/523] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:33:16.339484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3b0c8-7bef-4da0-987e-db735cbd11af None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:16.368173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:16.393055 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd3a76-ce07-44c3-acc1-a49251d52376 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:16.427867 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa5701-c2e8-4990-91fb-4ba9a4b45b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:16.428676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa5701-c2e8-4990-91fb-4ba9a4b45b64 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:16.428963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa5701-c2e8-4990-91fb-4ba9a4b45b64 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:16.429246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa5701-c2e8-4990-91fb-4ba9a4b45b64 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:16.437259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa5701-c2e8-4990-91fb-4ba9a4b45b64 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:16.438737 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa5701-c2e8-4990-91fb-4ba9a4b45b64 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:16.446608 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3b0c8-7bef-4da0-987e-db735cbd11af None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:16.453995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-6daa5701-c2e8-4990-91fb-4ba9a4b45b64 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 18:33:16.453995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:16.453995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:16.453995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:16.453995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:16.453995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:16.453995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:16.453995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:16.453995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:16.453995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:16.453995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:16.453995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:16.453995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:16.453995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:16.453995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:16.453995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:16.455117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:16.456383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:16.456383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:16.456383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:16.456383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:16.456383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:16.456383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:16.456383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:16.456383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:16.456383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 18:33:16.456383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:16.456383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 260/524] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:16.456383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa5701-c2e8-4990-91fb-4ba9a4b45b64 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:16.487410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a5291-de04-4c30-8f37-30b98e05b123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:16.488151 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a5291-de04-4c30-8f37-30b98e05b123 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:16.488371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a5291-de04-4c30-8f37-30b98e05b123 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:16.488644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a5291-de04-4c30-8f37-30b98e05b123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:16.489473 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a5291-de04-4c30-8f37-30b98e05b123 None admin] RBAC: Adding query filter params (role.id=62fd6b166d1847b19e812160b459d5db, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=da1746d29f9e4e8b8626ad4b11931cbd) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:16.489786 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a5291-de04-4c30-8f37-30b98e05b123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:16.491213 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a5291-de04-4c30-8f37-30b98e05b123 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:16.497723 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 265/525] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:33:16 2022] GET /identity/v3/role_assignments?user.id=da1746d29f9e4e8b8626ad4b11931cbd&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=62fd6b166d1847b19e812160b459d5db => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:16.498490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a5291-de04-4c30-8f37-30b98e05b123 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:16.516206 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:16.595332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa5701-c2e8-4990-91fb-4ba9a4b45b64 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:16.635677 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471e8e8-059a-4f19-a093-3a0b750f1da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:16.636672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471e8e8-059a-4f19-a093-3a0b750f1da3 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:16.637168 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471e8e8-059a-4f19-a093-3a0b750f1da3 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:16.637629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471e8e8-059a-4f19-a093-3a0b750f1da3 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:16.638577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471e8e8-059a-4f19-a093-3a0b750f1da3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:16.639070 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471e8e8-059a-4f19-a093-3a0b750f1da3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:16.640301 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:16.640982 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471e8e8-059a-4f19-a093-3a0b750f1da3 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:16.653024 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a5291-de04-4c30-8f37-30b98e05b123 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:16.660344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 261/526] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:16.661424 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471e8e8-059a-4f19-a093-3a0b750f1da3 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:16.703557 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef099be3-3b7f-43b8-b517-d0b241b4b693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:16.704517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef099be3-3b7f-43b8-b517-d0b241b4b693 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:16.704881 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef099be3-3b7f-43b8-b517-d0b241b4b693 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:16.705400 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef099be3-3b7f-43b8-b517-d0b241b4b693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:16.724238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef099be3-3b7f-43b8-b517-d0b241b4b693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:16.725839 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef099be3-3b7f-43b8-b517-d0b241b4b693 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:16.751210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-ef099be3-3b7f-43b8-b517-d0b241b4b693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:16.751210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:16.751210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:16.751210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:16.751210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:16.751210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:16.751210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:16.751210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:16.751210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:16.751210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:16.751210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:16.751210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:16.751210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:16.751210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:16.751210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:16.752351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:16.752351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:16.752351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:16.752351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:16.752351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:16.752351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:16.752351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:16.752351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:16.752351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:16.752351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:16.752351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:16.752351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:16.752351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:16.752351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:16.752351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:16.752351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:16.752351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:16.753440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:16.753440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:16.753440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:16.753440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:16.754327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 266/527] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:16.755286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef099be3-3b7f-43b8-b517-d0b241b4b693 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:16.786814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471e8e8-059a-4f19-a093-3a0b750f1da3 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:16.788884 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:16.827412 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775026f-4526-4aa2-a3df-b80a01f6ff4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:16.828405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775026f-4526-4aa2-a3df-b80a01f6ff4e None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:16.829023 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775026f-4526-4aa2-a3df-b80a01f6ff4e None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:16.829454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775026f-4526-4aa2-a3df-b80a01f6ff4e None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:16.830598 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775026f-4526-4aa2-a3df-b80a01f6ff4e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:16.831056 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775026f-4526-4aa2-a3df-b80a01f6ff4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:16.832686 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f775026f-4526-4aa2-a3df-b80a01f6ff4e None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:16.853569 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 262/528] 10.222.0.36 () {56 vars in 1139 bytes} [Mon Jun 27 18:33:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:16.854688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775026f-4526-4aa2-a3df-b80a01f6ff4e None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:16.866164 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef099be3-3b7f-43b8-b517-d0b241b4b693 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:16.903239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9ecb4-c127-4788-afb1-3ed45ebf3db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:16.904008 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9ecb4-c127-4788-afb1-3ed45ebf3db8 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:16.904401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9ecb4-c127-4788-afb1-3ed45ebf3db8 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:16.904786 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb9ecb4-c127-4788-afb1-3ed45ebf3db8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:16.911877 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9ecb4-c127-4788-afb1-3ed45ebf3db8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:16.913462 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb9ecb4-c127-4788-afb1-3ed45ebf3db8 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:16.928166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-4cb9ecb4-c127-4788-afb1-3ed45ebf3db8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:16.928166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:16.928166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:16.928166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:16.928166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:16.928166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:16.928166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:16.928166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:16.928166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:16.928166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:16.928166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:16.928166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:16.928166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:16.928166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:16.928166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:16.929070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:16.929070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:16.929070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:16.929070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:16.929070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:16.929070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:16.929070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:16.929070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:16.929070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:16.929070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:16.929070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:16.929070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:16.929070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:16.929070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:16.929070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:16.929070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:16.929070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:16.930510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:16.930510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:16.930510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:16.930510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:16.930510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:16.930510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:16.930510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:16.930510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:16.930510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 267/529] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:16.930991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9ecb4-c127-4788-afb1-3ed45ebf3db8 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:16.936416 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:16.972134 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775026f-4526-4aa2-a3df-b80a01f6ff4e None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:17.011510 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a362300-f42b-443c-8c2d-f354c8e16070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:17.012578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a362300-f42b-443c-8c2d-f354c8e16070 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:17.013059 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a362300-f42b-443c-8c2d-f354c8e16070 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:17.013616 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a362300-f42b-443c-8c2d-f354c8e16070 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:17.014568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a362300-f42b-443c-8c2d-f354c8e16070 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:17.015095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a362300-f42b-443c-8c2d-f354c8e16070 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:17.016756 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a362300-f42b-443c-8c2d-f354c8e16070 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:17.035177 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 263/530] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:17.036458 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a362300-f42b-443c-8c2d-f354c8e16070 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:17.051166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb9ecb4-c127-4788-afb1-3ed45ebf3db8 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:17.061365 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:17.094242 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205b65c-d0b1-4c18-8e0c-249ea16c83da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:17.094899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205b65c-d0b1-4c18-8e0c-249ea16c83da None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:17.095191 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205b65c-d0b1-4c18-8e0c-249ea16c83da None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:17.095474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205b65c-d0b1-4c18-8e0c-249ea16c83da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:17.150487 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a362300-f42b-443c-8c2d-f354c8e16070 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:17.182531 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205b65c-d0b1-4c18-8e0c-249ea16c83da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:17.184616 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205b65c-d0b1-4c18-8e0c-249ea16c83da None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:17.188013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:17.189986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afa6ec-e522-4779-af80-c67b114f46c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:17.190902 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afa6ec-e522-4779-af80-c67b114f46c0 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:17.191398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afa6ec-e522-4779-af80-c67b114f46c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:17.191920 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4afa6ec-e522-4779-af80-c67b114f46c0 None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:17.192925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afa6ec-e522-4779-af80-c67b114f46c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:17.193537 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afa6ec-e522-4779-af80-c67b114f46c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:17.195227 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4afa6ec-e522-4779-af80-c67b114f46c0 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:17.215609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 264/531] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:17.216788 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afa6ec-e522-4779-af80-c67b114f46c0 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:17.309769 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 268/532] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:33:17.310677 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205b65c-d0b1-4c18-8e0c-249ea16c83da None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:17.314454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:17.336012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4afa6ec-e522-4779-af80-c67b114f46c0 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:17.374468 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482a0d6-dcc5-475b-95a1-e5245eb0df81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:17.375687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482a0d6-dcc5-475b-95a1-e5245eb0df81 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:17.376202 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482a0d6-dcc5-475b-95a1-e5245eb0df81 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:17.376728 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482a0d6-dcc5-475b-95a1-e5245eb0df81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:17.384443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482a0d6-dcc5-475b-95a1-e5245eb0df81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:17.386249 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482a0d6-dcc5-475b-95a1-e5245eb0df81 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:17.401495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-b482a0d6-dcc5-475b-95a1-e5245eb0df81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:17.401495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:17.401495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:17.401495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:17.401495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:17.401495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:17.401495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:17.401495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:17.401495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:17.401495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:17.401495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:17.401495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:17.401495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:17.401495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:17.401495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:17.402772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:17.402772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:17.402772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:17.402772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:17.402772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:17.402772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:17.402772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:17.402772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:17.402772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:17.402772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:17.402772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:17.402772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:17.402772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:17.402772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:17.402772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:17.402772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:17.402772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:17.403642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:17.403642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:17.403642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:17.403642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:17.403642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:17.403642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:17.403642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:17.403642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:17.410650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 265/533] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:17.410650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482a0d6-dcc5-475b-95a1-e5245eb0df81 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:17.431479 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205b65c-d0b1-4c18-8e0c-249ea16c83da None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:17.434373 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:17.469258 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea78f9-c090-4d7f-a50a-093c84bcef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:17.470263 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea78f9-c090-4d7f-a50a-093c84bcef03 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:17.470913 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea78f9-c090-4d7f-a50a-093c84bcef03 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:17.471497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea78f9-c090-4d7f-a50a-093c84bcef03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:17.472618 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea78f9-c090-4d7f-a50a-093c84bcef03 None admin] RBAC: Adding query filter params (role.id=62fd6b166d1847b19e812160b459d5db, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=f7ccc6b9aeef498a93030b48306fe402) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:17.473136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea78f9-c090-4d7f-a50a-093c84bcef03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:17.474905 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea78f9-c090-4d7f-a50a-093c84bcef03 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:17.482050 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 269/534] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:33:17 2022] GET /identity/v3/role_assignments?user.id=f7ccc6b9aeef498a93030b48306fe402&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=62fd6b166d1847b19e812160b459d5db => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:17.483261 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea78f9-c090-4d7f-a50a-093c84bcef03 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:17.567680 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482a0d6-dcc5-475b-95a1-e5245eb0df81 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:17.625488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775ef26-e453-4259-b814-330753e013f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:17.627006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775ef26-e453-4259-b814-330753e013f2 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:17.627567 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775ef26-e453-4259-b814-330753e013f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:17.628053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775ef26-e453-4259-b814-330753e013f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:17.656849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:17.662101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775ef26-e453-4259-b814-330753e013f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:17.668067 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775ef26-e453-4259-b814-330753e013f2 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:17.690992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea78f9-c090-4d7f-a50a-093c84bcef03 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:17.694444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-5775ef26-e453-4259-b814-330753e013f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:17.694444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:17.694444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:17.694444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:17.694444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:17.694444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:17.694444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:17.694444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:17.694444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:17.694444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:17.694444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:17.694444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:17.694444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:17.694444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:17.694444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:17.695466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:17.695466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:17.695466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:17.695466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:17.695466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:17.695466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:17.695466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:17.695466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:17.695466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:17.695466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:17.695466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:17.695466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:17.695466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:17.695466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:17.695466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:17.695466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:17.695466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:17.696740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:17.696740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:17.696740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:17.696740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:17.696740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 266/535] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:17.704589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775ef26-e453-4259-b814-330753e013f2 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:17.740903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8bb6d-b531-413f-ab85-0a19f488594d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:17.741923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8bb6d-b531-413f-ab85-0a19f488594d None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:17.742360 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8bb6d-b531-413f-ab85-0a19f488594d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:17.742808 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8bb6d-b531-413f-ab85-0a19f488594d None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:17.743843 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8bb6d-b531-413f-ab85-0a19f488594d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:17.744368 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8bb6d-b531-413f-ab85-0a19f488594d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:17.746064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a8bb6d-b531-413f-ab85-0a19f488594d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:17.769885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 270/536] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:17.775979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8bb6d-b531-413f-ab85-0a19f488594d None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:17.843452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775ef26-e453-4259-b814-330753e013f2 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:17.846417 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:17.901182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbf0f4-4824-45c3-9a53-ad542f3897a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:17.901853 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbf0f4-4824-45c3-9a53-ad542f3897a4 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:17.902140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbf0f4-4824-45c3-9a53-ad542f3897a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:17.902422 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbf0f4-4824-45c3-9a53-ad542f3897a4 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:17.903166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbf0f4-4824-45c3-9a53-ad542f3897a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:17.903481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbf0f4-4824-45c3-9a53-ad542f3897a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:17.905658 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dbf0f4-4824-45c3-9a53-ad542f3897a4 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:17.930710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 267/537] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:17.935984 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbf0f4-4824-45c3-9a53-ad542f3897a4 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:17.985942 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8bb6d-b531-413f-ab85-0a19f488594d None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:18.025212 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:18.070336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbf0f4-4824-45c3-9a53-ad542f3897a4 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:18.088275 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf05ea-04c8-4e1b-a74a-ae4cba386c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:18.088947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf05ea-04c8-4e1b-a74a-ae4cba386c26 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:18.089235 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf05ea-04c8-4e1b-a74a-ae4cba386c26 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:18.089511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf05ea-04c8-4e1b-a74a-ae4cba386c26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:18.090356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf05ea-04c8-4e1b-a74a-ae4cba386c26 None admin] RBAC: Adding query filter params (role.id=62fd6b166d1847b19e812160b459d5db, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=4e59193e90e240f6b9876d0455eea355) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:18.090670 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf05ea-04c8-4e1b-a74a-ae4cba386c26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:18.092140 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf05ea-04c8-4e1b-a74a-ae4cba386c26 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:18.106922 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9688e-ccdb-4c0a-8e94-c355113bfa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:18.107822 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9688e-ccdb-4c0a-8e94-c355113bfa39 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:18.108038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9688e-ccdb-4c0a-8e94-c355113bfa39 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:18.108908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9688e-ccdb-4c0a-8e94-c355113bfa39 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:18.109784 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 271/538] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:33:17 2022] GET /identity/v3/role_assignments?user.id=4e59193e90e240f6b9876d0455eea355&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=62fd6b166d1847b19e812160b459d5db => generated 259 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:18.116350 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9688e-ccdb-4c0a-8e94-c355113bfa39 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:18.118437 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9688e-ccdb-4c0a-8e94-c355113bfa39 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:18.134862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-87d9688e-ccdb-4c0a-8e94-c355113bfa39 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:18.134862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:18.134862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:18.134862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:18.134862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:18.134862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:18.134862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:18.134862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:18.134862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:18.134862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:18.134862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:18.134862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:18.134862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:18.134862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:18.134862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:18.135847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:18.135847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:18.135847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:18.135847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:18.135847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:18.135847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:18.135847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:18.135847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:18.135847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:18.135847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:18.135847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:18.135847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:18.135847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:18.135847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:18.135847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:18.135847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:18.135847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:18.136955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:18.136955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:18.136955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:18.136955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:18.136955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:18.136955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:18.136955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:18.136955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:18.136955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 268/539] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:18.141796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf05ea-04c8-4e1b-a74a-ae4cba386c26 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:18.270427 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82cb46-54e2-48fe-8e52-5f9c2133d24c None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:18.270925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82cb46-54e2-48fe-8e52-5f9c2133d24c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:18.271225 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82cb46-54e2-48fe-8e52-5f9c2133d24c None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:18.272866 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 269/540] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:18.280041 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937e81b-b84b-4048-847e-eb484ac86329 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:18.280337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937e81b-b84b-4048-847e-eb484ac86329 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:18.280617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937e81b-b84b-4048-847e-eb484ac86329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:18.303126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-3937e81b-b84b-4048-847e-eb484ac86329 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:18.304450 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-3937e81b-b84b-4048-847e-eb484ac86329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:18.319902 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:18.345561 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf05ea-04c8-4e1b-a74a-ae4cba386c26 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:18.411999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d35df-d87e-45b1-9cc3-8b15fca14ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:18.412780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d35df-d87e-45b1-9cc3-8b15fca14ff1 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:18.413077 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d35df-d87e-45b1-9cc3-8b15fca14ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:18.413365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d35df-d87e-45b1-9cc3-8b15fca14ff1 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:18.414107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 270/541] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:33:18.415105 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d35df-d87e-45b1-9cc3-8b15fca14ff1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:18.415105 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d35df-d87e-45b1-9cc3-8b15fca14ff1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:18.428828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d35df-d87e-45b1-9cc3-8b15fca14ff1 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:18.446248 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 272/542] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:18.451701 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937e81b-b84b-4048-847e-eb484ac86329 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:18.454969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d35df-d87e-45b1-9cc3-8b15fca14ff1 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:18.564391 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d35df-d87e-45b1-9cc3-8b15fca14ff1 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:18.601262 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:18.607522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214906bb-da99-4161-a43b-b66ba7c34764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:18.608939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214906bb-da99-4161-a43b-b66ba7c34764 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:18.614060 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214906bb-da99-4161-a43b-b66ba7c34764 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:18.614060 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214906bb-da99-4161-a43b-b66ba7c34764 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:18.625352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214906bb-da99-4161-a43b-b66ba7c34764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:18.634708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-214906bb-da99-4161-a43b-b66ba7c34764 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:18.634708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:18.634708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:18.634708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:18.634708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:18.634708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:18.634708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:18.634708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:18.634708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:18.634708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:18.634708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:18.634708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:18.634708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:18.634708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:18.634708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:18.634708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:18.635926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:18.635926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:18.635926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:18.635926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:18.635926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:18.635926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:18.635926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:18.635926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:18.635926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:18.635926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:18.635926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:18.635926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:18.635926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:18.635926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:18.635926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:18.635926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:18.636712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:18.636712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:18.636712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:18.636712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:18.636712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:18.636712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:18.636712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:18.636712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:18.636712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:18.636712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:18.636712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:18.636712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:18.636712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 273/543] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:18.645023 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214906bb-da99-4161-a43b-b66ba7c34764 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:18.663903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:18.761695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214906bb-da99-4161-a43b-b66ba7c34764 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:18.801499 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdcd65-51fa-49aa-b84e-20224530b171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:18.802095 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdcd65-51fa-49aa-b84e-20224530b171 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:18.802385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdcd65-51fa-49aa-b84e-20224530b171 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:18.802667 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fdcd65-51fa-49aa-b84e-20224530b171 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:18.803520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fdcd65-51fa-49aa-b84e-20224530b171 None admin] RBAC: Adding query filter params (name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:18.803866 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fdcd65-51fa-49aa-b84e-20224530b171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:18.807263 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fdcd65-51fa-49aa-b84e-20224530b171 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:18.817437 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 274/544] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:18.823962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdcd65-51fa-49aa-b84e-20224530b171 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:18.838243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937e81b-b84b-4048-847e-eb484ac86329 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:18.878266 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae5fb5-5d17-40d2-86a3-08facefe105d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:18.878991 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae5fb5-5d17-40d2-86a3-08facefe105d None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:18.879285 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae5fb5-5d17-40d2-86a3-08facefe105d None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:18.879621 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae5fb5-5d17-40d2-86a3-08facefe105d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:18.880467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae5fb5-5d17-40d2-86a3-08facefe105d None admin] RBAC: Adding query filter params (role.id=62fd6b166d1847b19e812160b459d5db, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=1e684ee875464138abc4e89060902100) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:18.880787 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae5fb5-5d17-40d2-86a3-08facefe105d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:18.882374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae5fb5-5d17-40d2-86a3-08facefe105d None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:18.889847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 271/545] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:33:18 2022] GET /identity/v3/role_assignments?user.id=1e684ee875464138abc4e89060902100&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=62fd6b166d1847b19e812160b459d5db => generated 259 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:18.891179 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bd16b-a5bc-4ce3-ae63-5a2b718cd305 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:18.891473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bd16b-a5bc-4ce3-ae63-5a2b718cd305 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:18.891791 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bd16b-a5bc-4ce3-ae63-5a2b718cd305 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:18.897454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 272/546] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:18.898941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0789d-2bac-402f-95a4-789eba58362e None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:18.899237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0789d-2bac-402f-95a4-789eba58362e None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:18.899522 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0789d-2bac-402f-95a4-789eba58362e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:18.921966 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-6aa0789d-2bac-402f-95a4-789eba58362e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:18.923224 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-6aa0789d-2bac-402f-95a4-789eba58362e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:18.951963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:18.998443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fdcd65-51fa-49aa-b84e-20224530b171 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:19.067158 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06e6bd-dc4a-484a-95ca-256c301c123d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:19.067988 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06e6bd-dc4a-484a-95ca-256c301c123d None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:19.068279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06e6bd-dc4a-484a-95ca-256c301c123d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:19.068564 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b06e6bd-dc4a-484a-95ca-256c301c123d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:19.071864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 273/547] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:33:19.095810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06e6bd-dc4a-484a-95ca-256c301c123d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:19.097287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b06e6bd-dc4a-484a-95ca-256c301c123d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:19.111349 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0789d-2bac-402f-95a4-789eba58362e None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:19.122047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-0b06e6bd-dc4a-484a-95ca-256c301c123d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:19.122047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:19.122047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:19.122047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:19.122047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:19.122047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:19.122047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:19.122047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:19.122047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:19.122047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:19.122047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:19.122047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:19.122047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:19.122047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:19.122047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:19.124046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:19.124046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:19.124046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:19.124046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:19.124046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:19.124046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:19.124046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:19.124046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:19.124046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:19.124046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:19.124046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:19.124046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:19.124046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:19.124046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:19.124046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:19.124046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:19.124046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:19.125927 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:19.125927 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:19.125927 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:19.125927 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:19.125927 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 275/548] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:19.133129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06e6bd-dc4a-484a-95ca-256c301c123d None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:19.188518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:19.269896 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b06e6bd-dc4a-484a-95ca-256c301c123d None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:19.320485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:19.340470 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93797f08-f468-43fe-980b-49fe55cdce3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:19.341145 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93797f08-f468-43fe-980b-49fe55cdce3d None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:19.341434 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93797f08-f468-43fe-980b-49fe55cdce3d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:19.341720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93797f08-f468-43fe-980b-49fe55cdce3d None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:19.342298 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0789d-2bac-402f-95a4-789eba58362e None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:19.342462 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93797f08-f468-43fe-980b-49fe55cdce3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:19.342879 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93797f08-f468-43fe-980b-49fe55cdce3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:19.353199 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93797f08-f468-43fe-980b-49fe55cdce3d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:19.381476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 276/549] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:19.386539 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93797f08-f468-43fe-980b-49fe55cdce3d None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:19.408862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90605631-6a19-4b6b-8881-7de285185c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:19.409684 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605631-6a19-4b6b-8881-7de285185c8f None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:19.409973 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605631-6a19-4b6b-8881-7de285185c8f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:19.410251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90605631-6a19-4b6b-8881-7de285185c8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:19.436133 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90605631-6a19-4b6b-8881-7de285185c8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:19.448332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-90605631-6a19-4b6b-8881-7de285185c8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:19.448332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:19.448332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:19.448332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:19.448332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:19.448332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:19.448332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:19.448332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:19.448332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:19.448332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:19.448332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:19.448332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:19.448332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:19.448332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:19.448332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:19.448332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:19.449269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:19.449269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:19.449269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:19.449269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:19.449269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:19.449269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:19.449269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:19.449269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:19.449269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:19.449269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:19.449269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:19.449269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:19.449269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:19.449269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:19.449269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:19.449269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:19.450075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:19.450075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:19.450075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:19.450075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:19.450075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:19.450075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:19.450075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:19.450075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:19.450075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:19.450075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:19.450075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:19.450075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:19.450075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 274/550] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:19.455563 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90605631-6a19-4b6b-8881-7de285185c8f None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:19.547565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93797f08-f468-43fe-980b-49fe55cdce3d None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:19.608837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc0df8-2870-4b5c-b19b-0f64dde69bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:19.609560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc0df8-2870-4b5c-b19b-0f64dde69bc0 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:19.609843 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc0df8-2870-4b5c-b19b-0f64dde69bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:19.610123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc0df8-2870-4b5c-b19b-0f64dde69bc0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:19.621651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc0df8-2870-4b5c-b19b-0f64dde69bc0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:19.623120 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc0df8-2870-4b5c-b19b-0f64dde69bc0 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:19.652560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-14fc0df8-2870-4b5c-b19b-0f64dde69bc0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 18:33:19.652560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:19.652560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:19.652560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:19.652560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:19.652560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:19.652560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:19.652560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:19.652560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:19.652560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:19.652560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:19.652560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:19.652560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:19.652560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:19.652560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:19.652560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:19.653690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:19.654603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:19.654603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:19.654603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:19.654603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:19.654603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:19.654603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:19.654603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:19.654603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:19.654603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 18:33:19.654603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:19.654603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 277/551] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:33:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:19.659904 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:19.660296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc0df8-2870-4b5c-b19b-0f64dde69bc0 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:19.677684 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90605631-6a19-4b6b-8881-7de285185c8f None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:19.712438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:19.751872 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd91d58d-0cd3-4c85-9374-9d3b66d1b087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:19.752551 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91d58d-0cd3-4c85-9374-9d3b66d1b087 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:19.752954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91d58d-0cd3-4c85-9374-9d3b66d1b087 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:19.753244 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91d58d-0cd3-4c85-9374-9d3b66d1b087 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:19.753999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91d58d-0cd3-4c85-9374-9d3b66d1b087 None admin] RBAC: Adding query filter params (name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:19.754314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91d58d-0cd3-4c85-9374-9d3b66d1b087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:19.763781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd91d58d-0cd3-4c85-9374-9d3b66d1b087 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:19.775856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 275/552] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:19.776854 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc0df8-2870-4b5c-b19b-0f64dde69bc0 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:19.777294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b80a5-4f36-437f-b4be-e175a8cf1036 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:19.777413 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b80a5-4f36-437f-b4be-e175a8cf1036 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:19.777699 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b80a5-4f36-437f-b4be-e175a8cf1036 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:19.779304 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 276/553] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:19.784569 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b80a5-4f36-437f-b4be-e175a8cf1036 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:19.823828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a362910-724b-41c6-9e2e-5b20566905fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:19.824981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a362910-724b-41c6-9e2e-5b20566905fe None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:19.825340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a362910-724b-41c6-9e2e-5b20566905fe None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:19.825685 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a362910-724b-41c6-9e2e-5b20566905fe None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:19.826637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a362910-724b-41c6-9e2e-5b20566905fe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:19.827028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a362910-724b-41c6-9e2e-5b20566905fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:19.829833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a362910-724b-41c6-9e2e-5b20566905fe None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:19.855640 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 278/554] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Jun 27 18:33:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:19.857367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbd9fc-3916-4e44-91a1-68a074f26f42 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:19.857664 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbd9fc-3916-4e44-91a1-68a074f26f42 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:19.857945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbd9fc-3916-4e44-91a1-68a074f26f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:19.879457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-7cbbd9fc-3916-4e44-91a1-68a074f26f42 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:19.881039 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-7cbbd9fc-3916-4e44-91a1-68a074f26f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:19.911028 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b80a5-4f36-437f-b4be-e175a8cf1036 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:19.949372 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c61191-76cd-47c9-b550-9ee6bb5e823b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:19.950558 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c61191-76cd-47c9-b550-9ee6bb5e823b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:19.951077 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c61191-76cd-47c9-b550-9ee6bb5e823b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:19.951578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c61191-76cd-47c9-b550-9ee6bb5e823b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:19.963792 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 279/555] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:19.964585 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c61191-76cd-47c9-b550-9ee6bb5e823b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:19.964768 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbd9fc-3916-4e44-91a1-68a074f26f42 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:19.966660 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c61191-76cd-47c9-b550-9ee6bb5e823b None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:19.985002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-c2c61191-76cd-47c9-b550-9ee6bb5e823b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:19.985002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:19.985002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:19.985002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:19.985002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:19.985002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:19.985002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:19.985002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:19.985002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:19.985002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:19.985002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:19.985002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:19.985002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:19.985002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:19.985002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:19.985936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:19.985936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:19.985936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:19.985936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:19.985936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:19.985936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:19.985936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:19.985936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:19.985936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:19.985936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:19.985936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:19.985936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:19.985936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:19.985936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:19.985936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:19.985936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:19.985936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:19.986820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:19.986820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:19.986820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:19.986820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:19.989171 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 277/556] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:19.995686 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c61191-76cd-47c9-b550-9ee6bb5e823b None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:20.011456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:20.016971 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:20.088566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbd9fc-3916-4e44-91a1-68a074f26f42 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:20.126750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdc451-ca08-444e-b071-b1c7a082fc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:20.127499 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc451-ca08-444e-b071-b1c7a082fc95 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:20.127832 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc451-ca08-444e-b071-b1c7a082fc95 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:20.128115 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc451-ca08-444e-b071-b1c7a082fc95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:20.142984 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c61191-76cd-47c9-b550-9ee6bb5e823b None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:20.185015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea80b6f-57e3-41a8-a61b-43b1e29c83b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:20.185723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea80b6f-57e3-41a8-a61b-43b1e29c83b2 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:20.186013 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea80b6f-57e3-41a8-a61b-43b1e29c83b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:20.186335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea80b6f-57e3-41a8-a61b-43b1e29c83b2 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:20.187055 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea80b6f-57e3-41a8-a61b-43b1e29c83b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:20.187364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea80b6f-57e3-41a8-a61b-43b1e29c83b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:20.188808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea80b6f-57e3-41a8-a61b-43b1e29c83b2 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:20.201254 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 278/557] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:20.202165 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea80b6f-57e3-41a8-a61b-43b1e29c83b2 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:20.208131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdc451-ca08-444e-b071-b1c7a082fc95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:20.209620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdc451-ca08-444e-b071-b1c7a082fc95 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:20.255912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:20.274779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:20.313283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea80b6f-57e3-41a8-a61b-43b1e29c83b2 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:20.337201 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 280/558] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:33:20.338050 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdc451-ca08-444e-b071-b1c7a082fc95 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:20.357751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45227d5-5409-42fa-8a91-7d1c9fc5b4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:20.358552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45227d5-5409-42fa-8a91-7d1c9fc5b4f4 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:20.358841 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45227d5-5409-42fa-8a91-7d1c9fc5b4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:20.359124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45227d5-5409-42fa-8a91-7d1c9fc5b4f4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:20.374218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45227d5-5409-42fa-8a91-7d1c9fc5b4f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:20.383655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-d45227d5-5409-42fa-8a91-7d1c9fc5b4f4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:20.383655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:20.383655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:20.383655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:20.383655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:20.383655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:20.383655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:20.383655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:20.383655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:20.383655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:20.383655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:20.383655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:20.383655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:20.383655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:20.383655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:20.383655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:20.386387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:20.386387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:20.386387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:20.386387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:20.386387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:20.386387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:20.386387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:20.386387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:20.386387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:20.386387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:20.386387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:20.386387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:20.386387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:20.386387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:20.386387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:20.386387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:20.388744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:20.388744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:20.388744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:20.388744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:20.388744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:20.388744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:20.388744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:20.388744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:20.388744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:20.388744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:20.388744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:20.388744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:20.388744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 279/559] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:20.388744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45227d5-5409-42fa-8a91-7d1c9fc5b4f4 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:20.447854 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdc451-ca08-444e-b071-b1c7a082fc95 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:20.494317 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df3c85-582b-49e5-9031-77552e328308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:20.495914 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df3c85-582b-49e5-9031-77552e328308 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:20.496652 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df3c85-582b-49e5-9031-77552e328308 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:20.497089 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df3c85-582b-49e5-9031-77552e328308 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:20.500396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:20.508511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df3c85-582b-49e5-9031-77552e328308 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:20.510788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df3c85-582b-49e5-9031-77552e328308 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:20.528957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45227d5-5409-42fa-8a91-7d1c9fc5b4f4 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:20.529609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-e2df3c85-582b-49e5-9031-77552e328308 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:33:20.529609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:20.529609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:20.529609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:20.529609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:20.529609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:20.529609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:20.529609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:20.529609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:20.529609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:20.529609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:20.529609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:20.529609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:20.529609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:20.529609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:20.529609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:20.530912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:20.532401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:20.532401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:20.532401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:20.532401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:20.532401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:20.532401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:20.532401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:20.532401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:20.532401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:33:20.532401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:20.532401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 281/560] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jun 27 18:33:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:20.533539 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df3c85-582b-49e5-9031-77552e328308 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:20.559401 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:20.565175 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da2c40-38cb-449a-b8ba-7a2709816133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:20.565963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da2c40-38cb-449a-b8ba-7a2709816133 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:20.566244 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da2c40-38cb-449a-b8ba-7a2709816133 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:20.566518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da2c40-38cb-449a-b8ba-7a2709816133 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:20.576970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da2c40-38cb-449a-b8ba-7a2709816133 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:20.578424 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da2c40-38cb-449a-b8ba-7a2709816133 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:20.596050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-b4da2c40-38cb-449a-b8ba-7a2709816133 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:20.596050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:20.596050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:20.596050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:20.596050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:20.596050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:20.596050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:20.596050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:20.596050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:20.596050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:20.596050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:20.596050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:20.596050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:20.596050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:20.596050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:20.598075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:20.598075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:20.598075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:20.598075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:20.598075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:20.598075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:20.598075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:20.598075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:20.598075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:20.598075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:20.598075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:20.598075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:20.598075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:20.598075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:20.598075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:20.598075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:20.598075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:20.600231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:20.600231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:20.600231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:20.600231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:20.602695 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 280/561] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:20.603741 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baf534-3145-49a9-acb6-9ff697b3acb4 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:20.604035 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baf534-3145-49a9-acb6-9ff697b3acb4 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:20.604311 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baf534-3145-49a9-acb6-9ff697b3acb4 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:20.605574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 281/562] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:20.606254 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baf534-3145-49a9-acb6-9ff697b3acb4 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:20.654541 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df3c85-582b-49e5-9031-77552e328308 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:20.696632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08f96e-1e3e-4a21-b477-4ddf55a5342f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:20.697404 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08f96e-1e3e-4a21-b477-4ddf55a5342f None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:20.697693 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08f96e-1e3e-4a21-b477-4ddf55a5342f None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:20.698041 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a08f96e-1e3e-4a21-b477-4ddf55a5342f None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:20.698735 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08f96e-1e3e-4a21-b477-4ddf55a5342f None admin] RBAC: Adding query filter params (name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:20.699050 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08f96e-1e3e-4a21-b477-4ddf55a5342f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:20.700653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a08f96e-1e3e-4a21-b477-4ddf55a5342f None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:20.715139 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 282/563] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:20.715139 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08f96e-1e3e-4a21-b477-4ddf55a5342f None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:20.717053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baf534-3145-49a9-acb6-9ff697b3acb4 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:20.754714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919b90e-464b-4d09-9730-dbcdf6fd39e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:20.755825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919b90e-464b-4d09-9730-dbcdf6fd39e7 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:20.756125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919b90e-464b-4d09-9730-dbcdf6fd39e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:20.756414 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919b90e-464b-4d09-9730-dbcdf6fd39e7 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:20.757285 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919b90e-464b-4d09-9730-dbcdf6fd39e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:20.757949 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919b90e-464b-4d09-9730-dbcdf6fd39e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:20.759753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919b90e-464b-4d09-9730-dbcdf6fd39e7 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:20.772169 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:20.784001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 282/564] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jun 27 18:33:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:20.784001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004db5fa-bd64-414f-9339-57157f119997 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:20.784001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004db5fa-bd64-414f-9339-57157f119997 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:20.784001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004db5fa-bd64-414f-9339-57157f119997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:20.799339 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-004db5fa-bd64-414f-9339-57157f119997 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:20.800594 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-004db5fa-bd64-414f-9339-57157f119997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:20.821128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a08f96e-1e3e-4a21-b477-4ddf55a5342f None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:20.884291 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c9723-516e-4383-a86b-603e20b8d3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:20.884946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c9723-516e-4383-a86b-603e20b8d3c1 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:20.885229 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c9723-516e-4383-a86b-603e20b8d3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:20.885518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9c9723-516e-4383-a86b-603e20b8d3c1 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:20.886222 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c9723-516e-4383-a86b-603e20b8d3c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:20.886530 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c9723-516e-4383-a86b-603e20b8d3c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:20.887448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:20.887923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9c9723-516e-4383-a86b-603e20b8d3c1 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:20.904991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 283/565] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:20.904991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c9723-516e-4383-a86b-603e20b8d3c1 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:20.927583 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 283/566] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:20.927766 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004db5fa-bd64-414f-9339-57157f119997 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:21.018605 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9c9723-516e-4383-a86b-603e20b8d3c1 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:21.035643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:21.047104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004db5fa-bd64-414f-9339-57157f119997 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:21.054315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5ca94-f29d-480d-b731-74e946a69830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:21.055548 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5ca94-f29d-480d-b731-74e946a69830 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:21.055839 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5ca94-f29d-480d-b731-74e946a69830 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:21.056115 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a5ca94-f29d-480d-b731-74e946a69830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:21.065966 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5ca94-f29d-480d-b731-74e946a69830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:21.067399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a5ca94-f29d-480d-b731-74e946a69830 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:21.085198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f05b4-e91e-4b02-8d20-52fcb38abb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:21.085349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-a0a5ca94-f29d-480d-b731-74e946a69830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:21.085349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:21.085349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:21.085349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:21.085349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:21.085349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:21.085349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:21.085349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:21.085349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:21.085349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:21.085349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:21.085349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:21.085349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:21.085349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:21.085349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:21.086790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:21.086790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:21.086790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:21.086790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:21.086790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:21.086790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:21.086790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:21.086790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:21.086790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:21.086790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:21.086790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:21.086790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:21.086790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:21.086790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:21.086790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:21.086790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:21.086790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:21.092356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:21.092356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:21.092356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:21.092356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:21.092590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f05b4-e91e-4b02-8d20-52fcb38abb95 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:21.092590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f05b4-e91e-4b02-8d20-52fcb38abb95 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:21.092590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f05b4-e91e-4b02-8d20-52fcb38abb95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:21.092774 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 284/567] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:21.092774 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5ca94-f29d-480d-b731-74e946a69830 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:21.097740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f05b4-e91e-4b02-8d20-52fcb38abb95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:21.099204 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f05b4-e91e-4b02-8d20-52fcb38abb95 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:21.117043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-6b9f05b4-e91e-4b02-8d20-52fcb38abb95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:21.117043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:21.117043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:21.117043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:21.117043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:21.117043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:21.117043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:21.117043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:21.117043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:21.117043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:21.117043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:21.117043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:21.117043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:21.117043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:21.117043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:21.117954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:21.117954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:21.117954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:21.117954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:21.117954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:21.117954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:21.117954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:21.117954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:21.117954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:21.117954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:21.117954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:21.117954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:21.117954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:21.117954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:21.117954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:21.117954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:21.117954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:21.118861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:21.118861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:21.118861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:21.118861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:21.118861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 284/568] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:21.119431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f05b4-e91e-4b02-8d20-52fcb38abb95 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:21.142905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:21.192605 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a5ca94-f29d-480d-b731-74e946a69830 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:21.217010 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f05b4-e91e-4b02-8d20-52fcb38abb95 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:21.228115 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b32ca7-07cc-44f2-a2f0-d139b9c5ccd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:21.228908 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b32ca7-07cc-44f2-a2f0-d139b9c5ccd5 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:21.229196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b32ca7-07cc-44f2-a2f0-d139b9c5ccd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:21.229482 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b32ca7-07cc-44f2-a2f0-d139b9c5ccd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:21.236382 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b32ca7-07cc-44f2-a2f0-d139b9c5ccd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:21.237844 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b32ca7-07cc-44f2-a2f0-d139b9c5ccd5 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:21.250210 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20318259-699b-4497-9c72-cc1fc928c2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:21.250990 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20318259-699b-4497-9c72-cc1fc928c2ff None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:21.251270 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20318259-699b-4497-9c72-cc1fc928c2ff None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:21.251567 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20318259-699b-4497-9c72-cc1fc928c2ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:21.251892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-29b32ca7-07cc-44f2-a2f0-d139b9c5ccd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:21.251892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:21.251892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:21.251892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:21.251892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:21.251892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:21.251892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:21.251892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:21.251892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:21.251892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:21.251892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:21.251892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:21.251892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:21.251892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:21.251892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:21.252939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:21.252939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:21.252939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:21.252939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:21.252939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:21.252939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:21.252939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:21.252939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:21.252939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:21.252939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:21.252939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:21.252939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:21.252939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:21.252939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:21.252939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:21.252939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:21.252939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:21.253992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:21.253992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:21.253992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:21.253992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:21.253992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:21.253992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:21.253992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:21.253992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:21.253992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 285/569] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:21.254795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3acc0-8dca-42a8-b951-796b567a34c7 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:21.254795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3acc0-8dca-42a8-b951-796b567a34c7 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:21.254795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d3acc0-8dca-42a8-b951-796b567a34c7 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:21.259577 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 286/570] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:21.259577 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3acc0-8dca-42a8-b951-796b567a34c7 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:21.265668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20318259-699b-4497-9c72-cc1fc928c2ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:21.273682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-20318259-699b-4497-9c72-cc1fc928c2ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:21.273682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:21.273682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:21.273682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:21.273682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:21.273682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:21.273682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:21.273682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:21.273682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:21.273682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:21.273682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:21.273682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:21.273682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:21.273682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:21.273682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:21.273682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:21.274591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:21.274591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:21.274591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:21.274591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:21.274591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:21.274591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:21.274591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:21.274591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:21.274591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:21.274591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:21.274591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:21.274591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:21.274591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:21.274591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:21.274591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:21.274591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:21.275444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:21.275444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:21.275444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:21.275444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:21.275444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:21.275444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:21.275444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:21.275444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:21.275444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:21.275444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:21.275444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:21.275444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:21.275444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 285/571] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:21.276254 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20318259-699b-4497-9c72-cc1fc928c2ff None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:21.290886 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:21.355009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:21.364817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d3acc0-8dca-42a8-b951-796b567a34c7 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:21.373920 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20318259-699b-4497-9c72-cc1fc928c2ff None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:21.398648 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016efb28-3144-4330-a202-2f8e08d7cf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:21.399308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016efb28-3144-4330-a202-2f8e08d7cf79 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:21.399631 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016efb28-3144-4330-a202-2f8e08d7cf79 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:21.399911 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016efb28-3144-4330-a202-2f8e08d7cf79 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:21.400637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016efb28-3144-4330-a202-2f8e08d7cf79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:21.400949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016efb28-3144-4330-a202-2f8e08d7cf79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:21.402318 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016efb28-3144-4330-a202-2f8e08d7cf79 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:21.408381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628b204-3138-4572-8ddb-2d99d689eca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:21.409525 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628b204-3138-4572-8ddb-2d99d689eca5 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:21.409906 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628b204-3138-4572-8ddb-2d99d689eca5 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:21.410190 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628b204-3138-4572-8ddb-2d99d689eca5 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:21.411344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628b204-3138-4572-8ddb-2d99d689eca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:21.411694 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628b204-3138-4572-8ddb-2d99d689eca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:21.413068 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628b204-3138-4572-8ddb-2d99d689eca5 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:21.413922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 287/572] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:21.414736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016efb28-3144-4330-a202-2f8e08d7cf79 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:21.425267 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 286/573] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:21.426490 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed892f-54e6-42ff-8226-80c077a78e9f None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:21.426881 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed892f-54e6-42ff-8226-80c077a78e9f None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:21.427199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed892f-54e6-42ff-8226-80c077a78e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:21.443664 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-e7ed892f-54e6-42ff-8226-80c077a78e9f None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:21.444860 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e7ed892f-54e6-42ff-8226-80c077a78e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:21.506979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:21.514072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 287/574] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:21.514906 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed892f-54e6-42ff-8226-80c077a78e9f None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:21.525071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016efb28-3144-4330-a202-2f8e08d7cf79 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:21.561338 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed92e38-8f2d-4230-b086-cb81190852c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:21.561992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed92e38-8f2d-4230-b086-cb81190852c2 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:21.562277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed92e38-8f2d-4230-b086-cb81190852c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:21.562554 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed92e38-8f2d-4230-b086-cb81190852c2 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:21.563339 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed92e38-8f2d-4230-b086-cb81190852c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:21.563692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed92e38-8f2d-4230-b086-cb81190852c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:21.565121 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed92e38-8f2d-4230-b086-cb81190852c2 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:21.576833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 288/575] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:21.577606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed92e38-8f2d-4230-b086-cb81190852c2 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:21.585675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:21.614390 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed892f-54e6-42ff-8226-80c077a78e9f None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:21.647641 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be56dd-4ac5-4c57-8b10-2081afd0428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:21.648304 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be56dd-4ac5-4c57-8b10-2081afd0428c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:21.648629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be56dd-4ac5-4c57-8b10-2081afd0428c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:21.648912 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be56dd-4ac5-4c57-8b10-2081afd0428c None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:21.649654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be56dd-4ac5-4c57-8b10-2081afd0428c None admin] RBAC: Adding query filter params (name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:21.649964 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be56dd-4ac5-4c57-8b10-2081afd0428c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:21.651332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be56dd-4ac5-4c57-8b10-2081afd0428c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:21.659005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 288/576] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:21.659005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be56dd-4ac5-4c57-8b10-2081afd0428c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:21.678735 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed92e38-8f2d-4230-b086-cb81190852c2 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:21.712449 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2939208-80c2-417a-80c1-7f8408ee0143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:21.713242 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2939208-80c2-417a-80c1-7f8408ee0143 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:21.713529 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2939208-80c2-417a-80c1-7f8408ee0143 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:21.713804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2939208-80c2-417a-80c1-7f8408ee0143 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:21.721098 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2939208-80c2-417a-80c1-7f8408ee0143 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:21.722527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2939208-80c2-417a-80c1-7f8408ee0143 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:21.737215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-b2939208-80c2-417a-80c1-7f8408ee0143 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 18:33:21.737215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:21.737215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:21.737215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:21.737215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:21.737215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:21.737215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:21.737215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:21.737215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:21.737215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:21.737215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:21.737215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:21.737215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:21.737215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:21.737215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:21.737215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:21.738159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:21.739129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:21.739129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:21.739129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:21.739129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:21.739129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:21.739129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:21.739129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:21.739129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:21.739129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 18:33:21.739129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:21.739129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 289/577] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:33:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:21.739129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2939208-80c2-417a-80c1-7f8408ee0143 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:21.749968 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:21.762275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be56dd-4ac5-4c57-8b10-2081afd0428c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:21.799556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f825ed4-8089-4bb9-811a-d6d01e74e145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:21.799556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f825ed4-8089-4bb9-811a-d6d01e74e145 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:21.799556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f825ed4-8089-4bb9-811a-d6d01e74e145 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:21.799556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f825ed4-8089-4bb9-811a-d6d01e74e145 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:21.799934 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:21.804441 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f825ed4-8089-4bb9-811a-d6d01e74e145 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:21.806643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f825ed4-8089-4bb9-811a-d6d01e74e145 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:21.820690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-6f825ed4-8089-4bb9-811a-d6d01e74e145 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:21.820690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:21.820690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:21.820690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:21.820690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:21.820690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:21.820690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:21.820690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:21.820690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:21.820690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:21.820690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:21.820690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:21.820690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:21.820690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:21.820690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:21.823820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:21.823820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:21.823820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:21.823820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:21.823820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:21.823820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:21.823820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:21.823820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:21.823820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:21.823820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:21.823820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:21.823820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:21.823820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:21.823820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:21.823820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:21.823820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:21.823820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:21.824760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:21.824760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:21.824760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:21.824760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:21.824760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:21.824760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:21.824760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:21.824760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:21.824760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 289/578] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:21.824760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f825ed4-8089-4bb9-811a-d6d01e74e145 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:21.837096 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2939208-80c2-417a-80c1-7f8408ee0143 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:21.871481 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f82ca-c0d5-46da-88c4-bcbe5cd4f85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:21.872297 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f82ca-c0d5-46da-88c4-bcbe5cd4f85f None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:21.872578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f82ca-c0d5-46da-88c4-bcbe5cd4f85f None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:21.872852 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f82ca-c0d5-46da-88c4-bcbe5cd4f85f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:21.882867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f82ca-c0d5-46da-88c4-bcbe5cd4f85f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:21.891477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-de4f82ca-c0d5-46da-88c4-bcbe5cd4f85f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:21.891477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:21.891477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:21.891477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:21.891477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:21.891477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:21.891477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:21.891477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:21.891477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:21.891477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:21.891477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:21.891477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:21.891477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:21.891477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:21.891477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:21.891477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:21.892626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:21.892626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:21.892626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:21.892626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:21.892626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:21.892626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:21.892626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:21.892626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:21.892626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:21.892626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:21.892626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:21.892626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:21.892626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:21.892626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:21.892626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:21.892626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:21.898698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:21.898698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:21.898698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:21.898698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:21.898698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:21.898698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:21.898698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:21.898698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:21.898698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:21.898698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:21.898698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:21.898698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:21.898698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 290/579] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:21.898698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f82ca-c0d5-46da-88c4-bcbe5cd4f85f None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:21.929652 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f825ed4-8089-4bb9-811a-d6d01e74e145 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:21.959942 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:21.962780 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e8cbf-1397-4141-a08d-7a4a8f7d865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:21.963442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e8cbf-1397-4141-a08d-7a4a8f7d865d None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:21.963751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e8cbf-1397-4141-a08d-7a4a8f7d865d None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:21.964031 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0e8cbf-1397-4141-a08d-7a4a8f7d865d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:21.964859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e8cbf-1397-4141-a08d-7a4a8f7d865d None admin] RBAC: Adding query filter params (role.id=62fd6b166d1847b19e812160b459d5db, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=94555ff897d94c90968c470d82ff9e2a) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:21.965172 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e8cbf-1397-4141-a08d-7a4a8f7d865d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:21.966635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0e8cbf-1397-4141-a08d-7a4a8f7d865d None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:21.972211 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 290/580] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:33:21 2022] GET /identity/v3/role_assignments?user.id=94555ff897d94c90968c470d82ff9e2a&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=62fd6b166d1847b19e812160b459d5db => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:21.972977 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e8cbf-1397-4141-a08d-7a4a8f7d865d None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:22.009644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f82ca-c0d5-46da-88c4-bcbe5cd4f85f None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:22.039688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:22.049225 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033d646-6344-4fcb-aee2-00cc5216dc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:22.050469 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033d646-6344-4fcb-aee2-00cc5216dc20 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:22.050909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033d646-6344-4fcb-aee2-00cc5216dc20 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:22.051335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033d646-6344-4fcb-aee2-00cc5216dc20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:22.063846 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033d646-6344-4fcb-aee2-00cc5216dc20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:22.065627 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033d646-6344-4fcb-aee2-00cc5216dc20 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:22.084423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-a033d646-6344-4fcb-aee2-00cc5216dc20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:22.084423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:22.084423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:22.084423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:22.084423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:22.084423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:22.084423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:22.084423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:22.084423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:22.084423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:22.084423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:22.084423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:22.084423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:22.084423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:22.084423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:22.085585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:22.085585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:22.085585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:22.085585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:22.085585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:22.085585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:22.085585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:22.085585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:22.085585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:22.085585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:22.085585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:22.085585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:22.085585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:22.085585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:22.085585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:22.085585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:22.085585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:22.087204 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:22.087204 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:22.087204 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:22.087204 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:22.087473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0e8cbf-1397-4141-a08d-7a4a8f7d865d None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:22.093571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 291/581] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:22.094762 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033d646-6344-4fcb-aee2-00cc5216dc20 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:22.125088 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb1aeb-6268-434f-8999-15e6341c9fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:22.125900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb1aeb-6268-434f-8999-15e6341c9fab None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:22.126016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb1aeb-6268-434f-8999-15e6341c9fab None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:22.126293 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb1aeb-6268-434f-8999-15e6341c9fab None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:22.127128 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb1aeb-6268-434f-8999-15e6341c9fab None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:22.127443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb1aeb-6268-434f-8999-15e6341c9fab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:22.128938 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb1aeb-6268-434f-8999-15e6341c9fab None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:22.146919 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 291/582] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Jun 27 18:33:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:22.147765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb1aeb-6268-434f-8999-15e6341c9fab None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:22.212361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033d646-6344-4fcb-aee2-00cc5216dc20 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:22.234956 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:22.249859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb1aeb-6268-434f-8999-15e6341c9fab None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:22.250774 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f7140-3602-4402-83e4-78dd9543fd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:22.251576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f7140-3602-4402-83e4-78dd9543fd32 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:22.251866 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f7140-3602-4402-83e4-78dd9543fd32 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:22.252263 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f7140-3602-4402-83e4-78dd9543fd32 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:22.253060 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f7140-3602-4402-83e4-78dd9543fd32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:22.253396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f7140-3602-4402-83e4-78dd9543fd32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:22.254810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f7140-3602-4402-83e4-78dd9543fd32 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:22.266970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:22.268511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 292/583] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:22.269585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f7140-3602-4402-83e4-78dd9543fd32 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:22.292053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03299f30-2f20-4d53-8404-3911ec96039b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:22.293115 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03299f30-2f20-4d53-8404-3911ec96039b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:22.293560 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03299f30-2f20-4d53-8404-3911ec96039b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:22.293844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03299f30-2f20-4d53-8404-3911ec96039b None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:22.294592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03299f30-2f20-4d53-8404-3911ec96039b None admin] RBAC: Adding query filter params (name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:22.294902 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03299f30-2f20-4d53-8404-3911ec96039b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:22.296359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03299f30-2f20-4d53-8404-3911ec96039b None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:22.306779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 292/584] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:22.307285 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03299f30-2f20-4d53-8404-3911ec96039b None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:22.376127 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f7140-3602-4402-83e4-78dd9543fd32 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:22.410253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c32f8-f2b4-43a6-917d-aa5c739d2712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:22.410915 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c32f8-f2b4-43a6-917d-aa5c739d2712 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:22.411203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c32f8-f2b4-43a6-917d-aa5c739d2712 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:22.411481 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c32f8-f2b4-43a6-917d-aa5c739d2712 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:22.413575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c32f8-f2b4-43a6-917d-aa5c739d2712 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:22.413575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c32f8-f2b4-43a6-917d-aa5c739d2712 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:22.413751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03299f30-2f20-4d53-8404-3911ec96039b None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:22.414481 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c32f8-f2b4-43a6-917d-aa5c739d2712 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:22.426691 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 293/585] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:22.427351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c32f8-f2b4-43a6-917d-aa5c739d2712 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:22.453521 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c3f35-ea25-4a41-b27c-01708a07f790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:22.454315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c3f35-ea25-4a41-b27c-01708a07f790 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:22.454594 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c3f35-ea25-4a41-b27c-01708a07f790 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:22.454994 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c3f35-ea25-4a41-b27c-01708a07f790 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:22.465928 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c3f35-ea25-4a41-b27c-01708a07f790 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:22.467485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014c3f35-ea25-4a41-b27c-01708a07f790 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:22.468961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:22.486714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-014c3f35-ea25-4a41-b27c-01708a07f790 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:22.486714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:22.486714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:22.486714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:22.486714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:22.486714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:22.486714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:22.486714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:22.486714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:22.486714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:22.486714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:22.486714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:22.486714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:22.486714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:22.486714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:22.488742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:22.488742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:22.488742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:22.488742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:22.488742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:22.488742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:22.488742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:22.488742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:22.488742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:22.488742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:22.488742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:22.488742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:22.488742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:22.488742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:22.488742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:22.488742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:22.488742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:22.489836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:22.489836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:22.489836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:22.489836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:22.489836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 293/586] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:22.489836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c3f35-ea25-4a41-b27c-01708a07f790 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:22.528898 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:22.544480 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c32f8-f2b4-43a6-917d-aa5c739d2712 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:22.579069 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef6582-93ec-48c3-98eb-c1a41f2f4f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:22.579988 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef6582-93ec-48c3-98eb-c1a41f2f4f6d None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:22.580275 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef6582-93ec-48c3-98eb-c1a41f2f4f6d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:22.580553 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef6582-93ec-48c3-98eb-c1a41f2f4f6d None admin] PATH_INFO: `/v3/projects/94dba2006b6747f8badff33745bde432/users/da1746d29f9e4e8b8626ad4b11931cbd/roles/62fd6b166d1847b19e812160b459d5db` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:22.596390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef6582-93ec-48c3-98eb-c1a41f2f4f6d None admin] RBAC: Authorizing `identity:create_grant(project_id=94dba2006b6747f8badff33745bde432, user_id=da1746d29f9e4e8b8626ad4b11931cbd, role_id=62fd6b166d1847b19e812160b459d5db)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:22.598048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ef6582-93ec-48c3-98eb-c1a41f2f4f6d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:22.601374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c3f35-ea25-4a41-b27c-01708a07f790 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:22.636631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20a9eb-5445-4a69-b108-7d761d899302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:22.637539 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20a9eb-5445-4a69-b108-7d761d899302 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:22.637719 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20a9eb-5445-4a69-b108-7d761d899302 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:22.638013 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20a9eb-5445-4a69-b108-7d761d899302 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:22.649297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20a9eb-5445-4a69-b108-7d761d899302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:22.650828 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20a9eb-5445-4a69-b108-7d761d899302 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:22.657140 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 294/587] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:33:22 2022] PUT /identity/v3/projects/94dba2006b6747f8badff33745bde432/users/da1746d29f9e4e8b8626ad4b11931cbd/roles/62fd6b166d1847b19e812160b459d5db => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:33:22.668185 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef6582-93ec-48c3-98eb-c1a41f2f4f6d None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:22.669233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-4a20a9eb-5445-4a69-b108-7d761d899302 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:22.669233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:22.669233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:22.669233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:22.669233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:22.669233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:22.669233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:22.669233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:22.669233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:22.669233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:22.669233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:22.669233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:22.669233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:22.669233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:22.669233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:22.670325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:22.670325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:22.670325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:22.670325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:22.670325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:22.670325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:22.670325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:22.670325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:22.670325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:22.670325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:22.670325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:22.670325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:22.670325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:22.670325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:22.670325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:22.670325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:22.670325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:22.671448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:22.671448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:22.671448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:22.671448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:22.676966 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 294/588] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:22.676966 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20a9eb-5445-4a69-b108-7d761d899302 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:22.784102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:22.808971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20a9eb-5445-4a69-b108-7d761d899302 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:22.816902 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:22.829528 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef6582-93ec-48c3-98eb-c1a41f2f4f6d None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:22.920799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b512243-ce5f-4a1c-a370-69ee7a8b1d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:22.921562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b512243-ce5f-4a1c-a370-69ee7a8b1d9c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:22.921916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b512243-ce5f-4a1c-a370-69ee7a8b1d9c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:22.922260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b512243-ce5f-4a1c-a370-69ee7a8b1d9c None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:22.923059 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b512243-ce5f-4a1c-a370-69ee7a8b1d9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:22.923437 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b512243-ce5f-4a1c-a370-69ee7a8b1d9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:22.923852 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be119d-80d4-491b-96c0-af06d781025c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:22.924651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be119d-80d4-491b-96c0-af06d781025c None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:22.924938 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be119d-80d4-491b-96c0-af06d781025c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:22.925046 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b512243-ce5f-4a1c-a370-69ee7a8b1d9c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:22.925210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be119d-80d4-491b-96c0-af06d781025c None admin] PATH_INFO: `/v3/users/glance` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:22.934357 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be119d-80d4-491b-96c0-af06d781025c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:22.936404 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be119d-80d4-491b-96c0-af06d781025c None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:22.940327 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 295/589] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:22.941220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b512243-ce5f-4a1c-a370-69ee7a8b1d9c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:22.953704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-e6be119d-80d4-491b-96c0-af06d781025c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 27 18:33:22.953704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:22.953704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:22.953704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:22.953704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:22.953704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:22.953704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:22.953704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:22.953704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:22.953704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:22.953704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:22.953704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:22.953704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:22.953704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:22.953704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:22.953704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:22.954860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:22.956128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:22.956128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:22.956128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:22.956128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:22.956128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:22.956128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:22.956128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:22.956128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:22.956128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 27 18:33:22.956128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:22.956995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 295/590] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:33:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:22.958046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be119d-80d4-491b-96c0-af06d781025c None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:23.050504 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b512243-ce5f-4a1c-a370-69ee7a8b1d9c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:23.068952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be119d-80d4-491b-96c0-af06d781025c None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:23.087167 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77957a76-a6b1-47a2-8685-de6b69014d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:23.087794 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77957a76-a6b1-47a2-8685-de6b69014d0b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:23.088080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77957a76-a6b1-47a2-8685-de6b69014d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:23.088359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77957a76-a6b1-47a2-8685-de6b69014d0b None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:23.089076 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77957a76-a6b1-47a2-8685-de6b69014d0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:23.089385 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77957a76-a6b1-47a2-8685-de6b69014d0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:23.090771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77957a76-a6b1-47a2-8685-de6b69014d0b None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:23.102971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 296/591] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:23.108342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77957a76-a6b1-47a2-8685-de6b69014d0b None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:23.110919 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018ee46-54d3-414f-a755-24962ba80b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:23.111821 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018ee46-54d3-414f-a755-24962ba80b58 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:23.112179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018ee46-54d3-414f-a755-24962ba80b58 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:23.112516 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:23.112624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018ee46-54d3-414f-a755-24962ba80b58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:23.120214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018ee46-54d3-414f-a755-24962ba80b58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:23.121735 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018ee46-54d3-414f-a755-24962ba80b58 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:23.137428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-2018ee46-54d3-414f-a755-24962ba80b58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:23.137428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:23.137428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:23.137428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:23.137428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:23.137428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:23.137428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:23.137428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:23.137428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:23.137428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:23.137428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:23.137428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:23.137428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:23.137428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:23.137428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:23.138327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:23.138327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:23.138327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:23.138327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:23.138327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:23.138327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:23.138327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:23.138327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:23.138327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:23.138327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:23.138327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:23.138327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:23.138327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:23.138327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:23.138327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:23.138327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:23.138327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:23.139374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:23.139374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:23.139374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:23.139374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:23.139374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:23.139374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:23.139374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:23.139374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:23.139374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 296/592] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:23.139905 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018ee46-54d3-414f-a755-24962ba80b58 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:23.153135 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:23.218973 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77957a76-a6b1-47a2-8685-de6b69014d0b None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:23.255025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4be04-3996-45f3-a765-501d6b59a400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:23.255723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4be04-3996-45f3-a765-501d6b59a400 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:23.256007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4be04-3996-45f3-a765-501d6b59a400 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:23.256391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4be04-3996-45f3-a765-501d6b59a400 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:23.257334 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4be04-3996-45f3-a765-501d6b59a400 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:23.258166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4be04-3996-45f3-a765-501d6b59a400 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:23.259635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4be04-3996-45f3-a765-501d6b59a400 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:23.267974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018ee46-54d3-414f-a755-24962ba80b58 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:23.283150 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 297/593] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Jun 27 18:33:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:23.284191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4be04-3996-45f3-a765-501d6b59a400 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:23.311384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5f20a-c5f7-4eee-8819-887238d99745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:23.312236 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5f20a-c5f7-4eee-8819-887238d99745 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:23.312530 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5f20a-c5f7-4eee-8819-887238d99745 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:23.312804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5f20a-c5f7-4eee-8819-887238d99745 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:23.322149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5f20a-c5f7-4eee-8819-887238d99745 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:23.324254 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5f20a-c5f7-4eee-8819-887238d99745 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:23.342596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-56d5f20a-c5f7-4eee-8819-887238d99745 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 18:33:23.342596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:23.342596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:23.342596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:23.342596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:23.342596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:23.342596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:23.342596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:23.342596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:23.342596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:23.342596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:23.342596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:23.342596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:23.342596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:23.342596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:23.342596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:23.343550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:23.344503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:23.344503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:23.344503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:23.344503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:23.344503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:23.344503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:23.344503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:23.344503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:23.344503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 18:33:23.344503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:23.347682 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 297/594] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:23.348586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5f20a-c5f7-4eee-8819-887238d99745 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:23.357456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:23.401416 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4be04-3996-45f3-a765-501d6b59a400 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:23.442758 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2aeddf-2f93-4e91-8a6d-f99576a7c60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:23.443719 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2aeddf-2f93-4e91-8a6d-f99576a7c60e None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:23.444257 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:23.444987 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2aeddf-2f93-4e91-8a6d-f99576a7c60e None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:23.446302 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2aeddf-2f93-4e91-8a6d-f99576a7c60e None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:23.447259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2aeddf-2f93-4e91-8a6d-f99576a7c60e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:23.447736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2aeddf-2f93-4e91-8a6d-f99576a7c60e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:23.449313 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2aeddf-2f93-4e91-8a6d-f99576a7c60e None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:23.465524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 298/595] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:23.466629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2aeddf-2f93-4e91-8a6d-f99576a7c60e None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:23.482556 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5f20a-c5f7-4eee-8819-887238d99745 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:23.529740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0296233-1329-496b-94eb-cc678b06e962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:23.530549 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0296233-1329-496b-94eb-cc678b06e962 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:23.530832 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0296233-1329-496b-94eb-cc678b06e962 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:23.531552 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0296233-1329-496b-94eb-cc678b06e962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:23.546886 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0296233-1329-496b-94eb-cc678b06e962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:23.548629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0296233-1329-496b-94eb-cc678b06e962 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:23.572759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-c0296233-1329-496b-94eb-cc678b06e962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:23.572759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:23.572759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:23.572759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:23.572759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:23.572759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:23.572759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:23.572759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:23.572759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:23.572759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:23.572759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:23.572759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:23.572759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:23.572759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:23.572759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:23.573695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:23.573695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:23.573695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:23.573695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:23.573695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:23.573695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:23.573695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:23.573695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:23.573695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:23.573695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:23.573695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:23.573695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:23.573695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:23.573695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:23.573695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:23.573695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:23.573695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:23.574616 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:23.574616 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:23.574616 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:23.574616 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:23.574616 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 298/596] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:23.579658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0296233-1329-496b-94eb-cc678b06e962 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:23.600796 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2aeddf-2f93-4e91-8a6d-f99576a7c60e None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:23.623790 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:23.646239 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956286d-4c46-4d1b-b59c-462baf350a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:23.647049 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956286d-4c46-4d1b-b59c-462baf350a3e None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:23.647681 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956286d-4c46-4d1b-b59c-462baf350a3e None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:23.648058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956286d-4c46-4d1b-b59c-462baf350a3e None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:23.649754 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956286d-4c46-4d1b-b59c-462baf350a3e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:23.650185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956286d-4c46-4d1b-b59c-462baf350a3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:23.652479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956286d-4c46-4d1b-b59c-462baf350a3e None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:23.676931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 299/597] 10.222.0.36 () {56 vars in 1139 bytes} [Mon Jun 27 18:33:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:23.678737 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956286d-4c46-4d1b-b59c-462baf350a3e None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:23.701275 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0296233-1329-496b-94eb-cc678b06e962 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:23.725822 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:23.739214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765907f2-f32e-4dfb-b0c6-5db24fbe9fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:23.740524 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765907f2-f32e-4dfb-b0c6-5db24fbe9fa0 None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:23.741285 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765907f2-f32e-4dfb-b0c6-5db24fbe9fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:23.741767 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765907f2-f32e-4dfb-b0c6-5db24fbe9fa0 None admin] PATH_INFO: `/v3/projects/94dba2006b6747f8badff33745bde432/users/f7ccc6b9aeef498a93030b48306fe402/roles/62fd6b166d1847b19e812160b459d5db` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:23.758318 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765907f2-f32e-4dfb-b0c6-5db24fbe9fa0 None admin] RBAC: Authorizing `identity:create_grant(project_id=94dba2006b6747f8badff33745bde432, user_id=f7ccc6b9aeef498a93030b48306fe402, role_id=62fd6b166d1847b19e812160b459d5db)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:23.760423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765907f2-f32e-4dfb-b0c6-5db24fbe9fa0 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:23.801857 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956286d-4c46-4d1b-b59c-462baf350a3e None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:23.843600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bc133-0eb0-403c-9336-f3d27bed8811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:23.843600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bc133-0eb0-403c-9336-f3d27bed8811 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:23.843600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bc133-0eb0-403c-9336-f3d27bed8811 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:23.843600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bc133-0eb0-403c-9336-f3d27bed8811 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:23.844094 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bc133-0eb0-403c-9336-f3d27bed8811 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:23.844094 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bc133-0eb0-403c-9336-f3d27bed8811 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:23.844094 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bc133-0eb0-403c-9336-f3d27bed8811 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:23.844661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 299/598] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:33:23 2022] PUT /identity/v3/projects/94dba2006b6747f8badff33745bde432/users/f7ccc6b9aeef498a93030b48306fe402/roles/62fd6b166d1847b19e812160b459d5db => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:33:23.846233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765907f2-f32e-4dfb-b0c6-5db24fbe9fa0 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:23.866725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 300/599] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:23.876364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bc133-0eb0-403c-9336-f3d27bed8811 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:23.962868 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:24.041127 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765907f2-f32e-4dfb-b0c6-5db24fbe9fa0 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:24.057856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bc133-0eb0-403c-9336-f3d27bed8811 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:24.087630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edad3c-6585-479c-a124-3dca3947737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:24.089048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edad3c-6585-479c-a124-3dca3947737f None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:24.089648 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edad3c-6585-479c-a124-3dca3947737f None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:24.090077 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edad3c-6585-479c-a124-3dca3947737f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:24.098666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041915c1-df1f-4e45-bfa8-ab9d83549599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:24.099627 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041915c1-df1f-4e45-bfa8-ab9d83549599 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:24.100010 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041915c1-df1f-4e45-bfa8-ab9d83549599 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:24.100406 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041915c1-df1f-4e45-bfa8-ab9d83549599 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:24.102877 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0edad3c-6585-479c-a124-3dca3947737f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:24.104930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0edad3c-6585-479c-a124-3dca3947737f None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:24.108979 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041915c1-df1f-4e45-bfa8-ab9d83549599 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:24.110508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041915c1-df1f-4e45-bfa8-ab9d83549599 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:24.124820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-d0edad3c-6585-479c-a124-3dca3947737f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:24.124820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:24.124820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:24.124820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:24.124820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:24.124820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:24.124820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:24.124820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:24.124820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:24.124820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:24.124820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:24.124820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:24.124820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:24.124820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:24.124820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:24.125930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:24.125930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:24.125930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:24.125930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:24.125930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:24.125930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:24.125930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:24.125930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:24.125930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:24.125930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:24.125930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:24.125930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:24.125930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:24.125930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:24.125930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:24.125930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:24.125930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:24.127044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:24.127044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:24.127044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:24.127044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:24.128587 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 300/600] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:24.129952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28234a49-0426-488e-ad32-4800b4ed41ee None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:24.130367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28234a49-0426-488e-ad32-4800b4ed41ee None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:24.130798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28234a49-0426-488e-ad32-4800b4ed41ee None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:24.132491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 301/601] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:24.134149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-041915c1-df1f-4e45-bfa8-ab9d83549599 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:24.134149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:24.134149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:24.134149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:24.134149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:24.134149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:24.134149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:24.134149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:24.134149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:24.134149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:24.134149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:24.134149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:24.134149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:24.134149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:24.134149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:24.135189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:24.135189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:24.135189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:24.135189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:24.135189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:24.135189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:24.135189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:24.135189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:24.135189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:24.135189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:24.135189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:24.135189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:24.135189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:24.135189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:24.135189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:24.135189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:24.135189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:24.136320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:24.136320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:24.136320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:24.136320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:24.136320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:24.136320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:24.136320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:24.136320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:24.138260 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270a63f-df1f-4013-8aae-9bf26953f2cd None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:24.138682 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270a63f-df1f-4013-8aae-9bf26953f2cd None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:24.139094 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270a63f-df1f-4013-8aae-9bf26953f2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:24.142883 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 301/602] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:24.144039 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041915c1-df1f-4e45-bfa8-ab9d83549599 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:24.162182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-1270a63f-df1f-4013-8aae-9bf26953f2cd None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:24.164443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-1270a63f-df1f-4013-8aae-9bf26953f2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:24.187425 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:24.244950 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 302/603] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:33:24.246056 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270a63f-df1f-4013-8aae-9bf26953f2cd None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:24.260062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:24.272542 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041915c1-df1f-4e45-bfa8-ab9d83549599 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:24.315587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfcbca-cc50-4f8b-aa73-652b8191de19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:24.316608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfcbca-cc50-4f8b-aa73-652b8191de19 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:24.317124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfcbca-cc50-4f8b-aa73-652b8191de19 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:24.317620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfcbca-cc50-4f8b-aa73-652b8191de19 None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:24.318714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfcbca-cc50-4f8b-aa73-652b8191de19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:24.319302 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfcbca-cc50-4f8b-aa73-652b8191de19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:24.321065 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfcbca-cc50-4f8b-aa73-652b8191de19 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:24.335397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 302/604] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:24.337159 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfcbca-cc50-4f8b-aa73-652b8191de19 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:24.355446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270a63f-df1f-4013-8aae-9bf26953f2cd None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:24.391816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0de53-340b-4bce-b502-6c41ef955580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:24.392500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0de53-340b-4bce-b502-6c41ef955580 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:24.392789 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0de53-340b-4bce-b502-6c41ef955580 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:24.393159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0de53-340b-4bce-b502-6c41ef955580 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:24.393894 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0de53-340b-4bce-b502-6c41ef955580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:24.394196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0de53-340b-4bce-b502-6c41ef955580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:24.395573 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa0de53-340b-4bce-b502-6c41ef955580 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:24.411584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 303/605] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:24.412464 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0de53-340b-4bce-b502-6c41ef955580 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:24.428507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:24.461783 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfcbca-cc50-4f8b-aa73-652b8191de19 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:24.501541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4746f1-c6f5-4554-88b0-ea8b403e281f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:24.502760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4746f1-c6f5-4554-88b0-ea8b403e281f None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:24.503257 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4746f1-c6f5-4554-88b0-ea8b403e281f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:24.503835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4746f1-c6f5-4554-88b0-ea8b403e281f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:24.522919 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4746f1-c6f5-4554-88b0-ea8b403e281f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:24.529444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0de53-340b-4bce-b502-6c41ef955580 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:24.536197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-2f4746f1-c6f5-4554-88b0-ea8b403e281f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:24.536197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:24.536197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:24.536197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:24.536197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:24.536197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:24.536197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:24.536197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:24.536197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:24.536197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:24.536197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:24.536197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:24.536197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:24.536197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:24.536197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:24.536197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:24.537176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:24.537176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:24.537176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:24.537176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:24.537176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:24.537176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:24.537176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:24.537176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:24.537176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:24.537176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:24.537176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:24.537176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:24.537176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:24.537176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:24.537176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:24.537176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:24.538034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:24.538034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:24.538034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:24.538034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:24.538034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:24.538034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:24.538034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:24.538034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:24.538034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:24.538034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:24.538034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:24.538034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:24.543075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 303/606] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:24.543989 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4746f1-c6f5-4554-88b0-ea8b403e281f None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:24.564936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:24.578385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9300b-da72-45b9-ab46-b51aa3f336aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:24.579559 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9300b-da72-45b9-ab46-b51aa3f336aa None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:24.580054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9300b-da72-45b9-ab46-b51aa3f336aa None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:24.580659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9300b-da72-45b9-ab46-b51aa3f336aa None admin] PATH_INFO: `/v3/projects/94dba2006b6747f8badff33745bde432/users/4e59193e90e240f6b9876d0455eea355/roles/62fd6b166d1847b19e812160b459d5db` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:24.600121 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9300b-da72-45b9-ab46-b51aa3f336aa None admin] RBAC: Authorizing `identity:create_grant(project_id=94dba2006b6747f8badff33745bde432, user_id=4e59193e90e240f6b9876d0455eea355, role_id=62fd6b166d1847b19e812160b459d5db)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:24.603310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9300b-da72-45b9-ab46-b51aa3f336aa None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:24.653998 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4746f1-c6f5-4554-88b0-ea8b403e281f None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:24.688816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5c7ed-cdbb-442b-abad-82305820a484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:24.689608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5c7ed-cdbb-442b-abad-82305820a484 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:24.689893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5c7ed-cdbb-442b-abad-82305820a484 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:24.690168 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5c7ed-cdbb-442b-abad-82305820a484 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:24.697745 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5c7ed-cdbb-442b-abad-82305820a484 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:24.699185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc5c7ed-cdbb-442b-abad-82305820a484 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:24.716240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 304/607] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:33:24 2022] PUT /identity/v3/projects/94dba2006b6747f8badff33745bde432/users/4e59193e90e240f6b9876d0455eea355/roles/62fd6b166d1847b19e812160b459d5db => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:33:24.717719 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9300b-da72-45b9-ab46-b51aa3f336aa None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:24.718630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-3bc5c7ed-cdbb-442b-abad-82305820a484 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:24.718630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:24.718630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:24.718630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:24.718630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:24.718630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:24.718630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:24.718630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:24.718630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:24.718630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:24.718630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:24.718630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:24.718630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:24.718630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:24.718630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:24.719566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:24.719566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:24.719566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:24.719566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:24.719566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:24.719566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:24.719566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:24.719566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:24.719566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:24.719566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:24.719566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:24.719566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:24.719566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:24.719566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:24.719566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:24.719566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:24.719566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:24.720498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:24.720498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:24.720498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:24.720498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:24.720498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:24.720498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:24.720498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:24.720498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:24.723653 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 304/608] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:24.725817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5c7ed-cdbb-442b-abad-82305820a484 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:24.837474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:24.848635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:24.877077 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc5c7ed-cdbb-442b-abad-82305820a484 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:24.887340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9300b-da72-45b9-ab46-b51aa3f336aa None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:24.920321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc56d39-e18b-4162-b070-5f22e68a91c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:24.920915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc56d39-e18b-4162-b070-5f22e68a91c8 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:24.922530 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc56d39-e18b-4162-b070-5f22e68a91c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:24.922530 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc56d39-e18b-4162-b070-5f22e68a91c8 None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:24.922530 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc56d39-e18b-4162-b070-5f22e68a91c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:24.922792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc56d39-e18b-4162-b070-5f22e68a91c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:24.924059 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc56d39-e18b-4162-b070-5f22e68a91c8 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:24.931064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bbc92-9e2f-4f06-98fd-61e67948496f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:24.932261 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bbc92-9e2f-4f06-98fd-61e67948496f None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:24.932261 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bbc92-9e2f-4f06-98fd-61e67948496f None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:24.933025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bbc92-9e2f-4f06-98fd-61e67948496f None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:24.933798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bbc92-9e2f-4f06-98fd-61e67948496f None admin] RBAC: Adding query filter params (name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:24.934117 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bbc92-9e2f-4f06-98fd-61e67948496f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:24.936006 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2bbc92-9e2f-4f06-98fd-61e67948496f None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:24.939016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 305/609] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:24.939567 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ba6fc-aa89-4b0a-897b-74d3c35c838f None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:24.941277 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ba6fc-aa89-4b0a-897b-74d3c35c838f None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:24.941277 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ba6fc-aa89-4b0a-897b-74d3c35c838f None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:24.942011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 306/610] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:24.946115 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 305/611] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:24.946782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ba6fc-aa89-4b0a-897b-74d3c35c838f None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:24.947377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728ea2a-a803-4b0b-a16e-e130710df916 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:24.951832 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728ea2a-a803-4b0b-a16e-e130710df916 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:24.952256 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728ea2a-a803-4b0b-a16e-e130710df916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:24.970354 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-5728ea2a-a803-4b0b-a16e-e130710df916 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:24.971648 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5728ea2a-a803-4b0b-a16e-e130710df916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:25.042466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 306/612] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:25.047966 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728ea2a-a803-4b0b-a16e-e130710df916 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:25.092263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ba6fc-aa89-4b0a-897b-74d3c35c838f None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:25.135893 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:25.139050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff21a4a-bd97-4a1f-8a23-88c1e928db56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:25.140235 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff21a4a-bd97-4a1f-8a23-88c1e928db56 None admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:25.140960 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff21a4a-bd97-4a1f-8a23-88c1e928db56 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:25.141343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff21a4a-bd97-4a1f-8a23-88c1e928db56 None admin] PATH_INFO: `/v3/projects/94dba2006b6747f8badff33745bde432/users/1e684ee875464138abc4e89060902100/roles/62fd6b166d1847b19e812160b459d5db` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:25.153114 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:25.160208 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728ea2a-a803-4b0b-a16e-e130710df916 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:25.161957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff21a4a-bd97-4a1f-8a23-88c1e928db56 None admin] RBAC: Authorizing `identity:create_grant(project_id=94dba2006b6747f8badff33745bde432, user_id=1e684ee875464138abc4e89060902100, role_id=62fd6b166d1847b19e812160b459d5db)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:25.164877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff21a4a-bd97-4a1f-8a23-88c1e928db56 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:25.196679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec7f44-fda4-414d-9a6f-6be56e1806c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:25.197403 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec7f44-fda4-414d-9a6f-6be56e1806c3 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:25.197690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec7f44-fda4-414d-9a6f-6be56e1806c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:25.197991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec7f44-fda4-414d-9a6f-6be56e1806c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:25.208470 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec7f44-fda4-414d-9a6f-6be56e1806c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:25.209927 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec7f44-fda4-414d-9a6f-6be56e1806c3 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:25.229295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-66ec7f44-fda4-414d-9a6f-6be56e1806c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:25.229295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:25.229295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:25.229295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:25.229295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:25.229295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:25.229295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:25.229295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:25.229295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:25.229295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:25.229295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:25.229295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:25.229295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:25.229295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:25.229295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:25.230370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:25.230370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:25.230370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:25.230370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:25.230370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:25.230370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:25.230370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:25.230370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:25.230370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:25.230370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:25.230370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:25.230370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:25.230370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:25.230370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:25.230370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:25.230370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:25.230370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:25.231357 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:25.231357 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:25.231357 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:25.231357 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:25.231357 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 307/613] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:25.231357 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec7f44-fda4-414d-9a6f-6be56e1806c3 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:25.249272 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 307/614] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:33:24 2022] PUT /identity/v3/projects/94dba2006b6747f8badff33745bde432/users/1e684ee875464138abc4e89060902100/roles/62fd6b166d1847b19e812160b459d5db => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:33:25.258402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff21a4a-bd97-4a1f-8a23-88c1e928db56 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:25.380797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec7f44-fda4-414d-9a6f-6be56e1806c3 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:25.403486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:25.418541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff21a4a-bd97-4a1f-8a23-88c1e928db56 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:25.450259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132aa56c-a7c3-47e8-9ec5-a62a7f1ea678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:25.451036 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132aa56c-a7c3-47e8-9ec5-a62a7f1ea678 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:25.451331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132aa56c-a7c3-47e8-9ec5-a62a7f1ea678 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:25.451635 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132aa56c-a7c3-47e8-9ec5-a62a7f1ea678 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:25.457739 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e2e65-b384-49cd-86c4-1f859b7ce5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:25.458418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e2e65-b384-49cd-86c4-1f859b7ce5f9 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:25.458704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e2e65-b384-49cd-86c4-1f859b7ce5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:25.458987 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e2e65-b384-49cd-86c4-1f859b7ce5f9 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:25.459752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e2e65-b384-49cd-86c4-1f859b7ce5f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:25.460065 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e2e65-b384-49cd-86c4-1f859b7ce5f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:25.461706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e2e65-b384-49cd-86c4-1f859b7ce5f9 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:25.473074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132aa56c-a7c3-47e8-9ec5-a62a7f1ea678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:25.474743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 308/615] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:25.480852 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e2e65-b384-49cd-86c4-1f859b7ce5f9 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:25.487165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-132aa56c-a7c3-47e8-9ec5-a62a7f1ea678 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:25.487165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:25.487165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:25.487165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:25.487165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:25.487165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:25.487165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:25.487165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:25.487165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:25.487165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:25.487165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:25.487165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:25.487165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:25.487165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:25.487165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:25.487165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:25.488178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:25.488178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:25.488178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:25.488178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:25.488178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:25.488178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:25.488178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:25.488178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:25.488178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:25.488178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:25.488178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:25.488178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:25.488178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:25.488178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:25.488178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:25.488178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:25.489013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:25.489013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:25.489013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:25.489013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:25.489013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:25.489013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:25.489013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:25.489013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:25.489013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:25.489013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:25.489013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:25.489013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:25.496485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 308/616] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:25.497744 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132aa56c-a7c3-47e8-9ec5-a62a7f1ea678 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:25.541035 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:25.595855 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e2e65-b384-49cd-86c4-1f859b7ce5f9 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:25.614653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132aa56c-a7c3-47e8-9ec5-a62a7f1ea678 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:25.631808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae97e6d-3bac-4a77-a7bd-463626e5c9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:25.633154 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae97e6d-3bac-4a77-a7bd-463626e5c9ce None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:25.633443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae97e6d-3bac-4a77-a7bd-463626e5c9ce None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:25.633722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae97e6d-3bac-4a77-a7bd-463626e5c9ce None admin] PATH_INFO: `/v3/users/swift` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:25.641827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae97e6d-3bac-4a77-a7bd-463626e5c9ce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:25.643287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae97e6d-3bac-4a77-a7bd-463626e5c9ce None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:25.661688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-9ae97e6d-3bac-4a77-a7bd-463626e5c9ce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 18:33:25.661688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:25.661688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:25.661688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:25.661688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:25.661688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:25.661688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:25.661688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:25.661688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:25.661688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:25.661688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:25.661688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:25.661688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:25.661688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:25.661688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:25.661688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:25.663109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:25.665208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:25.665208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:25.665208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:25.665208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:25.665208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:25.665208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:25.665208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:25.665208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:25.665208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 18:33:25.665208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:25.665208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 309/617] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:33:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:25.669218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae97e6d-3bac-4a77-a7bd-463626e5c9ce None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:25.681241 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd9829-f96c-470f-b753-39e28ab1c201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:25.681923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd9829-f96c-470f-b753-39e28ab1c201 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:25.682213 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd9829-f96c-470f-b753-39e28ab1c201 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:25.682495 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd9829-f96c-470f-b753-39e28ab1c201 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:25.683260 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd9829-f96c-470f-b753-39e28ab1c201 None admin] RBAC: Adding query filter params (name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:25.683625 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd9829-f96c-470f-b753-39e28ab1c201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:25.684968 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd9829-f96c-470f-b753-39e28ab1c201 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:25.713887 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 309/618] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:25.720865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd9829-f96c-470f-b753-39e28ab1c201 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:25.771422 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:25.781247 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae97e6d-3bac-4a77-a7bd-463626e5c9ce None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:25.791358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:25.823610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2217515-90b3-42e4-b56b-13eee28e22da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:25.823610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2217515-90b3-42e4-b56b-13eee28e22da None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:25.823610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2217515-90b3-42e4-b56b-13eee28e22da None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:25.823610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2217515-90b3-42e4-b56b-13eee28e22da None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:25.824120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2217515-90b3-42e4-b56b-13eee28e22da None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:25.824120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2217515-90b3-42e4-b56b-13eee28e22da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:25.824120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2217515-90b3-42e4-b56b-13eee28e22da None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:25.847801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 310/619] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Jun 27 18:33:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:25.849381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2217515-90b3-42e4-b56b-13eee28e22da None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:25.909478 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd9829-f96c-470f-b753-39e28ab1c201 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:25.962632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2217515-90b3-42e4-b56b-13eee28e22da None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:26.001718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64688d06-f6ec-434b-989d-cda0c89c6032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:26.002906 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64688d06-f6ec-434b-989d-cda0c89c6032 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:26.003440 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64688d06-f6ec-434b-989d-cda0c89c6032 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:26.004010 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64688d06-f6ec-434b-989d-cda0c89c6032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:26.004246 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f042d82-2334-4969-be85-4273ab78fee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:26.005052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f042d82-2334-4969-be85-4273ab78fee6 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:26.005359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f042d82-2334-4969-be85-4273ab78fee6 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:26.005621 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f042d82-2334-4969-be85-4273ab78fee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:26.016185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64688d06-f6ec-434b-989d-cda0c89c6032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:26.018050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64688d06-f6ec-434b-989d-cda0c89c6032 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:26.031796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f042d82-2334-4969-be85-4273ab78fee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:26.033524 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f042d82-2334-4969-be85-4273ab78fee6 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:26.054604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-64688d06-f6ec-434b-989d-cda0c89c6032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:26.054604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:26.054604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:26.054604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:26.054604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:26.054604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:26.054604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:26.054604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:26.054604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:26.054604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:26.054604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:26.054604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:26.054604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:26.054604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:26.054604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:26.055635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:26.055635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:26.055635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:26.055635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:26.055635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:26.055635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:26.055635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:26.055635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:26.055635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:26.055635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:26.055635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:26.055635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:26.055635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:26.055635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:26.055635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:26.055635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:26.055635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:26.056544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:26.056544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:26.056544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:26.056544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:26.064945 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 311/620] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:26.066110 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64688d06-f6ec-434b-989d-cda0c89c6032 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:26.069313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-2f042d82-2334-4969-be85-4273ab78fee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:26.069313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:26.069313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:26.069313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:26.069313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:26.069313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:26.069313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:26.069313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:26.069313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:26.069313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:26.069313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:26.069313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:26.069313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:26.069313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:26.069313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:26.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:26.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:26.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:26.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:26.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:26.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:26.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:26.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:26.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:26.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:26.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:26.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:26.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:26.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:26.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:26.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:26.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:26.071899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:26.071899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:26.071899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:26.071899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:26.080176 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 310/621] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:26.081550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cdc10-f084-4669-8787-27387d03d6ac None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:26.082075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cdc10-f084-4669-8787-27387d03d6ac None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:26.082075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cdc10-f084-4669-8787-27387d03d6ac None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:26.083842 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 311/622] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:26.089909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa5131-739e-44de-a563-004c4f8b7486 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:26.089909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa5131-739e-44de-a563-004c4f8b7486 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:26.090197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa5131-739e-44de-a563-004c4f8b7486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:26.096534 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:26.108321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-b6aa5131-739e-44de-a563-004c4f8b7486 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:26.109534 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b6aa5131-739e-44de-a563-004c4f8b7486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:26.177237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64688d06-f6ec-434b-989d-cda0c89c6032 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:26.183777 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 312/623] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:33:26.184675 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa5131-739e-44de-a563-004c4f8b7486 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:26.213380 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c88f2-0516-481a-80c6-d05ae5fe85ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:26.214041 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c88f2-0516-481a-80c6-d05ae5fe85ac None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:26.214323 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c88f2-0516-481a-80c6-d05ae5fe85ac None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:26.214651 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c88f2-0516-481a-80c6-d05ae5fe85ac None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:26.215057 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:26.215799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c88f2-0516-481a-80c6-d05ae5fe85ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:26.215799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c88f2-0516-481a-80c6-d05ae5fe85ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:26.218492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c88f2-0516-481a-80c6-d05ae5fe85ac None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:26.230232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 312/624] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:26.231056 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c88f2-0516-481a-80c6-d05ae5fe85ac None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:26.307702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa5131-739e-44de-a563-004c4f8b7486 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:26.312304 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:26.333845 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c88f2-0516-481a-80c6-d05ae5fe85ac None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:26.343427 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75b268-de27-44c4-90a1-bd778f6ad8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:26.344302 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75b268-de27-44c4-90a1-bd778f6ad8e4 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:26.344767 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75b268-de27-44c4-90a1-bd778f6ad8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:26.345194 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75b268-de27-44c4-90a1-bd778f6ad8e4 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:26.346067 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75b268-de27-44c4-90a1-bd778f6ad8e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:26.346535 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75b268-de27-44c4-90a1-bd778f6ad8e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:26.348416 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75b268-de27-44c4-90a1-bd778f6ad8e4 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:26.362345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 313/625] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:26.363507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75b268-de27-44c4-90a1-bd778f6ad8e4 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:26.369423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9934b-4fef-47bb-926c-f64c69f82323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:26.370272 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9934b-4fef-47bb-926c-f64c69f82323 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:26.370619 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9934b-4fef-47bb-926c-f64c69f82323 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:26.370900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9934b-4fef-47bb-926c-f64c69f82323 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:26.381552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9934b-4fef-47bb-926c-f64c69f82323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:26.390107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-d4c9934b-4fef-47bb-926c-f64c69f82323 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:26.390107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:26.390107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:26.390107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:26.390107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:26.390107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:26.390107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:26.390107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:26.390107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:26.390107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:26.390107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:26.390107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:26.390107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:26.390107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:26.390107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:26.390107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:26.391259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:26.391259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:26.391259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:26.391259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:26.391259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:26.391259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:26.391259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:26.391259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:26.391259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:26.391259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:26.391259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:26.391259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:26.391259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:26.391259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:26.391259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:26.391259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:26.396900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:26.396900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:26.396900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:26.396900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:26.396900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:26.396900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:26.396900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:26.396900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:26.396900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:26.396900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:26.396900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:26.396900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:26.396900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 313/626] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:26.396900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9934b-4fef-47bb-926c-f64c69f82323 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:26.460954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:26.480833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75b268-de27-44c4-90a1-bd778f6ad8e4 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:26.495757 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9934b-4fef-47bb-926c-f64c69f82323 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:26.518114 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee437e3-00ca-4a04-81a0-d77e776137ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:26.518917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee437e3-00ca-4a04-81a0-d77e776137ac None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:26.519257 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee437e3-00ca-4a04-81a0-d77e776137ac None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:26.519482 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee437e3-00ca-4a04-81a0-d77e776137ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:26.528076 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee437e3-00ca-4a04-81a0-d77e776137ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:26.529474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee437e3-00ca-4a04-81a0-d77e776137ac None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:26.533636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8bd6e-3871-400a-8617-65cfdcc624cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:26.534586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8bd6e-3871-400a-8617-65cfdcc624cd None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:26.535007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8bd6e-3871-400a-8617-65cfdcc624cd None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:26.535434 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8bd6e-3871-400a-8617-65cfdcc624cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:26.543995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8bd6e-3871-400a-8617-65cfdcc624cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:26.545306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-0ee437e3-00ca-4a04-81a0-d77e776137ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:26.545306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:26.545306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:26.545306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:26.545306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:26.545306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:26.545306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:26.545306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:26.545306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:26.545306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:26.545306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:26.545306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:26.545306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:26.545306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:26.545306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:26.546331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:26.546331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:26.546331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:26.546331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:26.546331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:26.546331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:26.546331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:26.546331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:26.546331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:26.546331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:26.546331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:26.546331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:26.546331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:26.546331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:26.546331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:26.546331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:26.546331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:26.547359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:26.547359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:26.547359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:26.547359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:26.547359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:26.547359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:26.547359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:26.547359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:26.547359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 314/627] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:26.547876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee437e3-00ca-4a04-81a0-d77e776137ac None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:26.548318 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8bd6e-3871-400a-8617-65cfdcc624cd None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:26.550367 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:26.564932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-62e8bd6e-3871-400a-8617-65cfdcc624cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:33:26.564932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:26.564932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:26.564932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:26.564932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:26.564932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:26.564932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:26.564932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:26.564932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:26.564932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:26.564932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:26.564932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:26.564932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:26.564932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:26.564932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:26.564932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:26.566170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:26.567290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:26.567290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:26.567290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:26.567290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:26.567290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:26.567290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:26.567290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:26.567290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:26.567290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:33:26.567290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:26.569501 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 314/628] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jun 27 18:33:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:26.570438 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8bd6e-3871-400a-8617-65cfdcc624cd None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:26.659436 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee437e3-00ca-4a04-81a0-d77e776137ac None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:26.687133 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8bd6e-3871-400a-8617-65cfdcc624cd None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:26.692325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:26.697653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc715d4a-6b59-4c5b-ad88-223a82063c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:26.698402 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc715d4a-6b59-4c5b-ad88-223a82063c3c None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:26.698703 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc715d4a-6b59-4c5b-ad88-223a82063c3c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:26.699099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc715d4a-6b59-4c5b-ad88-223a82063c3c None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:26.699953 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc715d4a-6b59-4c5b-ad88-223a82063c3c None admin] RBAC: Adding query filter params (name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:26.708449 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc715d4a-6b59-4c5b-ad88-223a82063c3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:26.708449 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc715d4a-6b59-4c5b-ad88-223a82063c3c None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:26.717007 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 315/629] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:26.717884 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc715d4a-6b59-4c5b-ad88-223a82063c3c None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:26.730670 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27da43-2259-4017-b42a-1ad8344e32b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:26.731896 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27da43-2259-4017-b42a-1ad8344e32b5 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:26.732375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27da43-2259-4017-b42a-1ad8344e32b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:26.732792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c27da43-2259-4017-b42a-1ad8344e32b5 None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:26.733719 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27da43-2259-4017-b42a-1ad8344e32b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:26.734174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27da43-2259-4017-b42a-1ad8344e32b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:26.736028 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c27da43-2259-4017-b42a-1ad8344e32b5 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:26.749779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 315/630] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:26.750883 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27da43-2259-4017-b42a-1ad8344e32b5 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:26.813726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:26.823888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc715d4a-6b59-4c5b-ad88-223a82063c3c None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:26.859977 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26253d8b-947f-4fe9-a776-995405d37416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:26.860273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c27da43-2259-4017-b42a-1ad8344e32b5 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:26.860655 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26253d8b-947f-4fe9-a776-995405d37416 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:26.860943 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26253d8b-947f-4fe9-a776-995405d37416 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:26.861225 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26253d8b-947f-4fe9-a776-995405d37416 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:26.862073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26253d8b-947f-4fe9-a776-995405d37416 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:26.862544 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26253d8b-947f-4fe9-a776-995405d37416 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:26.864139 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26253d8b-947f-4fe9-a776-995405d37416 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:26.884489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 316/631] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jun 27 18:33:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:26.885517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26253d8b-947f-4fe9-a776-995405d37416 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:26.897445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c94be0-a11b-42c8-bcbc-f4e4f459077e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:26.899085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c94be0-a11b-42c8-bcbc-f4e4f459077e None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:26.899513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c94be0-a11b-42c8-bcbc-f4e4f459077e None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:26.900042 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c94be0-a11b-42c8-bcbc-f4e4f459077e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:26.911162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c94be0-a11b-42c8-bcbc-f4e4f459077e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:26.912963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c94be0-a11b-42c8-bcbc-f4e4f459077e None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:26.931492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-74c94be0-a11b-42c8-bcbc-f4e4f459077e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:26.931492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:26.931492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:26.931492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:26.931492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:26.931492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:26.931492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:26.931492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:26.931492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:26.931492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:26.931492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:26.931492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:26.931492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:26.931492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:26.931492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:26.932564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:26.932564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:26.932564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:26.932564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:26.932564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:26.932564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:26.932564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:26.932564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:26.932564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:26.932564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:26.932564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:26.932564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:26.932564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:26.932564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:26.932564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:26.932564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:26.932564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:26.933549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:26.933549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:26.933549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:26.933549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:26.935593 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 316/632] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:26.936529 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c94be0-a11b-42c8-bcbc-f4e4f459077e None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:26.946715 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:26.998834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26253d8b-947f-4fe9-a776-995405d37416 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:27.037329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515671b5-5f2b-4786-b7a9-5e1fefe6488b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:27.038222 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515671b5-5f2b-4786-b7a9-5e1fefe6488b None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:27.038511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515671b5-5f2b-4786-b7a9-5e1fefe6488b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:27.039405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515671b5-5f2b-4786-b7a9-5e1fefe6488b None admin] PATH_INFO: `/v3/projects/94dba2006b6747f8badff33745bde432/users/94555ff897d94c90968c470d82ff9e2a/roles/62fd6b166d1847b19e812160b459d5db` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:27.046207 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c94be0-a11b-42c8-bcbc-f4e4f459077e None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:27.055274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515671b5-5f2b-4786-b7a9-5e1fefe6488b None admin] RBAC: Authorizing `identity:create_grant(project_id=94dba2006b6747f8badff33745bde432, user_id=94555ff897d94c90968c470d82ff9e2a, role_id=62fd6b166d1847b19e812160b459d5db)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:27.056776 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515671b5-5f2b-4786-b7a9-5e1fefe6488b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:27.058738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:27.082811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52207ab0-1d3e-4945-9c38-cfb3e8f73efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:27.083388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52207ab0-1d3e-4945-9c38-cfb3e8f73efa None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:27.083706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52207ab0-1d3e-4945-9c38-cfb3e8f73efa None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:27.083987 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52207ab0-1d3e-4945-9c38-cfb3e8f73efa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:27.131178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 317/633] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:33:26 2022] PUT /identity/v3/projects/94dba2006b6747f8badff33745bde432/users/94555ff897d94c90968c470d82ff9e2a/roles/62fd6b166d1847b19e812160b459d5db => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:33:27.133312 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515671b5-5f2b-4786-b7a9-5e1fefe6488b None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:27.161073 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52207ab0-1d3e-4945-9c38-cfb3e8f73efa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:27.163007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52207ab0-1d3e-4945-9c38-cfb3e8f73efa None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:27.261647 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515671b5-5f2b-4786-b7a9-5e1fefe6488b None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:27.264379 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:27.287305 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 317/634] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:33:27.289219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25885d56-2a27-4261-864e-efdfc35cd274 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:27.289699 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25885d56-2a27-4261-864e-efdfc35cd274 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:27.290160 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25885d56-2a27-4261-864e-efdfc35cd274 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:27.295637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 318/635] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:27.296509 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25885d56-2a27-4261-864e-efdfc35cd274 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:27.301530 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591b3d8-cdf1-433b-85a0-3b5c3943ce1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:27.302381 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591b3d8-cdf1-433b-85a0-3b5c3943ce1d None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:27.302676 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591b3d8-cdf1-433b-85a0-3b5c3943ce1d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:27.302953 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591b3d8-cdf1-433b-85a0-3b5c3943ce1d None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:27.303734 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591b3d8-cdf1-433b-85a0-3b5c3943ce1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:27.306460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591b3d8-cdf1-433b-85a0-3b5c3943ce1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:27.307906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591b3d8-cdf1-433b-85a0-3b5c3943ce1d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:27.319564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:27.321937 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 318/636] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:27.323231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a56a2-0edb-45e4-af0c-b49b00769623 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:27.323524 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a56a2-0edb-45e4-af0c-b49b00769623 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:27.327954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a56a2-0edb-45e4-af0c-b49b00769623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:27.350408 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-eb3a56a2-0edb-45e4-af0c-b49b00769623 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:27.350408 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-eb3a56a2-0edb-45e4-af0c-b49b00769623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:27.429960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 319/637] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:27.430952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a56a2-0edb-45e4-af0c-b49b00769623 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:27.440207 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25885d56-2a27-4261-864e-efdfc35cd274 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:27.496256 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0bbb3-7f46-4204-a69c-8dec376ba0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:27.498066 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0bbb3-7f46-4204-a69c-8dec376ba0b3 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:27.498569 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0bbb3-7f46-4204-a69c-8dec376ba0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:27.499065 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0bbb3-7f46-4204-a69c-8dec376ba0b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:27.516928 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0bbb3-7f46-4204-a69c-8dec376ba0b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:27.518401 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0bbb3-7f46-4204-a69c-8dec376ba0b3 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:27.553548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-b7e0bbb3-7f46-4204-a69c-8dec376ba0b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:27.553548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:27.553548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:27.553548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:27.553548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:27.553548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:27.553548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:27.553548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:27.553548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:27.553548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:27.553548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:27.553548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:27.553548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:27.553548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:27.553548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:27.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:27.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:27.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:27.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:27.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:27.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:27.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:27.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:27.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:27.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:27.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:27.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:27.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:27.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:27.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:27.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:27.555100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:27.556092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:27.556092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:27.556092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:27.556092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:27.557389 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 319/638] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:27.558278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0bbb3-7f46-4204-a69c-8dec376ba0b3 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:27.560066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:27.572613 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a56a2-0edb-45e4-af0c-b49b00769623 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:27.624850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495640e-b9b8-4f9a-afe0-391634d233d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:27.624850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495640e-b9b8-4f9a-afe0-391634d233d9 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:27.624850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495640e-b9b8-4f9a-afe0-391634d233d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:27.624850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9495640e-b9b8-4f9a-afe0-391634d233d9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:27.627880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:27.636472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495640e-b9b8-4f9a-afe0-391634d233d9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:27.639000 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9495640e-b9b8-4f9a-afe0-391634d233d9 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:27.653731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-9495640e-b9b8-4f9a-afe0-391634d233d9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 18:33:27.653731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:27.653731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:27.653731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:27.653731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:27.653731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:27.653731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:27.653731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:27.653731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:27.653731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:27.653731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:27.653731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:27.653731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:27.653731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:27.653731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:27.653731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:27.654816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:27.655798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:27.655798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:27.655798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:27.655798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:27.655798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:27.655798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:27.655798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:27.655798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:27.655798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 18:33:27.655798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:27.659623 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 320/639] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:33:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:27.660492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495640e-b9b8-4f9a-afe0-391634d233d9 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:27.680136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0bbb3-7f46-4204-a69c-8dec376ba0b3 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:27.723410 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45379e-c8ea-4ec1-a37f-3affd9be6485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:27.724663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45379e-c8ea-4ec1-a37f-3affd9be6485 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:27.725107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45379e-c8ea-4ec1-a37f-3affd9be6485 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:27.725393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45379e-c8ea-4ec1-a37f-3affd9be6485 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:27.736524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45379e-c8ea-4ec1-a37f-3affd9be6485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:27.744970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-ee45379e-c8ea-4ec1-a37f-3affd9be6485 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:27.744970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:27.744970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:27.744970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:27.744970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:27.744970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:27.744970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:27.744970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:27.744970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:27.744970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:27.744970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:27.744970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:27.744970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:27.744970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:27.744970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:27.744970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:27.745999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:27.745999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:27.745999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:27.745999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:27.745999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:27.745999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:27.745999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:27.745999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:27.745999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:27.745999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:27.745999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:27.745999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:27.745999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:27.745999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:27.745999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:27.745999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:27.746859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:27.746859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:27.746859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:27.746859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:27.746859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:27.746859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:27.746859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:27.746859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:27.746859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:27.746859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:27.746859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:27.746859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:27.746859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 320/640] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:27.747643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45379e-c8ea-4ec1-a37f-3affd9be6485 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:27.777805 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9495640e-b9b8-4f9a-afe0-391634d233d9 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:27.819820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc949d-094e-4e78-85c1-98830e0c5df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:27.820056 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc949d-094e-4e78-85c1-98830e0c5df6 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:27.820147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc949d-094e-4e78-85c1-98830e0c5df6 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:27.820426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc949d-094e-4e78-85c1-98830e0c5df6 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:27.821157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc949d-094e-4e78-85c1-98830e0c5df6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:27.821466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc949d-094e-4e78-85c1-98830e0c5df6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:27.822913 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc949d-094e-4e78-85c1-98830e0c5df6 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:27.835070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 321/641] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:27.836661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381b4de-f59f-40ec-af5a-5fc26732bbc1 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:27.837187 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381b4de-f59f-40ec-af5a-5fc26732bbc1 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:27.837679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381b4de-f59f-40ec-af5a-5fc26732bbc1 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:27.839120 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 322/642] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:27.840056 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381b4de-f59f-40ec-af5a-5fc26732bbc1 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:27.856211 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:27.861393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45379e-c8ea-4ec1-a37f-3affd9be6485 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:27.886277 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:27.897780 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d04bf-a1a3-4cde-849b-4f4028e0324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:27.898486 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d04bf-a1a3-4cde-849b-4f4028e0324f None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:27.898766 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d04bf-a1a3-4cde-849b-4f4028e0324f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:27.899041 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d04bf-a1a3-4cde-849b-4f4028e0324f None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:27.899905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d04bf-a1a3-4cde-849b-4f4028e0324f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:27.900217 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d04bf-a1a3-4cde-849b-4f4028e0324f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:27.901657 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d04bf-a1a3-4cde-849b-4f4028e0324f None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:27.922260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 321/643] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Jun 27 18:33:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:27.923467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d04bf-a1a3-4cde-849b-4f4028e0324f None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:27.949982 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381b4de-f59f-40ec-af5a-5fc26732bbc1 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:27.987341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128345a2-8a9c-4446-87e2-068c0c569b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:27.988064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128345a2-8a9c-4446-87e2-068c0c569b8e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:27.988356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128345a2-8a9c-4446-87e2-068c0c569b8e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:27.988641 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128345a2-8a9c-4446-87e2-068c0c569b8e None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:27.989399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128345a2-8a9c-4446-87e2-068c0c569b8e None admin] RBAC: Adding query filter params (name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:27.989723 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128345a2-8a9c-4446-87e2-068c0c569b8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:27.991084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128345a2-8a9c-4446-87e2-068c0c569b8e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:28.000012 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 323/644] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:28.005712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdf570-ddf0-4b1f-acf4-2d65be7a272e None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:28.006017 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdf570-ddf0-4b1f-acf4-2d65be7a272e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:28.006307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abdf570-ddf0-4b1f-acf4-2d65be7a272e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:28.022837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-2abdf570-ddf0-4b1f-acf4-2d65be7a272e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:28.024618 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-2abdf570-ddf0-4b1f-acf4-2d65be7a272e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:28.028538 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d04bf-a1a3-4cde-849b-4f4028e0324f None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:28.063706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77cc74-baf8-4e13-85f2-788657fecd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:28.064587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77cc74-baf8-4e13-85f2-788657fecd9a None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:28.064873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77cc74-baf8-4e13-85f2-788657fecd9a None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:28.065146 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77cc74-baf8-4e13-85f2-788657fecd9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:28.072095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77cc74-baf8-4e13-85f2-788657fecd9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:28.073523 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e77cc74-baf8-4e13-85f2-788657fecd9a None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:28.087851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-8e77cc74-baf8-4e13-85f2-788657fecd9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:28.087851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:28.087851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:28.087851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:28.087851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:28.087851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:28.087851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:28.087851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:28.087851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:28.087851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:28.087851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:28.087851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:28.087851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:28.087851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:28.087851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:28.088752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:28.088752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:28.088752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:28.088752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:28.088752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:28.088752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:28.088752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:28.088752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:28.088752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:28.088752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:28.088752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:28.088752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:28.088752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:28.088752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:28.088752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:28.088752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:28.088752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:28.089810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:28.089810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:28.089810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:28.089810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:28.089810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:28.089810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:28.089810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:28.089810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:28.089810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 322/645] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:28.090325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77cc74-baf8-4e13-85f2-788657fecd9a None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:28.107722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 324/646] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:28.107722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdf570-ddf0-4b1f-acf4-2d65be7a272e None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:28.109485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:28.142807 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:28.201571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e77cc74-baf8-4e13-85f2-788657fecd9a None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:28.213014 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abdf570-ddf0-4b1f-acf4-2d65be7a272e None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:28.236204 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175be36-1267-4922-9b20-bd49909fdb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:28.236857 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175be36-1267-4922-9b20-bd49909fdb77 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:28.237138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175be36-1267-4922-9b20-bd49909fdb77 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:28.237411 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175be36-1267-4922-9b20-bd49909fdb77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:28.248059 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197e6a2-1544-4beb-8a4b-9e60924ac0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:28.248858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197e6a2-1544-4beb-8a4b-9e60924ac0bf None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:28.249146 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197e6a2-1544-4beb-8a4b-9e60924ac0bf None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:28.249425 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3197e6a2-1544-4beb-8a4b-9e60924ac0bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:28.259700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197e6a2-1544-4beb-8a4b-9e60924ac0bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:28.261168 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3197e6a2-1544-4beb-8a4b-9e60924ac0bf None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:28.280042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-3197e6a2-1544-4beb-8a4b-9e60924ac0bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:28.280042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:28.280042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:28.280042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:28.280042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:28.280042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:28.280042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:28.280042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:28.280042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:28.280042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:28.280042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:28.280042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:28.280042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:28.280042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:28.280042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:28.281031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:28.281031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:28.281031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:28.281031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:28.281031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:28.281031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:28.281031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:28.281031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:28.281031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:28.281031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:28.281031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:28.281031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:28.281031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:28.281031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:28.281031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:28.281031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:28.281031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:28.281925 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:28.281925 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:28.281925 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:28.281925 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:28.281925 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 325/647] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:28.282199 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197e6a2-1544-4beb-8a4b-9e60924ac0bf None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:28.310972 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175be36-1267-4922-9b20-bd49909fdb77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:28.312475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175be36-1267-4922-9b20-bd49909fdb77 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:28.341715 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:28.355273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:28.385764 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3197e6a2-1544-4beb-8a4b-9e60924ac0bf None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:28.418602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 323/648] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:33:28.419362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175be36-1267-4922-9b20-bd49909fdb77 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:28.425474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee953ccf-797e-460b-a736-ace1e16372f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:28.426131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee953ccf-797e-460b-a736-ace1e16372f1 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:28.426418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee953ccf-797e-460b-a736-ace1e16372f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:28.426695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee953ccf-797e-460b-a736-ace1e16372f1 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:28.427483 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee953ccf-797e-460b-a736-ace1e16372f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:28.427826 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee953ccf-797e-460b-a736-ace1e16372f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:28.429289 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee953ccf-797e-460b-a736-ace1e16372f1 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:28.441079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 326/649] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:28.441712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee953ccf-797e-460b-a736-ace1e16372f1 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:28.529907 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175be36-1267-4922-9b20-bd49909fdb77 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:28.555593 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee953ccf-797e-460b-a736-ace1e16372f1 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:28.564151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08d083-a5d8-40fd-8ae4-61f45967b701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:28.564936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08d083-a5d8-40fd-8ae4-61f45967b701 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:28.565217 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08d083-a5d8-40fd-8ae4-61f45967b701 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:28.565489 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08d083-a5d8-40fd-8ae4-61f45967b701 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:28.572413 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:28.573696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:28.576893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08d083-a5d8-40fd-8ae4-61f45967b701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:28.584648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-9b08d083-a5d8-40fd-8ae4-61f45967b701 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:28.584648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:28.584648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:28.584648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:28.584648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:28.584648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:28.584648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:28.584648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:28.584648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:28.584648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:28.584648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:28.584648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:28.584648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:28.584648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:28.584648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:28.584648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:28.586382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:28.586382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:28.586382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:28.586382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:28.586382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:28.586382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:28.586382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:28.586382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:28.586382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:28.586382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:28.586382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:28.586382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:28.586382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:28.586382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:28.586382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:28.586382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:28.587408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:28.587408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:28.587408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:28.587408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:28.587408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:28.587408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:28.587408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:28.587408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:28.587408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:28.587408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:28.587408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:28.587408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:28.591227 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 324/650] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:28.592070 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08d083-a5d8-40fd-8ae4-61f45967b701 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:28.593819 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a06439-d793-42ae-9dac-dcf1abd56573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:28.597467 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a06439-d793-42ae-9dac-dcf1abd56573 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:28.597467 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a06439-d793-42ae-9dac-dcf1abd56573 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:28.597467 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a06439-d793-42ae-9dac-dcf1abd56573 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:28.597467 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a06439-d793-42ae-9dac-dcf1abd56573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:28.597467 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a06439-d793-42ae-9dac-dcf1abd56573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:28.597467 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a06439-d793-42ae-9dac-dcf1abd56573 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:28.610389 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 327/651] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:28.611190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a06439-d793-42ae-9dac-dcf1abd56573 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:28.711577 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a06439-d793-42ae-9dac-dcf1abd56573 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:28.714159 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08d083-a5d8-40fd-8ae4-61f45967b701 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:28.745829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be3180-4b4d-4f23-b621-4bedf9e75799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:28.746478 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be3180-4b4d-4f23-b621-4bedf9e75799 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:28.746764 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be3180-4b4d-4f23-b621-4bedf9e75799 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:28.747041 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be3180-4b4d-4f23-b621-4bedf9e75799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:28.747901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be3180-4b4d-4f23-b621-4bedf9e75799 None admin] RBAC: Adding query filter params (role.id=62fd6b166d1847b19e812160b459d5db, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=da1746d29f9e4e8b8626ad4b11931cbd) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:28.748217 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be3180-4b4d-4f23-b621-4bedf9e75799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:28.749653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be3180-4b4d-4f23-b621-4bedf9e75799 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:28.750164 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfd152-c9ce-47b5-b42e-4d8bca2bfd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:28.750965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfd152-c9ce-47b5-b42e-4d8bca2bfd34 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:28.751369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfd152-c9ce-47b5-b42e-4d8bca2bfd34 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:28.751695 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cfd152-c9ce-47b5-b42e-4d8bca2bfd34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:28.767837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 328/652] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:33:28 2022] GET /identity/v3/role_assignments?user.id=da1746d29f9e4e8b8626ad4b11931cbd&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=62fd6b166d1847b19e812160b459d5db => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:28.767837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be3180-4b4d-4f23-b621-4bedf9e75799 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:28.774555 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfd152-c9ce-47b5-b42e-4d8bca2bfd34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:28.776335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cfd152-c9ce-47b5-b42e-4d8bca2bfd34 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:28.796460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-e9cfd152-c9ce-47b5-b42e-4d8bca2bfd34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:28.796460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:28.796460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:28.796460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:28.796460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:28.796460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:28.796460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:28.796460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:28.796460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:28.796460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:28.796460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:28.796460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:28.796460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:28.796460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:28.796460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:28.797637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:28.797637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:28.797637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:28.797637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:28.797637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:28.797637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:28.797637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:28.797637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:28.797637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:28.797637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:28.797637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:28.797637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:28.797637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:28.797637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:28.797637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:28.797637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:28.797637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:28.798748 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:28.798748 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:28.798748 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:28.798748 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:28.804872 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 325/653] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:28.806171 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfd152-c9ce-47b5-b42e-4d8bca2bfd34 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:28.825908 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:28.878713 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:28.908758 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be3180-4b4d-4f23-b621-4bedf9e75799 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:28.934720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cfd152-c9ce-47b5-b42e-4d8bca2bfd34 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:28.962058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58186b-c99f-494f-9fa4-1039e7a6117b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:28.962752 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58186b-c99f-494f-9fa4-1039e7a6117b None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:28.963041 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58186b-c99f-494f-9fa4-1039e7a6117b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:28.963318 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58186b-c99f-494f-9fa4-1039e7a6117b None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:28.964150 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58186b-c99f-494f-9fa4-1039e7a6117b None admin] RBAC: Adding query filter params (name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:28.964464 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58186b-c99f-494f-9fa4-1039e7a6117b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:28.965838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58186b-c99f-494f-9fa4-1039e7a6117b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:28.974714 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 329/654] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:28.975360 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58186b-c99f-494f-9fa4-1039e7a6117b None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:28.978519 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a4d41-72db-4249-946a-129531d2162c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:28.979330 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a4d41-72db-4249-946a-129531d2162c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:28.979690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a4d41-72db-4249-946a-129531d2162c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:28.979965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a4d41-72db-4249-946a-129531d2162c None admin] PATH_INFO: `/v3/users/glance` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:28.988561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a4d41-72db-4249-946a-129531d2162c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:28.990007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a4d41-72db-4249-946a-129531d2162c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:29.006012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-436a4d41-72db-4249-946a-129531d2162c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 27 18:33:29.006012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:29.006012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:29.006012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:29.006012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:29.006012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:29.006012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:29.006012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:29.006012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:29.006012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:29.006012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:29.006012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:29.006012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:29.006012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:29.006012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:29.006012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:29.007001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:29.008014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:29.008014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:29.008014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:29.008014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:29.008014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:29.008014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:29.008014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:29.008014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:29.008014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 27 18:33:29.008014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:29.008566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 326/655] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:33:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:29.009216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a4d41-72db-4249-946a-129531d2162c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:29.100245 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58186b-c99f-494f-9fa4-1039e7a6117b None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:29.102905 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:29.127087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a4d41-72db-4249-946a-129531d2162c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:29.142302 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d1f19-a9e1-41ff-9460-f41fa1a4d20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:29.142995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d1f19-a9e1-41ff-9460-f41fa1a4d20a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:29.143279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d1f19-a9e1-41ff-9460-f41fa1a4d20a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:29.143575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d1f19-a9e1-41ff-9460-f41fa1a4d20a None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:29.144474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d1f19-a9e1-41ff-9460-f41fa1a4d20a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:29.144598 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:29.145234 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d1f19-a9e1-41ff-9460-f41fa1a4d20a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:29.147302 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d1f19-a9e1-41ff-9460-f41fa1a4d20a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:29.162860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 330/656] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:29.164399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d1f19-a9e1-41ff-9460-f41fa1a4d20a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:29.170021 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb252f5-882b-49a5-b935-857080805ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:29.170817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb252f5-882b-49a5-b935-857080805ccf None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:29.171158 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb252f5-882b-49a5-b935-857080805ccf None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:29.171503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb252f5-882b-49a5-b935-857080805ccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:29.185680 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb252f5-882b-49a5-b935-857080805ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:29.187753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb252f5-882b-49a5-b935-857080805ccf None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:29.207925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-5cb252f5-882b-49a5-b935-857080805ccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:29.207925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:29.207925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:29.207925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:29.207925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:29.207925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:29.207925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:29.207925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:29.207925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:29.207925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:29.207925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:29.207925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:29.207925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:29.207925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:29.207925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:29.208864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:29.208864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:29.208864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:29.208864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:29.208864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:29.208864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:29.208864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:29.208864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:29.208864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:29.208864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:29.208864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:29.208864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:29.208864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:29.208864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:29.208864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:29.208864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:29.208864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:29.209796 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:29.209796 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:29.209796 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:29.209796 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:29.212635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 327/657] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:29.213642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb252f5-882b-49a5-b935-857080805ccf None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:29.280546 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d1f19-a9e1-41ff-9460-f41fa1a4d20a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:29.318263 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041f294-5d29-42b4-bf78-2cb3f5f4a26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:29.318935 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041f294-5d29-42b4-bf78-2cb3f5f4a26b None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:29.319226 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041f294-5d29-42b4-bf78-2cb3f5f4a26b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:29.319501 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041f294-5d29-42b4-bf78-2cb3f5f4a26b None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:29.320932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041f294-5d29-42b4-bf78-2cb3f5f4a26b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:29.321218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041f294-5d29-42b4-bf78-2cb3f5f4a26b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:29.322655 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041f294-5d29-42b4-bf78-2cb3f5f4a26b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:29.326542 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb252f5-882b-49a5-b935-857080805ccf None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:29.345036 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 331/658] 10.222.0.36 () {56 vars in 1137 bytes} [Mon Jun 27 18:33:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:29.345036 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041f294-5d29-42b4-bf78-2cb3f5f4a26b None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:29.365505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:29.369244 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0911cc0-b613-4632-9bbb-68e2fe979e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:29.370049 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0911cc0-b613-4632-9bbb-68e2fe979e27 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:29.370339 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0911cc0-b613-4632-9bbb-68e2fe979e27 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:29.370621 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0911cc0-b613-4632-9bbb-68e2fe979e27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:29.379540 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0911cc0-b613-4632-9bbb-68e2fe979e27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:29.381027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0911cc0-b613-4632-9bbb-68e2fe979e27 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:29.400644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-e0911cc0-b613-4632-9bbb-68e2fe979e27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:29.400644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:29.400644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:29.400644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:29.400644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:29.400644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:29.400644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:29.400644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:29.400644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:29.400644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:29.400644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:29.400644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:29.400644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:29.400644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:29.400644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:29.401587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:29.401587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:29.401587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:29.401587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:29.401587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:29.401587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:29.401587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:29.401587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:29.401587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:29.401587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:29.401587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:29.401587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:29.401587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:29.401587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:29.401587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:29.401587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:29.401587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:29.402496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:29.402496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:29.402496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:29.402496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:29.402496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:29.402496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:29.402496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:29.402496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:29.403678 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 328/659] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:29.405061 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59005-59fd-4996-a69d-c66cbad4c560 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:29.405478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59005-59fd-4996-a69d-c66cbad4c560 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:29.405824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e59005-59fd-4996-a69d-c66cbad4c560 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:29.407343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 329/660] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:29.408248 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e59005-59fd-4996-a69d-c66cbad4c560 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:29.434525 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:29.456029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041f294-5d29-42b4-bf78-2cb3f5f4a26b None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:29.493215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337f4c5-2c46-4eb0-8ad9-6705fb2c997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:29.493780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337f4c5-2c46-4eb0-8ad9-6705fb2c997a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:29.494070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337f4c5-2c46-4eb0-8ad9-6705fb2c997a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:29.494350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c337f4c5-2c46-4eb0-8ad9-6705fb2c997a None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:29.495073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337f4c5-2c46-4eb0-8ad9-6705fb2c997a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:29.495384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337f4c5-2c46-4eb0-8ad9-6705fb2c997a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:29.496806 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c337f4c5-2c46-4eb0-8ad9-6705fb2c997a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:29.508163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 332/661] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:29.508949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337f4c5-2c46-4eb0-8ad9-6705fb2c997a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:29.521601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e59005-59fd-4996-a69d-c66cbad4c560 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:29.561676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e84cb4-7d1b-4bde-864a-8edef01c0e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:29.562438 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e84cb4-7d1b-4bde-864a-8edef01c0e86 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:29.562793 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e84cb4-7d1b-4bde-864a-8edef01c0e86 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:29.563147 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e84cb4-7d1b-4bde-864a-8edef01c0e86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:29.596298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:29.616688 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c337f4c5-2c46-4eb0-8ad9-6705fb2c997a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:29.635105 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e84cb4-7d1b-4bde-864a-8edef01c0e86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:29.636644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e84cb4-7d1b-4bde-864a-8edef01c0e86 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:29.653660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecb212-43a4-4248-b655-1b1e6b1dfc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:29.654324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecb212-43a4-4248-b655-1b1e6b1dfc88 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:29.654620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecb212-43a4-4248-b655-1b1e6b1dfc88 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:29.654903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecb212-43a4-4248-b655-1b1e6b1dfc88 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:29.655722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecb212-43a4-4248-b655-1b1e6b1dfc88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:29.656051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecb212-43a4-4248-b655-1b1e6b1dfc88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:29.657465 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecb212-43a4-4248-b655-1b1e6b1dfc88 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:29.664797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:29.670568 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 333/662] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:29.671840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e495a-7378-4836-8fb0-1ea5a918ac0d None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:29.672127 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e495a-7378-4836-8fb0-1ea5a918ac0d None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:29.672404 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e495a-7378-4836-8fb0-1ea5a918ac0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:29.690518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-df4e495a-7378-4836-8fb0-1ea5a918ac0d None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:29.691768 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-df4e495a-7378-4836-8fb0-1ea5a918ac0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:29.748778 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 330/663] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:33:29.750058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e84cb4-7d1b-4bde-864a-8edef01c0e86 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:29.763138 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 334/664] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:29.764251 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e495a-7378-4836-8fb0-1ea5a918ac0d None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:29.844228 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:29.867730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e84cb4-7d1b-4bde-864a-8edef01c0e86 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:29.880079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e495a-7378-4836-8fb0-1ea5a918ac0d None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:29.892868 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:29.903197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48a4e7-3b70-4f89-8a19-2dc94eb1983d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:29.906680 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48a4e7-3b70-4f89-8a19-2dc94eb1983d None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:29.906680 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48a4e7-3b70-4f89-8a19-2dc94eb1983d None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:29.906680 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48a4e7-3b70-4f89-8a19-2dc94eb1983d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:29.911686 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48a4e7-3b70-4f89-8a19-2dc94eb1983d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:29.913131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48a4e7-3b70-4f89-8a19-2dc94eb1983d None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:29.918164 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce2ffc-7c31-46b2-8b9c-180a49e7b714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:29.918825 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2ffc-7c31-46b2-8b9c-180a49e7b714 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:29.919116 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2ffc-7c31-46b2-8b9c-180a49e7b714 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:29.919395 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce2ffc-7c31-46b2-8b9c-180a49e7b714 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:29.920267 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce2ffc-7c31-46b2-8b9c-180a49e7b714 None admin] RBAC: Adding query filter params (role.id=62fd6b166d1847b19e812160b459d5db, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=f7ccc6b9aeef498a93030b48306fe402) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:29.920610 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce2ffc-7c31-46b2-8b9c-180a49e7b714 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:29.922034 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce2ffc-7c31-46b2-8b9c-180a49e7b714 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:29.928258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-1c48a4e7-3b70-4f89-8a19-2dc94eb1983d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 18:33:29.928258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:29.928258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:29.928258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:29.928258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:29.928258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:29.928258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:29.928258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:29.928258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:29.928258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:29.928258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:29.928258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:29.928258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:29.928258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:29.928258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:29.928258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:29.930120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:29.931310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:29.931310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:29.931310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:29.931310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:29.931310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:29.931310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:29.931310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:29.931310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:29.931310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 27 18:33:29.931310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:29.935693 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 331/665] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:29.936802 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48a4e7-3b70-4f89-8a19-2dc94eb1983d None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:29.938036 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 335/666] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:33:29 2022] GET /identity/v3/role_assignments?user.id=f7ccc6b9aeef498a93030b48306fe402&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=62fd6b166d1847b19e812160b459d5db => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:29.939018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce2ffc-7c31-46b2-8b9c-180a49e7b714 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:30.062075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce2ffc-7c31-46b2-8b9c-180a49e7b714 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:30.086156 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48a4e7-3b70-4f89-8a19-2dc94eb1983d None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:30.114222 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec91585-441c-4ec5-9a4a-054d38220b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:30.115485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec91585-441c-4ec5-9a4a-054d38220b27 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:30.116271 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec91585-441c-4ec5-9a4a-054d38220b27 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:30.116996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec91585-441c-4ec5-9a4a-054d38220b27 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:30.119952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:30.127208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e249e4-1121-4782-97a9-dd8403288947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:30.128145 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e249e4-1121-4782-97a9-dd8403288947 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:30.128431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e249e4-1121-4782-97a9-dd8403288947 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:30.135685 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e249e4-1121-4782-97a9-dd8403288947 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:30.135790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec91585-441c-4ec5-9a4a-054d38220b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:30.141113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-0ec91585-441c-4ec5-9a4a-054d38220b27 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:30.141113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:30.141113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:30.141113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:30.141113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:30.141113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:30.141113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:30.141113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:30.141113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:30.141113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:30.141113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:30.141113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:30.141113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:30.141113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:30.141113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:30.141113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:30.142043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:30.142043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:30.142043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:30.142043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:30.142043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:30.142043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:30.142043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:30.142043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:30.142043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:30.142043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:30.142043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:30.142043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:30.142043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:30.142043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:30.142043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:30.142043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:30.143624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:30.143624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:30.143624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:30.143624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:30.143624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:30.143624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:30.143624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:30.143624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:30.143624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:30.143624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:30.143624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:30.143624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:30.143624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 336/667] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:30.143624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec91585-441c-4ec5-9a4a-054d38220b27 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:30.146153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e249e4-1121-4782-97a9-dd8403288947 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:30.147224 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e249e4-1121-4782-97a9-dd8403288947 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:30.169136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-81e249e4-1121-4782-97a9-dd8403288947 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:30.169136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:30.169136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:30.169136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:30.169136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:30.169136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:30.169136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:30.169136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:30.169136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:30.169136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:30.169136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:30.169136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:30.169136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:30.169136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:30.169136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:30.170281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:30.170281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:30.170281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:30.170281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:30.170281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:30.170281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:30.170281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:30.170281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:30.170281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:30.170281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:30.170281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:30.170281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:30.170281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:30.170281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:30.170281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:30.170281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:30.170281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:30.171478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:30.171478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:30.171478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:30.171478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:30.171478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 332/668] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:30.171478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e249e4-1121-4782-97a9-dd8403288947 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:30.227367 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:30.280412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec91585-441c-4ec5-9a4a-054d38220b27 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:30.296818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e249e4-1121-4782-97a9-dd8403288947 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:30.324585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d2414-05f3-414a-bc0b-bb5e3bfad7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:30.325569 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d2414-05f3-414a-bc0b-bb5e3bfad7c3 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:30.326221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d2414-05f3-414a-bc0b-bb5e3bfad7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:30.326604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d2414-05f3-414a-bc0b-bb5e3bfad7c3 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:30.328239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d2414-05f3-414a-bc0b-bb5e3bfad7c3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:30.328666 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d2414-05f3-414a-bc0b-bb5e3bfad7c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:30.330229 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5d2414-05f3-414a-bc0b-bb5e3bfad7c3 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:30.332067 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692acde6-660e-405b-800c-8e7ec4c2abf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:30.332838 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692acde6-660e-405b-800c-8e7ec4c2abf4 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:30.333195 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692acde6-660e-405b-800c-8e7ec4c2abf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:30.333475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692acde6-660e-405b-800c-8e7ec4c2abf4 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:30.334325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692acde6-660e-405b-800c-8e7ec4c2abf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:30.334702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692acde6-660e-405b-800c-8e7ec4c2abf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:30.336680 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692acde6-660e-405b-800c-8e7ec4c2abf4 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:30.349411 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 333/669] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:30.350239 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692acde6-660e-405b-800c-8e7ec4c2abf4 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:30.360384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 337/670] 10.222.0.36 () {56 vars in 1139 bytes} [Mon Jun 27 18:33:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:30.361311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d2414-05f3-414a-bc0b-bb5e3bfad7c3 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:30.419881 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:30.465276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:30.469172 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692acde6-660e-405b-800c-8e7ec4c2abf4 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:30.473039 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d2414-05f3-414a-bc0b-bb5e3bfad7c3 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:30.509182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed2000-1338-4c98-9d27-3410612ee86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:30.509971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed2000-1338-4c98-9d27-3410612ee86e None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:30.513789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed2000-1338-4c98-9d27-3410612ee86e None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:30.514186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed2000-1338-4c98-9d27-3410612ee86e None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:30.515054 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed2000-1338-4c98-9d27-3410612ee86e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:30.515477 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed2000-1338-4c98-9d27-3410612ee86e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:30.516916 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf11475-5c97-4d18-83f9-43378c9306f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:30.517143 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed2000-1338-4c98-9d27-3410612ee86e None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:30.518389 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf11475-5c97-4d18-83f9-43378c9306f6 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:30.518841 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf11475-5c97-4d18-83f9-43378c9306f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:30.519380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf11475-5c97-4d18-83f9-43378c9306f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:30.533310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf11475-5c97-4d18-83f9-43378c9306f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:30.538229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 334/671] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:30.538229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed2000-1338-4c98-9d27-3410612ee86e None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:30.539758 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf11475-5c97-4d18-83f9-43378c9306f6 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:30.562062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-2bf11475-5c97-4d18-83f9-43378c9306f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:30.562062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:30.562062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:30.562062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:30.562062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:30.562062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:30.562062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:30.562062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:30.562062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:30.562062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:30.562062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:30.562062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:30.562062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:30.562062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:30.562062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:30.563048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:30.563048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:30.563048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:30.563048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:30.563048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:30.563048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:30.563048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:30.563048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:30.563048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:30.563048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:30.563048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:30.563048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:30.563048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:30.563048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:30.563048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:30.563048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:30.563048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:30.564360 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:30.564360 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:30.564360 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:30.564360 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:30.568045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 338/672] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:30.568902 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf11475-5c97-4d18-83f9-43378c9306f6 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:30.649839 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed2000-1338-4c98-9d27-3410612ee86e None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:30.677644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf11475-5c97-4d18-83f9-43378c9306f6 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:30.681402 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:30.696975 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1e213-e78c-476c-ab65-94f6a1937547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:30.698353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1e213-e78c-476c-ab65-94f6a1937547 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:30.698855 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1e213-e78c-476c-ab65-94f6a1937547 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:30.699361 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1e213-e78c-476c-ab65-94f6a1937547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:30.716642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf33f70-9271-4b38-8488-f8989e36d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:30.717451 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf33f70-9271-4b38-8488-f8989e36d231 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:30.717770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf33f70-9271-4b38-8488-f8989e36d231 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:30.718010 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf33f70-9271-4b38-8488-f8989e36d231 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:30.726476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf33f70-9271-4b38-8488-f8989e36d231 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:30.729562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf33f70-9271-4b38-8488-f8989e36d231 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:30.735836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:30.746125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-5cf33f70-9271-4b38-8488-f8989e36d231 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:30.746125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:30.746125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:30.746125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:30.746125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:30.746125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:30.746125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:30.746125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:30.746125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:30.746125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:30.746125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:30.746125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:30.746125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:30.746125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:30.746125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:30.749396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:30.749396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:30.749396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:30.749396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:30.749396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:30.749396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:30.749396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:30.749396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:30.749396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:30.749396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:30.749396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:30.749396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:30.749396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:30.749396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:30.749396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:30.749396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:30.749396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:30.750322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:30.750322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:30.750322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:30.750322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:30.750322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:30.750322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:30.750322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:30.750322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:30.752194 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 339/673] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:30.753041 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf33f70-9271-4b38-8488-f8989e36d231 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:30.793970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1e213-e78c-476c-ab65-94f6a1937547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:30.795826 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1e213-e78c-476c-ab65-94f6a1937547 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:30.867123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf33f70-9271-4b38-8488-f8989e36d231 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:30.918566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d21154-2a09-44e4-b072-cae83c6bc4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:30.918566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d21154-2a09-44e4-b072-cae83c6bc4ed None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:30.918566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d21154-2a09-44e4-b072-cae83c6bc4ed None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:30.918566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d21154-2a09-44e4-b072-cae83c6bc4ed None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:30.918973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d21154-2a09-44e4-b072-cae83c6bc4ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:30.918973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d21154-2a09-44e4-b072-cae83c6bc4ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:30.918973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d21154-2a09-44e4-b072-cae83c6bc4ed None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:30.932515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 340/674] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:30.933346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d21154-2a09-44e4-b072-cae83c6bc4ed None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:30.935689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 335/675] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:33:30.937090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1e213-e78c-476c-ab65-94f6a1937547 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:30.964337 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:31.000484 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:31.040772 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d21154-2a09-44e4-b072-cae83c6bc4ed None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:31.044155 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1e213-e78c-476c-ab65-94f6a1937547 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:31.074788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebb3ef-f9b0-4fe2-97fa-016b04d2fd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:31.075428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebb3ef-f9b0-4fe2-97fa-016b04d2fd83 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:31.075742 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebb3ef-f9b0-4fe2-97fa-016b04d2fd83 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:31.076028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebb3ef-f9b0-4fe2-97fa-016b04d2fd83 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:31.076817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebb3ef-f9b0-4fe2-97fa-016b04d2fd83 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:31.077134 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebb3ef-f9b0-4fe2-97fa-016b04d2fd83 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:31.078563 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebb3ef-f9b0-4fe2-97fa-016b04d2fd83 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:31.082004 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fa98e-8499-4f1c-ac2f-98f6a9037fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:31.082793 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fa98e-8499-4f1c-ac2f-98f6a9037fec None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:31.083074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fa98e-8499-4f1c-ac2f-98f6a9037fec None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:31.083348 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fa98e-8499-4f1c-ac2f-98f6a9037fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:31.091075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 341/676] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:31.092093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebb3ef-f9b0-4fe2-97fa-016b04d2fd83 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:31.098584 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fa98e-8499-4f1c-ac2f-98f6a9037fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:31.100064 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fa98e-8499-4f1c-ac2f-98f6a9037fec None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:31.120647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-a57fa98e-8499-4f1c-ac2f-98f6a9037fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:31.120647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:31.120647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:31.120647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:31.120647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:31.120647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:31.120647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:31.120647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:31.120647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:31.120647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:31.120647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:31.120647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:31.120647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:31.120647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:31.120647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:31.121738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:31.121738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:31.121738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:31.121738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:31.121738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:31.121738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:31.121738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:31.121738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:31.121738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:31.121738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:31.121738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:31.121738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:31.121738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:31.121738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:31.121738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:31.121738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:31.121738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:31.122817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:31.122817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:31.122817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:31.122817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:31.122817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 336/677] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:31.123328 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc9952-4f70-4667-aea9-4a5906706382 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:31.123634 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc9952-4f70-4667-aea9-4a5906706382 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:31.123909 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc9952-4f70-4667-aea9-4a5906706382 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:31.125289 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 337/678] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:31.128261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc9952-4f70-4667-aea9-4a5906706382 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:31.193538 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:31.209725 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebb3ef-f9b0-4fe2-97fa-016b04d2fd83 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:31.246100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2772a91-decf-45da-a070-e52c4b700c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:31.246899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2772a91-decf-45da-a070-e52c4b700c01 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:31.247290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2772a91-decf-45da-a070-e52c4b700c01 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:31.247692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2772a91-decf-45da-a070-e52c4b700c01 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:31.248614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc9952-4f70-4667-aea9-4a5906706382 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:31.255384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2772a91-decf-45da-a070-e52c4b700c01 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:31.256939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2772a91-decf-45da-a070-e52c4b700c01 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:31.260904 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:31.271484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-e2772a91-decf-45da-a070-e52c4b700c01 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 18:33:31.271484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:31.271484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:31.271484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:31.271484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:31.271484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:31.271484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:31.271484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:31.271484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:31.271484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:31.271484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:31.271484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:31.271484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:31.271484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:31.271484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:31.271484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:31.272488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:31.273489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:31.273489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:31.273489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:31.273489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:31.273489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:31.273489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:31.273489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:31.273489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:31.273489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 18:33:31.273489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:31.273489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 342/679] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:33:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:31.273489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2772a91-decf-45da-a070-e52c4b700c01 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:31.293383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781dedf-2871-4ddd-8e98-7a2e9b2335ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:31.294038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781dedf-2871-4ddd-8e98-7a2e9b2335ee None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:31.294326 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781dedf-2871-4ddd-8e98-7a2e9b2335ee None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:31.294621 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781dedf-2871-4ddd-8e98-7a2e9b2335ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:31.295433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781dedf-2871-4ddd-8e98-7a2e9b2335ee None admin] RBAC: Adding query filter params (role.id=62fd6b166d1847b19e812160b459d5db, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=4e59193e90e240f6b9876d0455eea355) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:31.295786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781dedf-2871-4ddd-8e98-7a2e9b2335ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:31.297246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781dedf-2871-4ddd-8e98-7a2e9b2335ee None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:31.303451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 338/680] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:33:31 2022] GET /identity/v3/role_assignments?user.id=4e59193e90e240f6b9876d0455eea355&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=62fd6b166d1847b19e812160b459d5db => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:31.305437 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad980a-9268-45f4-aa99-20677492e0ed None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:31.305791 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad980a-9268-45f4-aa99-20677492e0ed None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:31.306131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad980a-9268-45f4-aa99-20677492e0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:31.335354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-85ad980a-9268-45f4-aa99-20677492e0ed None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:31.336706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-85ad980a-9268-45f4-aa99-20677492e0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:31.415472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2772a91-decf-45da-a070-e52c4b700c01 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:31.422413 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 339/681] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:31.423576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad980a-9268-45f4-aa99-20677492e0ed None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:31.453846 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d8d0c-21d1-4e6f-bb07-28ddeab6db22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:31.454563 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d8d0c-21d1-4e6f-bb07-28ddeab6db22 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:31.454917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d8d0c-21d1-4e6f-bb07-28ddeab6db22 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:31.455267 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d8d0c-21d1-4e6f-bb07-28ddeab6db22 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:31.456113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d8d0c-21d1-4e6f-bb07-28ddeab6db22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:31.456497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d8d0c-21d1-4e6f-bb07-28ddeab6db22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:31.458082 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d8d0c-21d1-4e6f-bb07-28ddeab6db22 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:31.472385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 343/682] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:31.473392 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d8d0c-21d1-4e6f-bb07-28ddeab6db22 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:31.477950 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:31.556404 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad980a-9268-45f4-aa99-20677492e0ed None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:31.558880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:31.601257 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d8d0c-21d1-4e6f-bb07-28ddeab6db22 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:31.607347 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857e43d-8001-4467-ae24-a63d81e9b234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:31.608370 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e43d-8001-4467-ae24-a63d81e9b234 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:31.608805 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e43d-8001-4467-ae24-a63d81e9b234 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:31.609243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857e43d-8001-4467-ae24-a63d81e9b234 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:31.611009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857e43d-8001-4467-ae24-a63d81e9b234 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:31.611479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857e43d-8001-4467-ae24-a63d81e9b234 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:31.613096 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857e43d-8001-4467-ae24-a63d81e9b234 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:31.636946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 340/683] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Jun 27 18:33:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:31.637955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358f9c1-9631-4291-90e1-90d62e135220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:31.638356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857e43d-8001-4467-ae24-a63d81e9b234 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:31.638816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358f9c1-9631-4291-90e1-90d62e135220 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:31.639095 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358f9c1-9631-4291-90e1-90d62e135220 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:31.639368 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358f9c1-9631-4291-90e1-90d62e135220 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:31.653904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5358f9c1-9631-4291-90e1-90d62e135220 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:31.662475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-5358f9c1-9631-4291-90e1-90d62e135220 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:33:31.662475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:31.662475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:31.662475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:31.662475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:31.662475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:31.662475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:31.662475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:31.662475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:31.662475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:31.662475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:31.662475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:31.662475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:31.662475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:31.662475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:31.662475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:31.664031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:31.664031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:31.664031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:31.664031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:31.664031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:31.664031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:31.664031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:31.664031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:31.664031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:31.664031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:31.664031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:31.664031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:31.664031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:31.664031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:31.664031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:31.664031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:31.664906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:31.664906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:31.664906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:31.664906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:31.664906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:31.664906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:31.664906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:31.664906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:31.664906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:31.664906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:31.664906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:33:31.664906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:31.664906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 344/684] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:33:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:31.665620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358f9c1-9631-4291-90e1-90d62e135220 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:31.749390 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857e43d-8001-4467-ae24-a63d81e9b234 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:31.755876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:31.789053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f5727-a7b3-4862-bf28-cad0e4d74289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:31.789852 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f5727-a7b3-4862-bf28-cad0e4d74289 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:31.790131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f5727-a7b3-4862-bf28-cad0e4d74289 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:31.790404 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f5727-a7b3-4862-bf28-cad0e4d74289 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:31.797459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f5727-a7b3-4862-bf28-cad0e4d74289 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:31.798903 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f5727-a7b3-4862-bf28-cad0e4d74289 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:31.802241 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358f9c1-9631-4291-90e1-90d62e135220 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:31.814716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-880f5727-a7b3-4862-bf28-cad0e4d74289 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:31.814716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:31.814716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:31.814716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:31.814716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:31.814716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:31.814716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:31.814716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:31.814716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:31.814716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:31.814716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:31.814716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:31.814716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:31.814716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:31.814716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:31.815724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:31.815724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:31.815724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:31.815724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:31.815724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:31.815724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:31.815724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:31.815724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:31.815724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:31.815724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:31.815724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:31.815724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:31.815724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:31.815724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:31.815724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:31.815724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:31.815724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:31.816642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:31.816642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:31.816642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:31.816642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:31.816642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:31.816642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:31.816642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:31.816642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:31.816642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 341/685] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:31.817268 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f5727-a7b3-4862-bf28-cad0e4d74289 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:31.845520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:31.849298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fe4a8-e550-4bc1-98b6-ad37a4513722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:31.855565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fe4a8-e550-4bc1-98b6-ad37a4513722 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:31.860240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fe4a8-e550-4bc1-98b6-ad37a4513722 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:31.860240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fe4a8-e550-4bc1-98b6-ad37a4513722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:31.927300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f5727-a7b3-4862-bf28-cad0e4d74289 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:31.932423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59fe4a8-e550-4bc1-98b6-ad37a4513722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:31.934117 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59fe4a8-e550-4bc1-98b6-ad37a4513722 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:31.962265 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1284913-a08a-4d41-bb7c-376d0b85eea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:31.962931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1284913-a08a-4d41-bb7c-376d0b85eea7 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:31.963217 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1284913-a08a-4d41-bb7c-376d0b85eea7 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:31.963492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1284913-a08a-4d41-bb7c-376d0b85eea7 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:31.964286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1284913-a08a-4d41-bb7c-376d0b85eea7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:31.964588 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1284913-a08a-4d41-bb7c-376d0b85eea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:31.965963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1284913-a08a-4d41-bb7c-376d0b85eea7 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:31.975167 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 342/686] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:33:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:31.976761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1284913-a08a-4d41-bb7c-376d0b85eea7 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:32.004367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:32.051906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 345/687] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:33:32.053107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fe4a8-e550-4bc1-98b6-ad37a4513722 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:32.068744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:32.087122 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1284913-a08a-4d41-bb7c-376d0b85eea7 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:32.125978 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83db5b-4bd9-44a1-b2d6-7342659b2614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:32.126983 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83db5b-4bd9-44a1-b2d6-7342659b2614 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:32.127507 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83db5b-4bd9-44a1-b2d6-7342659b2614 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:32.128023 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83db5b-4bd9-44a1-b2d6-7342659b2614 None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:32.129005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83db5b-4bd9-44a1-b2d6-7342659b2614 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:32.129515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83db5b-4bd9-44a1-b2d6-7342659b2614 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:32.131318 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83db5b-4bd9-44a1-b2d6-7342659b2614 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:32.145516 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 343/688] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:32.146923 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83db5b-4bd9-44a1-b2d6-7342659b2614 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:32.162498 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fe4a8-e550-4bc1-98b6-ad37a4513722 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:32.199103 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e22eee-0b92-440b-b4de-85f6d7ff8e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:32.199937 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e22eee-0b92-440b-b4de-85f6d7ff8e3b None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:32.200214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e22eee-0b92-440b-b4de-85f6d7ff8e3b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:32.200489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e22eee-0b92-440b-b4de-85f6d7ff8e3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:32.210880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e22eee-0b92-440b-b4de-85f6d7ff8e3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:32.212373 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e22eee-0b92-440b-b4de-85f6d7ff8e3b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:32.230761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-10e22eee-0b92-440b-b4de-85f6d7ff8e3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:32.230761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:32.230761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:32.230761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:32.230761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:32.230761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:32.230761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:32.230761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:32.230761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:32.230761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:32.230761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:32.230761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:32.230761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:32.230761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:32.230761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:32.231980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:32.231980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:32.231980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:32.231980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:32.231980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:32.231980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:32.231980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:32.231980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:32.231980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:32.231980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:32.231980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:32.231980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:32.231980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:32.231980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:32.231980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:32.231980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:32.231980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:32.232895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:32.232895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:32.232895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:32.232895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:32.232895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 346/689] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:32.234047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e22eee-0b92-440b-b4de-85f6d7ff8e3b None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:32.251882 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:32.264077 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83db5b-4bd9-44a1-b2d6-7342659b2614 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:32.300030 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461e2308-47dc-4293-9ac8-cff6086ef07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:32.300875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e2308-47dc-4293-9ac8-cff6086ef07a None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:32.301167 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e2308-47dc-4293-9ac8-cff6086ef07a None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:32.301473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e2308-47dc-4293-9ac8-cff6086ef07a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:32.313807 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e2308-47dc-4293-9ac8-cff6086ef07a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:32.315672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461e2308-47dc-4293-9ac8-cff6086ef07a None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:32.318842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:32.334892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-461e2308-47dc-4293-9ac8-cff6086ef07a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:32.334892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:32.334892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:32.334892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:32.334892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:32.334892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:32.334892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:32.334892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:32.334892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:32.334892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:32.334892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:32.334892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:32.334892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:32.334892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:32.334892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:32.336121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:32.336121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:32.336121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:32.336121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:32.336121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:32.336121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:32.336121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:32.336121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:32.336121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:32.336121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:32.336121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:32.336121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:32.336121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:32.336121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:32.336121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:32.336121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:32.336121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:32.337033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:32.337033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:32.337033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:32.337033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:32.337618 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e22eee-0b92-440b-b4de-85f6d7ff8e3b None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:32.340646 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 344/690] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:32.346251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c74579-67e0-4dd2-99da-5761ff1a463f None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:32.346251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c74579-67e0-4dd2-99da-5761ff1a463f None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:32.346251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c74579-67e0-4dd2-99da-5761ff1a463f None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:32.346251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 345/691] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:32.346251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c74579-67e0-4dd2-99da-5761ff1a463f None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:32.377407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e224c29-892f-4f40-8479-bcb17ded1474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:32.378347 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e224c29-892f-4f40-8479-bcb17ded1474 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:32.378817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e224c29-892f-4f40-8479-bcb17ded1474 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:32.379263 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e224c29-892f-4f40-8479-bcb17ded1474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:32.380281 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e224c29-892f-4f40-8479-bcb17ded1474 None admin] RBAC: Adding query filter params (role.id=62fd6b166d1847b19e812160b459d5db, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=1e684ee875464138abc4e89060902100) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:32.380755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e224c29-892f-4f40-8479-bcb17ded1474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:32.382704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e224c29-892f-4f40-8479-bcb17ded1474 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:32.399904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 347/692] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:33:32 2022] GET /identity/v3/role_assignments?user.id=1e684ee875464138abc4e89060902100&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=62fd6b166d1847b19e812160b459d5db => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:32.400732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e224c29-892f-4f40-8479-bcb17ded1474 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:32.463722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c74579-67e0-4dd2-99da-5761ff1a463f None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:32.507893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c9716-34d3-4b35-97b2-80f44721c131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:32.508584 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c9716-34d3-4b35-97b2-80f44721c131 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:32.508877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c9716-34d3-4b35-97b2-80f44721c131 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:32.509158 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c9716-34d3-4b35-97b2-80f44721c131 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:32.509912 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c9716-34d3-4b35-97b2-80f44721c131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:32.510296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c9716-34d3-4b35-97b2-80f44721c131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:32.511686 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c9716-34d3-4b35-97b2-80f44721c131 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:32.525557 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:32.529755 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 346/693] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:32.531481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbf31b-927d-46f0-8c49-12682a77e3ee None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:32.531800 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbf31b-927d-46f0-8c49-12682a77e3ee None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:32.532084 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbf31b-927d-46f0-8c49-12682a77e3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:32.550325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e224c29-892f-4f40-8479-bcb17ded1474 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:32.553271 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-0dbbf31b-927d-46f0-8c49-12682a77e3ee None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:32.554536 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-0dbbf31b-927d-46f0-8c49-12682a77e3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:32.594947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691afb6-cd44-4296-bb98-9fa47f9559b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:32.595656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691afb6-cd44-4296-bb98-9fa47f9559b5 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:32.595939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691afb6-cd44-4296-bb98-9fa47f9559b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:32.596215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9691afb6-cd44-4296-bb98-9fa47f9559b5 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:32.596941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691afb6-cd44-4296-bb98-9fa47f9559b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:32.597249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691afb6-cd44-4296-bb98-9fa47f9559b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:32.598609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9691afb6-cd44-4296-bb98-9fa47f9559b5 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:32.613017 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 348/694] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:32.613645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691afb6-cd44-4296-bb98-9fa47f9559b5 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:32.616667 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:32.635321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 347/695] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:32.636817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbf31b-927d-46f0-8c49-12682a77e3ee None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:32.722997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9691afb6-cd44-4296-bb98-9fa47f9559b5 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:32.754346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbf31b-927d-46f0-8c49-12682a77e3ee None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:32.758398 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b61b98-3dfd-4f20-b91e-135d8fddfaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:32.759318 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b61b98-3dfd-4f20-b91e-135d8fddfaef None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:32.759702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b61b98-3dfd-4f20-b91e-135d8fddfaef None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:32.760069 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b61b98-3dfd-4f20-b91e-135d8fddfaef None admin] PATH_INFO: `/v3/users/nova` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:32.768059 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b61b98-3dfd-4f20-b91e-135d8fddfaef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:32.769598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b61b98-3dfd-4f20-b91e-135d8fddfaef None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:32.772379 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:32.786731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-27b61b98-3dfd-4f20-b91e-135d8fddfaef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:33:32.786731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:32.786731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:32.786731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:32.786731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:32.786731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:32.786731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:32.786731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:32.786731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:32.786731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:32.786731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:32.786731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:32.786731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:32.786731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:32.786731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:32.786731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:32.788029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:32.789711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:32.789711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:32.789711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:32.789711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:32.789711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:32.789711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:32.789711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:32.789711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:32.789711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:33:32.789711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:32.791905 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 349/696] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jun 27 18:33:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:32.792604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b61b98-3dfd-4f20-b91e-135d8fddfaef None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:32.794824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eae5ee-40a7-4985-a8e1-1c03e2270400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:32.795944 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eae5ee-40a7-4985-a8e1-1c03e2270400 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:32.797051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eae5ee-40a7-4985-a8e1-1c03e2270400 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:32.797364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eae5ee-40a7-4985-a8e1-1c03e2270400 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:32.806281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eae5ee-40a7-4985-a8e1-1c03e2270400 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:32.808366 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eae5ee-40a7-4985-a8e1-1c03e2270400 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:32.826948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-44eae5ee-40a7-4985-a8e1-1c03e2270400 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:32.826948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:32.826948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:32.826948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:32.826948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:32.826948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:32.826948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:32.826948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:32.826948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:32.826948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:32.826948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:32.826948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:32.826948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:32.826948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:32.826948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:32.828092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:32.828092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:32.828092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:32.828092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:32.828092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:32.828092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:32.828092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:32.828092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:32.828092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:32.828092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:32.828092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:32.828092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:32.828092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:32.828092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:32.828092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:32.828092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:32.828092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:32.829348 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:32.829348 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:32.829348 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:32.829348 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:32.829348 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:32.829348 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:32.829348 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:32.829348 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:32.829348 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 348/697] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:32.830204 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eae5ee-40a7-4985-a8e1-1c03e2270400 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:32.887597 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:32.920103 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b61b98-3dfd-4f20-b91e-135d8fddfaef None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:32.961851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eae5ee-40a7-4985-a8e1-1c03e2270400 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:32.968655 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e918c1-e255-4a3e-9367-10ca80c0a790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:32.969475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e918c1-e255-4a3e-9367-10ca80c0a790 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:32.969758 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e918c1-e255-4a3e-9367-10ca80c0a790 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:32.970033 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e918c1-e255-4a3e-9367-10ca80c0a790 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:32.970694 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e918c1-e255-4a3e-9367-10ca80c0a790 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:32.972134 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e918c1-e255-4a3e-9367-10ca80c0a790 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:32.988078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-86e918c1-e255-4a3e-9367-10ca80c0a790 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 18:33:32.988078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:32.988078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:33:32.988078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:33:32.988078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:33:32.988078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:33:32.988078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:33:32.988078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:32.988078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 18:33:32.988078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:32.988078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:33:32.988078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:32.988078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:32.988078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:32.988078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:32.988078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:32.989097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:32.989097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:32.989097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:32.989097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:32.989097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:32.989097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:32.989097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:32.989097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:33:32.989097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:33:32.989097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:33:32.989097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:33:32.989097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:32.989097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:32.989097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:32.989097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:32.989097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:32.989958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:32.989958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:32.989958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:32.989958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:32.989958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:32.989958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:32.989958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:32.989958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:32.989958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:32.989958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:32.989958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:32.989958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:33:32.989958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:32.989958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 18:33:32.989958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:32.989958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 350/698] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Jun 27 18:33:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:32.990820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e918c1-e255-4a3e-9367-10ca80c0a790 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:33.005726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113630a-d96f-45e4-af42-e8e71e5d3b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:33.007043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113630a-d96f-45e4-af42-e8e71e5d3b40 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:33.007480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113630a-d96f-45e4-af42-e8e71e5d3b40 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:33.007995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113630a-d96f-45e4-af42-e8e71e5d3b40 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:33.009018 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113630a-d96f-45e4-af42-e8e71e5d3b40 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:33.009512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113630a-d96f-45e4-af42-e8e71e5d3b40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:33.011143 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113630a-d96f-45e4-af42-e8e71e5d3b40 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:33.029687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 349/699] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jun 27 18:33:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:33.030849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113630a-d96f-45e4-af42-e8e71e5d3b40 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:33.070324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:33.109680 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e918c1-e255-4a3e-9367-10ca80c0a790 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:33.151579 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec2203-df0d-4797-8b52-7e18f0d81196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:33.152514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec2203-df0d-4797-8b52-7e18f0d81196 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:33.152806 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec2203-df0d-4797-8b52-7e18f0d81196 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:33.153084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec2203-df0d-4797-8b52-7e18f0d81196 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:33.153885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec2203-df0d-4797-8b52-7e18f0d81196 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:33.154199 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec2203-df0d-4797-8b52-7e18f0d81196 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:33.156608 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec2203-df0d-4797-8b52-7e18f0d81196 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:33.158535 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113630a-d96f-45e4-af42-e8e71e5d3b40 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:33.162007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:33.178503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 351/700] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:33.178503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec2203-df0d-4797-8b52-7e18f0d81196 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:33.202201 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05059953-08cf-4597-8277-2bb6253dc05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:33.203279 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05059953-08cf-4597-8277-2bb6253dc05b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:33.203847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05059953-08cf-4597-8277-2bb6253dc05b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:33.204330 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05059953-08cf-4597-8277-2bb6253dc05b None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:33.205297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05059953-08cf-4597-8277-2bb6253dc05b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:33.205810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05059953-08cf-4597-8277-2bb6253dc05b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:33.207503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05059953-08cf-4597-8277-2bb6253dc05b None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:33.213095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 350/701] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Jun 27 18:33:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:33.214344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05059953-08cf-4597-8277-2bb6253dc05b None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:33.297294 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec2203-df0d-4797-8b52-7e18f0d81196 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:33.327357 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:33.329089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05059953-08cf-4597-8277-2bb6253dc05b None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:33.340900 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd632c-1243-43f8-bb63-080e0b9e506e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:33.341995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd632c-1243-43f8-bb63-080e0b9e506e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:33.342293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd632c-1243-43f8-bb63-080e0b9e506e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:33.342574 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcd632c-1243-43f8-bb63-080e0b9e506e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:33.369491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cec19-fb34-495d-bfaf-4c08d82db8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:33.370543 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cec19-fb34-495d-bfaf-4c08d82db8d0 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:33.371040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cec19-fb34-495d-bfaf-4c08d82db8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:33.371520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cec19-fb34-495d-bfaf-4c08d82db8d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:33.372706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cec19-fb34-495d-bfaf-4c08d82db8d0 None admin] RBAC: Adding query filter params (role.id=62fd6b166d1847b19e812160b459d5db, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=94555ff897d94c90968c470d82ff9e2a) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:33.373331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cec19-fb34-495d-bfaf-4c08d82db8d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:33.375073 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cec19-fb34-495d-bfaf-4c08d82db8d0 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:33.387858 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 351/702] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:33:33 2022] GET /identity/v3/role_assignments?user.id=94555ff897d94c90968c470d82ff9e2a&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=62fd6b166d1847b19e812160b459d5db => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:33.389120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cec19-fb34-495d-bfaf-4c08d82db8d0 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:33.421587 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd632c-1243-43f8-bb63-080e0b9e506e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:33.423196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcd632c-1243-43f8-bb63-080e0b9e506e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:33.452147 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:33.545774 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 352/703] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:33:33.550766 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd632c-1243-43f8-bb63-080e0b9e506e None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:33.596005 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:33.637082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cec19-fb34-495d-bfaf-4c08d82db8d0 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:33.670314 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcd632c-1243-43f8-bb63-080e0b9e506e None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:33.677857 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443353ab-5f49-45e6-ba9a-eb60d6188d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:33.678626 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443353ab-5f49-45e6-ba9a-eb60d6188d95 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:33.679463 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443353ab-5f49-45e6-ba9a-eb60d6188d95 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:33.680105 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443353ab-5f49-45e6-ba9a-eb60d6188d95 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:33.680473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443353ab-5f49-45e6-ba9a-eb60d6188d95 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:33.680783 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443353ab-5f49-45e6-ba9a-eb60d6188d95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:33.682172 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443353ab-5f49-45e6-ba9a-eb60d6188d95 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:33.688582 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 352/704] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Jun 27 18:33:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:33.689857 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c185e-ed97-4a68-b712-1201eedae108 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:33.690148 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c185e-ed97-4a68-b712-1201eedae108 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:33.690428 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c185e-ed97-4a68-b712-1201eedae108 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:33.692116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 353/705] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:33.697707 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6096c7-adf8-4254-bf69-dc3d2eb547a7 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:33.698007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6096c7-adf8-4254-bf69-dc3d2eb547a7 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:33.698276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6096c7-adf8-4254-bf69-dc3d2eb547a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:33.712340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae69ba-7660-49c8-8dac-bd6f7de41723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:33.713168 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae69ba-7660-49c8-8dac-bd6f7de41723 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:33.713456 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae69ba-7660-49c8-8dac-bd6f7de41723 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:33.713787 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ae69ba-7660-49c8-8dac-bd6f7de41723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:33.717977 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-7f6096c7-adf8-4254-bf69-dc3d2eb547a7 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:33.719220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-7f6096c7-adf8-4254-bf69-dc3d2eb547a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:33.730478 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae69ba-7660-49c8-8dac-bd6f7de41723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:33.733389 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ae69ba-7660-49c8-8dac-bd6f7de41723 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:33.760596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-67ae69ba-7660-49c8-8dac-bd6f7de41723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:33.760596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:33.760596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:33.760596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:33.760596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:33.760596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:33.760596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:33.760596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:33.760596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:33.760596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:33.760596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:33.760596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:33.760596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:33.760596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:33.760596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:33.761644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:33.761644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:33.761644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:33.761644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:33.761644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:33.761644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:33.761644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:33.761644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:33.761644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:33.761644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:33.761644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:33.761644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:33.761644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:33.761644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:33.761644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:33.761644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:33.761644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:33.762587 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:33.762587 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:33.762587 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:33.762587 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:33.765060 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 353/706] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:33.771567 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae69ba-7660-49c8-8dac-bd6f7de41723 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:33.812141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 354/707] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:33:33.847103 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6096c7-adf8-4254-bf69-dc3d2eb547a7 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:33.868286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:33.884001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:33.892769 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ae69ba-7660-49c8-8dac-bd6f7de41723 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:33.931435 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25bd44-19a1-4feb-a6a3-474303e97950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:33.932511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25bd44-19a1-4feb-a6a3-474303e97950 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:33.933014 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25bd44-19a1-4feb-a6a3-474303e97950 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:33.933522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e25bd44-19a1-4feb-a6a3-474303e97950 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:33.934528 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25bd44-19a1-4feb-a6a3-474303e97950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:33.934996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25bd44-19a1-4feb-a6a3-474303e97950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:33.936718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e25bd44-19a1-4feb-a6a3-474303e97950 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:33.949584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 354/708] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:33.956328 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25bd44-19a1-4feb-a6a3-474303e97950 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:33.963205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6096c7-adf8-4254-bf69-dc3d2eb547a7 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:34.010910 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a0ba3-d7a7-4c93-bb56-bec160eca93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:34.011743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a0ba3-d7a7-4c93-bb56-bec160eca93e None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:34.012033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a0ba3-d7a7-4c93-bb56-bec160eca93e None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:34.012312 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a0ba3-d7a7-4c93-bb56-bec160eca93e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:34.026625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a0ba3-d7a7-4c93-bb56-bec160eca93e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:34.028430 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a0ba3-d7a7-4c93-bb56-bec160eca93e None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:34.053369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-f70a0ba3-d7a7-4c93-bb56-bec160eca93e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:34.053369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:34.053369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:34.053369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:34.053369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:34.053369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:34.053369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:34.053369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:34.053369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:34.053369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:34.053369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:34.053369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:34.053369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:34.053369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:34.053369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:34.054426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:34.054426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:34.054426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:34.054426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:34.054426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:34.054426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:34.054426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:34.054426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:34.054426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:34.054426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:34.054426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:34.054426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:34.054426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:34.054426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:34.054426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:34.054426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:34.054426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:34.055395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:34.055395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:34.055395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:34.055395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:34.055395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 355/709] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:34.067713 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a0ba3-d7a7-4c93-bb56-bec160eca93e None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:34.126430 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e25bd44-19a1-4feb-a6a3-474303e97950 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:34.196896 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265e3ff-d07b-47c6-bdac-c576f49e80de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:34.197759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265e3ff-d07b-47c6-bdac-c576f49e80de None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:34.198058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265e3ff-d07b-47c6-bdac-c576f49e80de None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:34.198342 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265e3ff-d07b-47c6-bdac-c576f49e80de None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:34.207434 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:34.212666 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265e3ff-d07b-47c6-bdac-c576f49e80de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:34.214123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265e3ff-d07b-47c6-bdac-c576f49e80de None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:34.218933 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:34.233180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-d265e3ff-d07b-47c6-bdac-c576f49e80de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:34.233180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:34.233180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:34.233180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:34.233180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:34.233180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:34.233180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:34.233180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:34.233180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:34.233180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:34.233180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:34.233180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:34.233180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:34.233180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:34.233180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:34.234128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:34.234128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:34.234128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:34.234128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:34.234128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:34.234128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:34.234128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:34.234128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:34.234128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:34.234128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:34.234128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:34.234128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:34.234128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:34.234128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:34.234128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:34.234128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:34.234128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:34.235019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:34.235019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:34.235019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:34.235019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:34.235019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:34.235019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:34.235019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:34.235019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:34.238178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 355/710] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:34.243834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265e3ff-d07b-47c6-bdac-c576f49e80de None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:34.251574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a0ba3-d7a7-4c93-bb56-bec160eca93e None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:34.309815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3638bf-89a3-4cb5-873d-f1dd86fa5913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:34.310647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3638bf-89a3-4cb5-873d-f1dd86fa5913 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:34.310939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3638bf-89a3-4cb5-873d-f1dd86fa5913 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:34.311219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3638bf-89a3-4cb5-873d-f1dd86fa5913 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:34.311976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3638bf-89a3-4cb5-873d-f1dd86fa5913 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:34.312287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3638bf-89a3-4cb5-873d-f1dd86fa5913 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:34.313689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3638bf-89a3-4cb5-873d-f1dd86fa5913 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:34.336398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 356/711] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:34.341375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3638bf-89a3-4cb5-873d-f1dd86fa5913 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:34.433798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265e3ff-d07b-47c6-bdac-c576f49e80de None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:34.499399 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3638bf-89a3-4cb5-873d-f1dd86fa5913 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:34.519120 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb68836-3cb6-4847-8a2a-7f21b76183a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:34.520169 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb68836-3cb6-4847-8a2a-7f21b76183a0 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:34.520829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb68836-3cb6-4847-8a2a-7f21b76183a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:34.523287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb68836-3cb6-4847-8a2a-7f21b76183a0 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:34.524336 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb68836-3cb6-4847-8a2a-7f21b76183a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:34.525694 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb68836-3cb6-4847-8a2a-7f21b76183a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:34.530371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb68836-3cb6-4847-8a2a-7f21b76183a0 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:34.552730 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 356/712] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:34.560687 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb68836-3cb6-4847-8a2a-7f21b76183a0 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:34.586136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e491a3c-c644-4d4a-8031-c55e7ff725cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:34.586997 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e491a3c-c644-4d4a-8031-c55e7ff725cd None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:34.587276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e491a3c-c644-4d4a-8031-c55e7ff725cd None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:34.587577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e491a3c-c644-4d4a-8031-c55e7ff725cd None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:34.588311 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e491a3c-c644-4d4a-8031-c55e7ff725cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:34.589824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e491a3c-c644-4d4a-8031-c55e7ff725cd None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:34.599039 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:34.647343 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:34.678947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 357/713] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:33:34 2022] POST /identity/v3/users => generated 254 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:33:34.680628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47141a-59d8-448b-bfcc-32632a7ba4bb None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:34.681022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47141a-59d8-448b-bfcc-32632a7ba4bb None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:34.681418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47141a-59d8-448b-bfcc-32632a7ba4bb None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:34.689168 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 358/714] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:34.689863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb68836-3cb6-4847-8a2a-7f21b76183a0 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:34.706287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10db85e-dfdd-4e39-bbcc-f6aafcb4185e None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:34.707178 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10db85e-dfdd-4e39-bbcc-f6aafcb4185e None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:34.707574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10db85e-dfdd-4e39-bbcc-f6aafcb4185e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:34.737606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b922482-6fb8-4343-b666-414fb717d445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:34.738283 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b922482-6fb8-4343-b666-414fb717d445 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:34.738572 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b922482-6fb8-4343-b666-414fb717d445 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:34.738852 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b922482-6fb8-4343-b666-414fb717d445 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:34.739730 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b922482-6fb8-4343-b666-414fb717d445 None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=da1746d29f9e4e8b8626ad4b11931cbd) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:34.740106 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b922482-6fb8-4343-b666-414fb717d445 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:34.742495 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b922482-6fb8-4343-b666-414fb717d445 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:34.748593 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-a10db85e-dfdd-4e39-bbcc-f6aafcb4185e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:34.749229 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 357/715] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:33:34 2022] GET /identity/v3/role_assignments?user.id=da1746d29f9e4e8b8626ad4b11931cbd&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=b156409c977248e1b23c26e589b1e04f => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:34.749959 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a10db85e-dfdd-4e39-bbcc-f6aafcb4185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:34.882395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 359/716] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:34.906885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b922482-6fb8-4343-b666-414fb717d445 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:35.023085 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b922482-6fb8-4343-b666-414fb717d445 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:35.044359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:35.060210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e717dc-4623-4ed1-8ada-a9dfd098115a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:35.061015 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e717dc-4623-4ed1-8ada-a9dfd098115a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:35.061296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e717dc-4623-4ed1-8ada-a9dfd098115a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:35.061576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e717dc-4623-4ed1-8ada-a9dfd098115a None admin] PATH_INFO: `/v3/services/network` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:35.062240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e717dc-4623-4ed1-8ada-a9dfd098115a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:35.063639 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e717dc-4623-4ed1-8ada-a9dfd098115a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:35.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-26e717dc-4623-4ed1-8ada-a9dfd098115a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 18:33:35.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:35.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:33:35.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:33:35.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:33:35.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:33:35.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:33:35.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:35.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 18:33:35.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:35.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:33:35.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:35.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:35.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:35.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:35.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:35.075598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:35.076629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:35.076629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:35.076629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:35.076629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:35.076629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:35.076629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:35.076629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:33:35.076629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:33:35.076629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:33:35.076629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:33:35.076629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:35.076629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:35.076629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:35.076629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:35.076629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:35.076629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:35.077885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:35.077885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:35.077885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:35.077885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:35.077885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:35.077885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:35.077885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:35.077885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:35.077885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:35.077885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:35.077885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:33:35.077885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:35.077885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 18:33:35.077885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:35.077885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 358/717] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:34 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:35.083032 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10db85e-dfdd-4e39-bbcc-f6aafcb4185e None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:35.201293 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10db85e-dfdd-4e39-bbcc-f6aafcb4185e None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:35.226175 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:35.242874 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b03115-085e-45ff-a6ab-5bde9dba6412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:35.243555 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b03115-085e-45ff-a6ab-5bde9dba6412 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:35.243844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b03115-085e-45ff-a6ab-5bde9dba6412 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:35.244120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b03115-085e-45ff-a6ab-5bde9dba6412 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:35.244877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b03115-085e-45ff-a6ab-5bde9dba6412 None admin] RBAC: Adding query filter params (name=network) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:35.245184 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b03115-085e-45ff-a6ab-5bde9dba6412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:35.246557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b03115-085e-45ff-a6ab-5bde9dba6412 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:35.251318 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 360/718] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jun 27 18:33:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:35.256660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e717dc-4623-4ed1-8ada-a9dfd098115a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:35.407769 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e717dc-4623-4ed1-8ada-a9dfd098115a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:35.460431 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f85812-9f76-4534-99cf-f92dd3cc3a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:35.461101 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f85812-9f76-4534-99cf-f92dd3cc3a24 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:35.461390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f85812-9f76-4534-99cf-f92dd3cc3a24 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:35.461671 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f85812-9f76-4534-99cf-f92dd3cc3a24 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:35.462384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f85812-9f76-4534-99cf-f92dd3cc3a24 None admin] RBAC: Adding query filter params (type=network) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:35.462695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f85812-9f76-4534-99cf-f92dd3cc3a24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:35.464217 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f85812-9f76-4534-99cf-f92dd3cc3a24 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:35.477286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 359/719] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jun 27 18:33:35 2022] GET /identity/v3/services?type=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:36.124497 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8a21c-2ca9-4032-b8e7-d3b4bdfb6dbe None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:36.125057 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8a21c-2ca9-4032-b8e7-d3b4bdfb6dbe None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:36.125057 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8a21c-2ca9-4032-b8e7-d3b4bdfb6dbe None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:36.126695 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 361/720] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:36.137391 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77383c-e142-490a-8ef7-885324e1c746 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:36.137825 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77383c-e142-490a-8ef7-885324e1c746 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:36.138045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77383c-e142-490a-8ef7-885324e1c746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:36.164541 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-cd77383c-e142-490a-8ef7-885324e1c746 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:36.165746 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-cd77383c-e142-490a-8ef7-885324e1c746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:36.216655 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:36.242710 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 360/721] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:36.278705 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8a21c-2ca9-4032-b8e7-d3b4bdfb6dbe None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:36.333321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32914dd-83a0-431a-b881-503501396c92 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:36.333616 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32914dd-83a0-431a-b881-503501396c92 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:36.333901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32914dd-83a0-431a-b881-503501396c92 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:36.335299 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 361/722] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:33:36.341611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9006ef3-4e2d-41af-8eab-615e14b3340e None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:36.341899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9006ef3-4e2d-41af-8eab-615e14b3340e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:36.342178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9006ef3-4e2d-41af-8eab-615e14b3340e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:36.376636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-f9006ef3-4e2d-41af-8eab-615e14b3340e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:36.377760 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-f9006ef3-4e2d-41af-8eab-615e14b3340e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:36.413655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8a21c-2ca9-4032-b8e7-d3b4bdfb6dbe None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:36.453070 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabafdc-2999-467a-98d7-196dc087a939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:36.453979 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabafdc-2999-467a-98d7-196dc087a939 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:36.454264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabafdc-2999-467a-98d7-196dc087a939 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:36.454540 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aabafdc-2999-467a-98d7-196dc087a939 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:36.465620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aabafdc-2999-467a-98d7-196dc087a939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:36.473488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-6aabafdc-2999-467a-98d7-196dc087a939 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:33:36.473488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:36.473488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:36.473488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:36.473488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:36.473488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:36.473488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:36.473488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:36.473488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:36.473488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:36.473488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:36.473488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:36.473488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:36.473488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:36.473488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:36.473488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:36.474473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:36.474473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:36.474473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:36.474473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:36.474473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:36.474473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:36.474473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:36.474473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:36.474473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:36.474473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:36.474473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:36.474473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:36.474473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:36.474473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:36.474473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:36.474473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:36.475356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:36.475356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:36.475356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:36.475356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:36.475356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:36.475356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:36.475356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:36.475356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:36.475356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:36.475356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:36.475356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:33:36.475356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:36.475356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 362/723] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:33:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:36.488927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabafdc-2999-467a-98d7-196dc087a939 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:36.503182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 362/724] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:33:36.577525 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:36.579463 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9006ef3-4e2d-41af-8eab-615e14b3340e None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:36.643452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aabafdc-2999-467a-98d7-196dc087a939 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:36.705766 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9006ef3-4e2d-41af-8eab-615e14b3340e None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:36.705993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3711091-c061-4d53-9496-a839ff7f828c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:36.706442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3711091-c061-4d53-9496-a839ff7f828c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:36.706722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3711091-c061-4d53-9496-a839ff7f828c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:36.706998 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3711091-c061-4d53-9496-a839ff7f828c None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:36.707765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3711091-c061-4d53-9496-a839ff7f828c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:36.708075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3711091-c061-4d53-9496-a839ff7f828c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:36.709445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3711091-c061-4d53-9496-a839ff7f828c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:36.720839 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:36.727256 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 363/725] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:33:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:36.733605 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3711091-c061-4d53-9496-a839ff7f828c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:36.761803 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cca37a-5b15-44e9-8e8a-bbefb1890cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:36.762472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cca37a-5b15-44e9-8e8a-bbefb1890cc1 None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:36.762762 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cca37a-5b15-44e9-8e8a-bbefb1890cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:36.763048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cca37a-5b15-44e9-8e8a-bbefb1890cc1 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:36.763798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cca37a-5b15-44e9-8e8a-bbefb1890cc1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:36.765177 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cca37a-5b15-44e9-8e8a-bbefb1890cc1 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:36.858450 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3711091-c061-4d53-9496-a839ff7f828c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:36.875322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 363/726] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jun 27 18:33:36 2022] POST /identity/v3/services => generated 251 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:33:36.883926 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:36.917568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f1637-7676-4e3b-8680-32b4ab59107a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:36.918419 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f1637-7676-4e3b-8680-32b4ab59107a None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:36.918701 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f1637-7676-4e3b-8680-32b4ab59107a None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:36.918980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f1637-7676-4e3b-8680-32b4ab59107a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:36.933714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f1637-7676-4e3b-8680-32b4ab59107a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:36.941301 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f1637-7676-4e3b-8680-32b4ab59107a None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:36.966724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-107f1637-7676-4e3b-8680-32b4ab59107a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:36.966724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:36.966724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:36.966724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:36.966724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:36.966724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:36.966724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:36.966724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:36.966724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:36.966724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:36.966724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:36.966724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:36.966724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:36.966724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:36.966724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:36.967729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:36.967729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:36.967729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:36.967729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:36.967729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:36.967729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:36.967729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:36.967729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:36.967729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:36.967729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:36.967729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:36.967729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:36.967729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:36.967729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:36.967729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:36.967729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:36.967729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:36.968641 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:36.968641 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:36.968641 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:36.968641 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:36.968641 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 364/727] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:36.975133 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cca37a-5b15-44e9-8e8a-bbefb1890cc1 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:37.052257 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e640ed4-236f-4195-9c18-f688bf160489 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:37.052612 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e640ed4-236f-4195-9c18-f688bf160489 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:37.052824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e640ed4-236f-4195-9c18-f688bf160489 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:37.054596 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 365/728] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:37.059868 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca881f29-2727-49a9-826c-4ec45cc0a782 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:37.060160 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca881f29-2727-49a9-826c-4ec45cc0a782 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:37.060445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca881f29-2727-49a9-826c-4ec45cc0a782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:37.080792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-ca881f29-2727-49a9-826c-4ec45cc0a782 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:37.082004 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ca881f29-2727-49a9-826c-4ec45cc0a782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:37.107420 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cca37a-5b15-44e9-8e8a-bbefb1890cc1 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:37.161487 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 366/729] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 27 18:33:37.164758 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee60f61-c18e-4d2a-afac-806a62997e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:37.165435 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee60f61-c18e-4d2a-afac-806a62997e0c None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:37.165744 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee60f61-c18e-4d2a-afac-806a62997e0c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:37.166027 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee60f61-c18e-4d2a-afac-806a62997e0c None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:37.166766 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee60f61-c18e-4d2a-afac-806a62997e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:37.167081 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee60f61-c18e-4d2a-afac-806a62997e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:37.168543 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee60f61-c18e-4d2a-afac-806a62997e0c None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:37.181516 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 364/730] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:37.185279 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca881f29-2727-49a9-826c-4ec45cc0a782 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:37.189764 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee60f61-c18e-4d2a-afac-806a62997e0c None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:37.223756 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:37.309647 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee60f61-c18e-4d2a-afac-806a62997e0c None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:37.347203 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:37.348525 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628f08e-2bdf-4c78-baa4-15212a96734d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:37.349336 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628f08e-2bdf-4c78-baa4-15212a96734d None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:37.349626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628f08e-2bdf-4c78-baa4-15212a96734d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:37.349908 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628f08e-2bdf-4c78-baa4-15212a96734d None admin] PATH_INFO: `/v3/users/swift` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:37.359038 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628f08e-2bdf-4c78-baa4-15212a96734d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:37.361012 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628f08e-2bdf-4c78-baa4-15212a96734d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:37.376700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-f628f08e-2bdf-4c78-baa4-15212a96734d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 18:33:37.376700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:37.376700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:37.376700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:37.376700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:37.376700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:37.376700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:37.376700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:37.376700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:37.376700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:37.376700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:37.376700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:37.376700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:37.376700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:37.376700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:37.376700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:37.377679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:37.378636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:37.378636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:37.378636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:37.378636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:37.378636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:37.378636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:37.378636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:37.378636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:37.378636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 18:33:37.378636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:37.378636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 365/731] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:33:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:37.385793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628f08e-2bdf-4c78-baa4-15212a96734d None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:37.387078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca881f29-2727-49a9-826c-4ec45cc0a782 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:37.426632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33c159-45e7-4a37-a7ff-506188deec9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:37.427364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33c159-45e7-4a37-a7ff-506188deec9c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:37.427687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33c159-45e7-4a37-a7ff-506188deec9c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:37.427971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff33c159-45e7-4a37-a7ff-506188deec9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:37.440775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff33c159-45e7-4a37-a7ff-506188deec9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:37.449174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-ff33c159-45e7-4a37-a7ff-506188deec9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:33:37.449174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:37.449174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:37.449174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:37.449174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:37.449174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:37.449174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:37.449174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:37.449174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:37.449174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:37.449174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:37.449174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:37.449174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:37.449174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:37.449174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:37.449174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:37.451252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:37.451252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:37.451252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:37.451252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:37.451252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:37.451252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:37.451252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:37.451252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:37.451252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:37.451252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:37.451252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:37.451252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:37.451252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:37.451252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:37.451252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:37.451252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:37.453340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:37.453340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:37.453340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:37.453340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:37.453340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:37.453340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:37.453340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:37.453340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:37.453340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:37.453340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:37.453340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:33:37.453340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:37.453340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 367/732] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:33:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:37.459567 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33c159-45e7-4a37-a7ff-506188deec9c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:37.570104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff33c159-45e7-4a37-a7ff-506188deec9c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:37.633350 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf206b7-db3d-4ae9-8b76-ad4e9df534d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:37.635775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf206b7-db3d-4ae9-8b76-ad4e9df534d5 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:37.636068 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf206b7-db3d-4ae9-8b76-ad4e9df534d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:37.636351 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf206b7-db3d-4ae9-8b76-ad4e9df534d5 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:37.637107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf206b7-db3d-4ae9-8b76-ad4e9df534d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:37.637419 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf206b7-db3d-4ae9-8b76-ad4e9df534d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:37.638809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf206b7-db3d-4ae9-8b76-ad4e9df534d5 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:37.658406 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:37.662402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 368/733] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:33:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:37.664909 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a19ad-4876-4553-859f-2ecee33fd180 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:37.665213 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a19ad-4876-4553-859f-2ecee33fd180 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:37.665495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a19ad-4876-4553-859f-2ecee33fd180 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:37.672246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 369/734] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:37.672246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a19ad-4876-4553-859f-2ecee33fd180 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:37.675290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628f08e-2bdf-4c78-baa4-15212a96734d None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:37.700008 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:37.711062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d89cf-649a-4a4c-aa81-c0963cf7c937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:37.711958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d89cf-649a-4a4c-aa81-c0963cf7c937 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:37.713535 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d89cf-649a-4a4c-aa81-c0963cf7c937 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:37.713535 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d89cf-649a-4a4c-aa81-c0963cf7c937 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:37.713916 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d89cf-649a-4a4c-aa81-c0963cf7c937 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:37.714375 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d89cf-649a-4a4c-aa81-c0963cf7c937 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:37.715958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d89cf-649a-4a4c-aa81-c0963cf7c937 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:37.735840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 366/735] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Jun 27 18:33:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:37.737386 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5e0b4-c26a-48fd-b944-377804d767ad None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:37.737911 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5e0b4-c26a-48fd-b944-377804d767ad None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:37.738312 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5e0b4-c26a-48fd-b944-377804d767ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:37.755993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-a4c5e0b4-c26a-48fd-b944-377804d767ad None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:37.757350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-a4c5e0b4-c26a-48fd-b944-377804d767ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:37.804763 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a19ad-4876-4553-859f-2ecee33fd180 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:37.833885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 367/736] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:37.835574 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5e0b4-c26a-48fd-b944-377804d767ad None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:37.854127 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c274847-701f-4bb7-8512-388fefcde12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:37.854986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c274847-701f-4bb7-8512-388fefcde12d None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:37.855271 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c274847-701f-4bb7-8512-388fefcde12d None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:37.855561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c274847-701f-4bb7-8512-388fefcde12d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:37.871405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c274847-701f-4bb7-8512-388fefcde12d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:37.872948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c274847-701f-4bb7-8512-388fefcde12d None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:37.891689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-7c274847-701f-4bb7-8512-388fefcde12d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:37.891689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:37.891689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:37.891689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:37.891689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:37.891689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:37.891689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:37.891689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:37.891689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:37.891689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:37.891689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:37.891689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:37.891689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:37.891689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:37.891689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:37.892614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:37.892614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:37.892614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:37.892614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:37.892614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:37.892614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:37.892614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:37.892614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:37.892614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:37.892614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:37.892614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:37.892614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:37.892614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:37.892614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:37.892614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:37.892614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:37.892614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:37.893592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:37.893592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:37.893592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:37.893592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:37.893592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 370/737] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:37.894280 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c274847-701f-4bb7-8512-388fefcde12d None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:37.938326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:37.962091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5e0b4-c26a-48fd-b944-377804d767ad None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:37.998019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ef352-36e3-466a-b3f4-8f3ac62bfb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:37.998676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:37.998905 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ef352-36e3-466a-b3f4-8f3ac62bfb76 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:37.999287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ef352-36e3-466a-b3f4-8f3ac62bfb76 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:37.999708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ef352-36e3-466a-b3f4-8f3ac62bfb76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:38.002482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c274847-701f-4bb7-8512-388fefcde12d None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:38.042910 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65d267-e08c-4aa1-b72b-759ef447d225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:38.043801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65d267-e08c-4aa1-b72b-759ef447d225 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:38.044099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65d267-e08c-4aa1-b72b-759ef447d225 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:38.044494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65d267-e08c-4aa1-b72b-759ef447d225 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:38.056232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65d267-e08c-4aa1-b72b-759ef447d225 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:38.065037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-8b65d267-e08c-4aa1-b72b-759ef447d225 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:38.065037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:38.065037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:38.065037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:38.065037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:38.065037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:38.065037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:38.065037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:38.065037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:38.065037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:38.065037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:38.065037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:38.065037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:38.065037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:38.065037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:38.065037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:38.080618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:38.080618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:38.080618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:38.080618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:38.080618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:38.080618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:38.080618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:38.080618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:38.080618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:38.080618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:38.080618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:38.080618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:38.080618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:38.080618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:38.080618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:38.080618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:38.081455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:38.081455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:38.081455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:38.081455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:38.081455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:38.081455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:38.081455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:38.081455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:38.081455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:38.081455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:38.081455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:38.081455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:38.081455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 371/738] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:38.081455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65d267-e08c-4aa1-b72b-759ef447d225 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:38.082210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ef352-36e3-466a-b3f4-8f3ac62bfb76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:38.082210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ef352-36e3-466a-b3f4-8f3ac62bfb76 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:38.156522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:38.179136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65d267-e08c-4aa1-b72b-759ef447d225 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:38.184374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 368/739] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:37 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 27 18:33:38.186681 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a67fe-20f7-441b-984f-a0fc3d385c89 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:38.187113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a67fe-20f7-441b-984f-a0fc3d385c89 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:38.187521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a67fe-20f7-441b-984f-a0fc3d385c89 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:38.189750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 369/740] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:38.191252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a67fe-20f7-441b-984f-a0fc3d385c89 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:38.202387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:38.215562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2718e59-7b8c-4101-9348-166295f8a374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:38.216318 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2718e59-7b8c-4101-9348-166295f8a374 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:38.216601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2718e59-7b8c-4101-9348-166295f8a374 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:38.216878 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2718e59-7b8c-4101-9348-166295f8a374 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:38.218220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2718e59-7b8c-4101-9348-166295f8a374 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:38.218607 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2718e59-7b8c-4101-9348-166295f8a374 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:38.220228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2718e59-7b8c-4101-9348-166295f8a374 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:38.237974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 372/741] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:38.237974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2718e59-7b8c-4101-9348-166295f8a374 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:38.314929 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a67fe-20f7-441b-984f-a0fc3d385c89 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:38.336375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2718e59-7b8c-4101-9348-166295f8a374 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:38.349876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd06d0-8307-4471-8d81-e127c898e739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:38.351066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd06d0-8307-4471-8d81-e127c898e739 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:38.351347 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd06d0-8307-4471-8d81-e127c898e739 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:38.351654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd06d0-8307-4471-8d81-e127c898e739 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:38.352396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd06d0-8307-4471-8d81-e127c898e739 None admin] RBAC: Adding query filter params (name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:38.352706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd06d0-8307-4471-8d81-e127c898e739 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:38.354329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd06d0-8307-4471-8d81-e127c898e739 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:38.367577 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 370/742] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:38.367577 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b0abd-8424-4a89-983b-637cd76870fa None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:38.367577 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b0abd-8424-4a89-983b-637cd76870fa None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:38.367577 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b0abd-8424-4a89-983b-637cd76870fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:38.376004 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd75326-6d4e-4d15-833e-884aabe32352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:38.376802 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd75326-6d4e-4d15-833e-884aabe32352 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:38.377091 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd75326-6d4e-4d15-833e-884aabe32352 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:38.377368 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd75326-6d4e-4d15-833e-884aabe32352 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:38.383323 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-890b0abd-8424-4a89-983b-637cd76870fa None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:38.384526 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-890b0abd-8424-4a89-983b-637cd76870fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:38.388508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd75326-6d4e-4d15-833e-884aabe32352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:38.389988 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd75326-6d4e-4d15-833e-884aabe32352 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:38.408854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-dcd75326-6d4e-4d15-833e-884aabe32352 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:38.408854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:38.408854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:38.408854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:38.408854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:38.408854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:38.408854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:38.408854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:38.408854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:38.408854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:38.408854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:38.408854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:38.408854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:38.408854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:38.408854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:38.409750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:38.409750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:38.409750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:38.409750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:38.409750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:38.409750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:38.409750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:38.409750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:38.409750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:38.409750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:38.409750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:38.409750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:38.409750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:38.409750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:38.409750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:38.409750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:38.409750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:38.410650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:38.410650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:38.410650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:38.410650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:38.410650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 373/743] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:38.410933 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd75326-6d4e-4d15-833e-884aabe32352 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:38.421323 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:38.447566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:38.467617 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 371/744] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:38 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 27 18:33:38.467617 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b0abd-8424-4a89-983b-637cd76870fa None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:38.538838 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd75326-6d4e-4d15-833e-884aabe32352 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:38.567523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b0abd-8424-4a89-983b-637cd76870fa None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:38.574223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df40a92-c2cf-4b22-a764-f6a328d69687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:38.575163 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df40a92-c2cf-4b22-a764-f6a328d69687 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:38.575450 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df40a92-c2cf-4b22-a764-f6a328d69687 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:38.575751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df40a92-c2cf-4b22-a764-f6a328d69687 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:38.583594 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df40a92-c2cf-4b22-a764-f6a328d69687 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:38.585702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df40a92-c2cf-4b22-a764-f6a328d69687 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:38.601659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92778a2-e44c-4570-a65a-468ad593c97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:38.602090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-3df40a92-c2cf-4b22-a764-f6a328d69687 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:33:38.602090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:38.602090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:38.602090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:38.602090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:38.602090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:38.602090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:38.602090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:38.602090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:38.602090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:38.602090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:38.602090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:38.602090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:38.602090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:38.602090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:38.602090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:38.603001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:38.609185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:38.609185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:38.609185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:38.609185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:38.609185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:38.609185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:38.609185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:38.609185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:38.609185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:33:38.609185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:38.609893 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92778a2-e44c-4570-a65a-468ad593c97d None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:38.609893 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92778a2-e44c-4570-a65a-468ad593c97d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:38.609893 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92778a2-e44c-4570-a65a-468ad593c97d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:38.610113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 374/745] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jun 27 18:33:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:38.610113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df40a92-c2cf-4b22-a764-f6a328d69687 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:38.620004 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92778a2-e44c-4570-a65a-468ad593c97d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:38.621516 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92778a2-e44c-4570-a65a-468ad593c97d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:38.639240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-b92778a2-e44c-4570-a65a-468ad593c97d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:38.639240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:38.639240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:38.639240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:38.639240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:38.639240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:38.639240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:38.639240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:38.639240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:38.639240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:38.639240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:38.639240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:38.639240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:38.639240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:38.639240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:38.640356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:38.640356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:38.640356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:38.640356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:38.640356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:38.640356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:38.640356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:38.640356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:38.640356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:38.640356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:38.640356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:38.640356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:38.640356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:38.640356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:38.640356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:38.640356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:38.640356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:38.641258 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:38.641258 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:38.641258 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:38.641258 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:38.645106 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 372/746] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:38.645922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92778a2-e44c-4570-a65a-468ad593c97d None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:38.668885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:38.705063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:38.712362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df40a92-c2cf-4b22-a764-f6a328d69687 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:38.747890 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec980003-bcf0-46a3-96dc-4ba3f85d16db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:38.748475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec980003-bcf0-46a3-96dc-4ba3f85d16db None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:38.748760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec980003-bcf0-46a3-96dc-4ba3f85d16db None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:38.749038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec980003-bcf0-46a3-96dc-4ba3f85d16db None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:38.749766 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec980003-bcf0-46a3-96dc-4ba3f85d16db None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:38.750076 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec980003-bcf0-46a3-96dc-4ba3f85d16db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:38.751453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec980003-bcf0-46a3-96dc-4ba3f85d16db None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:38.753947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92778a2-e44c-4570-a65a-468ad593c97d None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:38.763109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 375/747] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:38.763941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec980003-bcf0-46a3-96dc-4ba3f85d16db None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:38.795774 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62fe76-371e-4f2b-8122-eb99e2c8c4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:38.796784 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62fe76-371e-4f2b-8122-eb99e2c8c4ba None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:38.797218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62fe76-371e-4f2b-8122-eb99e2c8c4ba None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:38.797733 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62fe76-371e-4f2b-8122-eb99e2c8c4ba None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:38.798602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62fe76-371e-4f2b-8122-eb99e2c8c4ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:38.800169 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62fe76-371e-4f2b-8122-eb99e2c8c4ba None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:38.864731 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec980003-bcf0-46a3-96dc-4ba3f85d16db None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:38.897781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783668b0-39b1-4c48-8351-886228b93e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:38.898472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783668b0-39b1-4c48-8351-886228b93e45 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:38.898756 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783668b0-39b1-4c48-8351-886228b93e45 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:38.899034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783668b0-39b1-4c48-8351-886228b93e45 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:38.899900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783668b0-39b1-4c48-8351-886228b93e45 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:38.900215 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783668b0-39b1-4c48-8351-886228b93e45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:38.901661 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783668b0-39b1-4c48-8351-886228b93e45 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:38.918513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 376/748] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jun 27 18:33:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:38.919305 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783668b0-39b1-4c48-8351-886228b93e45 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:38.943567 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 373/749] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jun 27 18:33:38 2022] POST /identity/v3/services => generated 240 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:33:38.943567 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62fe76-371e-4f2b-8122-eb99e2c8c4ba None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:38.944805 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:39.048400 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783668b0-39b1-4c48-8351-886228b93e45 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:39.066728 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:39.094942 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd556fd6-e21e-4b72-a7b0-f3fc7c8bb09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:39.096198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd556fd6-e21e-4b72-a7b0-f3fc7c8bb09b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:39.096310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62fe76-371e-4f2b-8122-eb99e2c8c4ba None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:39.096787 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd556fd6-e21e-4b72-a7b0-f3fc7c8bb09b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:39.097384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd556fd6-e21e-4b72-a7b0-f3fc7c8bb09b None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:39.098324 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd556fd6-e21e-4b72-a7b0-f3fc7c8bb09b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:39.098852 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd556fd6-e21e-4b72-a7b0-f3fc7c8bb09b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:39.100517 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd556fd6-e21e-4b72-a7b0-f3fc7c8bb09b None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:39.123028 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 377/750] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:39.123028 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd556fd6-e21e-4b72-a7b0-f3fc7c8bb09b None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:39.156032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171abcf-65eb-409f-9460-8cdbde95ff9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:39.158505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171abcf-65eb-409f-9460-8cdbde95ff9e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:39.158505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171abcf-65eb-409f-9460-8cdbde95ff9e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:39.158505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171abcf-65eb-409f-9460-8cdbde95ff9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:39.165127 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171abcf-65eb-409f-9460-8cdbde95ff9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:39.166864 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171abcf-65eb-409f-9460-8cdbde95ff9e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:39.182352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-6171abcf-65eb-409f-9460-8cdbde95ff9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:39.182352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:39.182352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:39.182352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:39.182352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:39.182352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:39.182352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:39.182352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:39.182352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:39.182352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:39.182352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:39.182352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:39.182352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:39.182352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:39.182352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:39.183286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:39.183286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:39.183286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:39.183286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:39.183286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:39.183286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:39.183286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:39.183286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:39.183286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:39.183286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:39.183286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:39.183286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:39.183286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:39.183286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:39.183286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:39.183286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:39.183286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:39.184959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:39.184959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:39.184959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:39.184959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:39.184959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:39.184959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:39.184959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:39.184959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:39.184959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 374/751] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:39.184959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171abcf-65eb-409f-9460-8cdbde95ff9e None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:39.198414 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:39.234166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd556fd6-e21e-4b72-a7b0-f3fc7c8bb09b None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:39.270055 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae1b8d-71c6-4006-a5e0-eeff8a415110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:39.270855 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae1b8d-71c6-4006-a5e0-eeff8a415110 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:39.271140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae1b8d-71c6-4006-a5e0-eeff8a415110 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:39.271418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae1b8d-71c6-4006-a5e0-eeff8a415110 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:39.282456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae1b8d-71c6-4006-a5e0-eeff8a415110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:39.283957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae1b8d-71c6-4006-a5e0-eeff8a415110 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:39.296621 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171abcf-65eb-409f-9460-8cdbde95ff9e None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:39.304456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-3dae1b8d-71c6-4006-a5e0-eeff8a415110 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:39.304456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:39.304456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:39.304456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:39.304456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:39.304456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:39.304456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:39.304456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:39.304456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:39.304456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:39.304456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:39.304456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:39.304456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:39.304456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:39.304456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:39.305384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:39.305384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:39.305384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:39.305384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:39.305384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:39.305384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:39.305384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:39.305384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:39.305384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:39.305384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:39.305384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:39.305384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:39.305384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:39.305384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:39.305384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:39.305384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:39.305384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:39.306344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:39.306344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:39.306344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:39.306344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:39.306344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 378/752] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:39.307258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a841b-b595-4309-8e02-32baecc832bf None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:39.307569 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a841b-b595-4309-8e02-32baecc832bf None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:39.307917 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a841b-b595-4309-8e02-32baecc832bf None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:39.310964 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 379/753] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:39.311854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a841b-b595-4309-8e02-32baecc832bf None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:39.341889 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4e0c7-875a-4e90-9782-58f2ae8f6174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:39.343116 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4e0c7-875a-4e90-9782-58f2ae8f6174 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:39.343753 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4e0c7-875a-4e90-9782-58f2ae8f6174 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:39.344041 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d4e0c7-875a-4e90-9782-58f2ae8f6174 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:39.351916 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4e0c7-875a-4e90-9782-58f2ae8f6174 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:39.353538 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d4e0c7-875a-4e90-9782-58f2ae8f6174 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:39.357386 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:39.372100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-75d4e0c7-875a-4e90-9782-58f2ae8f6174 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 18:33:39.372100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:39.372100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:39.372100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:39.372100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:39.372100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:39.372100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:39.372100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:39.372100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:39.372100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:39.372100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:39.372100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:39.372100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:39.372100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:39.372100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:39.372100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:39.373061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:39.374061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:39.374061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:39.374061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:39.374061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:39.374061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:39.374061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:39.374061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:39.374061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:39.374061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 18:33:39.374061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:39.374061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 375/754] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jun 27 18:33:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:39.374659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4e0c7-875a-4e90-9782-58f2ae8f6174 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:39.422391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a841b-b595-4309-8e02-32baecc832bf None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:39.444068 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:39.461627 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909c849-d173-4360-af20-9dda8dc79607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:39.462285 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909c849-d173-4360-af20-9dda8dc79607 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:39.462568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909c849-d173-4360-af20-9dda8dc79607 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:39.462844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909c849-d173-4360-af20-9dda8dc79607 None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:39.463690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909c849-d173-4360-af20-9dda8dc79607 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:39.464003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909c849-d173-4360-af20-9dda8dc79607 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:39.465439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6909c849-d173-4360-af20-9dda8dc79607 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:39.482637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 380/755] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:39.484271 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536b2a8-edfb-4f89-962e-0412a62600d9 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:39.484561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536b2a8-edfb-4f89-962e-0412a62600d9 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:39.484836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536b2a8-edfb-4f89-962e-0412a62600d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:39.486893 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d4e0c7-875a-4e90-9782-58f2ae8f6174 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:39.501992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-7536b2a8-edfb-4f89-962e-0412a62600d9 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:39.503180 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-7536b2a8-edfb-4f89-962e-0412a62600d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:39.529879 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b8b36-4430-41ca-9a0b-708cbb81fa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:39.530983 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b8b36-4430-41ca-9a0b-708cbb81fa19 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:39.531287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b8b36-4430-41ca-9a0b-708cbb81fa19 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:39.531458 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b8b36-4430-41ca-9a0b-708cbb81fa19 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:39.532216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b8b36-4430-41ca-9a0b-708cbb81fa19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:39.532535 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b8b36-4430-41ca-9a0b-708cbb81fa19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:39.533921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b8b36-4430-41ca-9a0b-708cbb81fa19 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:39.549677 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 376/756] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:39.549677 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b8b36-4430-41ca-9a0b-708cbb81fa19 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:39.587552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 381/757] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:33:39.587552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536b2a8-edfb-4f89-962e-0412a62600d9 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:39.622536 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:39.667178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b8b36-4430-41ca-9a0b-708cbb81fa19 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:39.693602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536b2a8-edfb-4f89-962e-0412a62600d9 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:39.701740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2d5d9-5ba5-44fb-a91b-48810017eb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:39.702414 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2d5d9-5ba5-44fb-a91b-48810017eb66 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:39.702702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2d5d9-5ba5-44fb-a91b-48810017eb66 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:39.702984 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2d5d9-5ba5-44fb-a91b-48810017eb66 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:39.703860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2d5d9-5ba5-44fb-a91b-48810017eb66 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:39.704175 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2d5d9-5ba5-44fb-a91b-48810017eb66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:39.705779 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2d5d9-5ba5-44fb-a91b-48810017eb66 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:39.707588 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:39.728934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 377/758] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Jun 27 18:33:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:39.728934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2d5d9-5ba5-44fb-a91b-48810017eb66 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:39.737900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29609334-b4f2-454b-b5c4-76f76ba6e890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:39.738556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29609334-b4f2-454b-b5c4-76f76ba6e890 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:39.738842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29609334-b4f2-454b-b5c4-76f76ba6e890 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:39.739129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29609334-b4f2-454b-b5c4-76f76ba6e890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:39.739992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29609334-b4f2-454b-b5c4-76f76ba6e890 None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=94555ff897d94c90968c470d82ff9e2a) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:39.740310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29609334-b4f2-454b-b5c4-76f76ba6e890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:39.742378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29609334-b4f2-454b-b5c4-76f76ba6e890 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:39.748197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 382/759] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:33:39 2022] GET /identity/v3/role_assignments?user.id=94555ff897d94c90968c470d82ff9e2a&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=b156409c977248e1b23c26e589b1e04f => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:39.749056 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29609334-b4f2-454b-b5c4-76f76ba6e890 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:39.862692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2d5d9-5ba5-44fb-a91b-48810017eb66 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:39.884371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:39.885901 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29609334-b4f2-454b-b5c4-76f76ba6e890 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:39.905518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6810888-7562-48e0-8acb-31f61912a6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:39.906498 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6810888-7562-48e0-8acb-31f61912a6b9 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:39.906890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6810888-7562-48e0-8acb-31f61912a6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:39.907272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6810888-7562-48e0-8acb-31f61912a6b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:39.916134 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6810888-7562-48e0-8acb-31f61912a6b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:39.917710 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6810888-7562-48e0-8acb-31f61912a6b9 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:39.931685 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd33fc6-b1ae-40c8-9dc2-2e689b57624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:39.932817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd33fc6-b1ae-40c8-9dc2-2e689b57624b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:39.933287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd33fc6-b1ae-40c8-9dc2-2e689b57624b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:39.933746 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd33fc6-b1ae-40c8-9dc2-2e689b57624b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:39.934514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-c6810888-7562-48e0-8acb-31f61912a6b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:39.934514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:39.934514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:39.934514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:39.934514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:39.934514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:39.934514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:39.934514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:39.934514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:39.934514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:39.934514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:39.934514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:39.934514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:39.934514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:39.934514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:39.935377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:39.935377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:39.935377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:39.935377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:39.935377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:39.935377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:39.935377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:39.935377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:39.935377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:39.935377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:39.935377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:39.935377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:39.935377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:39.935377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:39.935377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:39.935377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:39.935377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:39.936304 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:39.936304 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:39.936304 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:39.936304 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:39.936304 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:39.936304 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:39.936304 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:39.936304 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:39.936737 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd33fc6-b1ae-40c8-9dc2-2e689b57624b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:39.936808 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 378/760] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:39.936886 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6810888-7562-48e0-8acb-31f61912a6b9 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:39.937241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd33fc6-b1ae-40c8-9dc2-2e689b57624b None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:39.955553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-9dd33fc6-b1ae-40c8-9dc2-2e689b57624b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 18:33:39.955553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:39.955553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:33:39.955553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:33:39.955553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:33:39.955553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:33:39.955553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:33:39.955553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:39.955553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 18:33:39.955553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:39.955553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:33:39.955553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:39.955553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:39.955553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:39.955553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:39.955553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:39.956554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:39.956554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:39.956554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:39.956554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:39.956554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:39.956554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:39.956554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:39.956554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:33:39.956554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:33:39.956554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:33:39.956554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:33:39.956554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:39.956554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:39.956554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:39.956554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:39.956554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:39.957383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:39.957383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:39.957383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:39.957383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:39.957383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:39.957383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:39.957383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:39.957383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:39.957383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:39.957383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:39.957383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:39.957383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:33:39.957383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:39.957383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 18:33:39.957383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:39.957383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 383/761] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Jun 27 18:33:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:39.958260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd33fc6-b1ae-40c8-9dc2-2e689b57624b None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:40.006661 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:40.060009 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6810888-7562-48e0-8acb-31f61912a6b9 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:40.090620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd33fc6-b1ae-40c8-9dc2-2e689b57624b None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:40.098114 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151687d-db71-42e1-a9d0-6603b82d8ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:40.099072 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151687d-db71-42e1-a9d0-6603b82d8ec7 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:40.100347 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151687d-db71-42e1-a9d0-6603b82d8ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:40.101296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151687d-db71-42e1-a9d0-6603b82d8ec7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:40.141666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e56a38-b3a0-422f-ae08-fd1073ef4ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:40.143487 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e56a38-b3a0-422f-ae08-fd1073ef4ac6 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:40.143965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e56a38-b3a0-422f-ae08-fd1073ef4ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:40.144397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e56a38-b3a0-422f-ae08-fd1073ef4ac6 None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:40.145344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e56a38-b3a0-422f-ae08-fd1073ef4ac6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:40.145830 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e56a38-b3a0-422f-ae08-fd1073ef4ac6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:40.148177 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e56a38-b3a0-422f-ae08-fd1073ef4ac6 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:40.157269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:40.172287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 384/762] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:40.173485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e56a38-b3a0-422f-ae08-fd1073ef4ac6 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:40.182696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151687d-db71-42e1-a9d0-6603b82d8ec7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:40.184231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151687d-db71-42e1-a9d0-6603b82d8ec7 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:40.285783 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:40.291600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e56a38-b3a0-422f-ae08-fd1073ef4ac6 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:40.301700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 379/763] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:33:40.303734 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151687d-db71-42e1-a9d0-6603b82d8ec7 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:40.331519 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173b452-dde7-4f6a-a5f1-16acb03619a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:40.332255 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173b452-dde7-4f6a-a5f1-16acb03619a0 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:40.332546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173b452-dde7-4f6a-a5f1-16acb03619a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:40.332823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173b452-dde7-4f6a-a5f1-16acb03619a0 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:40.333562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173b452-dde7-4f6a-a5f1-16acb03619a0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:40.333835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173b452-dde7-4f6a-a5f1-16acb03619a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:40.335834 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173b452-dde7-4f6a-a5f1-16acb03619a0 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:40.345574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 385/764] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Jun 27 18:33:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:40.346332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173b452-dde7-4f6a-a5f1-16acb03619a0 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:40.407433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:40.437180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151687d-db71-42e1-a9d0-6603b82d8ec7 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:40.458871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173b452-dde7-4f6a-a5f1-16acb03619a0 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:40.487560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66e073-2b76-4fde-8bd5-5c3687d57530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:40.489387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66e073-2b76-4fde-8bd5-5c3687d57530 None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:40.490155 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66e073-2b76-4fde-8bd5-5c3687d57530 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:40.490651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66e073-2b76-4fde-8bd5-5c3687d57530 None admin] PATH_INFO: `/v3/projects/94dba2006b6747f8badff33745bde432/users/da1746d29f9e4e8b8626ad4b11931cbd/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:40.494354 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66e073-2b76-4fde-8bd5-5c3687d57530 None admin] RBAC: Authorizing `identity:create_grant(project_id=94dba2006b6747f8badff33745bde432, user_id=da1746d29f9e4e8b8626ad4b11931cbd, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:40.496306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66e073-2b76-4fde-8bd5-5c3687d57530 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:40.497876 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce06e7-87c0-44fb-9700-f2e8cd17eaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:40.498679 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce06e7-87c0-44fb-9700-f2e8cd17eaf9 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:40.499017 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce06e7-87c0-44fb-9700-f2e8cd17eaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:40.499447 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce06e7-87c0-44fb-9700-f2e8cd17eaf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:40.511046 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce06e7-87c0-44fb-9700-f2e8cd17eaf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:40.512626 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce06e7-87c0-44fb-9700-f2e8cd17eaf9 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:40.536007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-15ce06e7-87c0-44fb-9700-f2e8cd17eaf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:40.536007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:40.536007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:40.536007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:40.536007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:40.536007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:40.536007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:40.536007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:40.536007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:40.536007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:40.536007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:40.536007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:40.536007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:40.536007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:40.536007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:40.537038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:40.537038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:40.537038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:40.537038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:40.537038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:40.537038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:40.537038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:40.537038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:40.537038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:40.537038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:40.537038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:40.537038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:40.537038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:40.537038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:40.537038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:40.537038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:40.537038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:40.538530 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:40.538530 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:40.538530 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:40.538530 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:40.538530 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 386/765] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:40.539273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce06e7-87c0-44fb-9700-f2e8cd17eaf9 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:40.555640 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:40.579562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 380/766] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:33:40 2022] PUT /identity/v3/projects/94dba2006b6747f8badff33745bde432/users/da1746d29f9e4e8b8626ad4b11931cbd/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:33:40.580530 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66e073-2b76-4fde-8bd5-5c3687d57530 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:40.709244 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce06e7-87c0-44fb-9700-f2e8cd17eaf9 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:40.774767 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66e073-2b76-4fde-8bd5-5c3687d57530 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:40.780876 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e9825-a7e8-4c74-be1e-6ae4001ea085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:40.781931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e9825-a7e8-4c74-be1e-6ae4001ea085 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:40.782478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e9825-a7e8-4c74-be1e-6ae4001ea085 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:40.782975 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e9825-a7e8-4c74-be1e-6ae4001ea085 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:40.784073 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e9825-a7e8-4c74-be1e-6ae4001ea085 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:40.784592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e9825-a7e8-4c74-be1e-6ae4001ea085 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:40.786345 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e9825-a7e8-4c74-be1e-6ae4001ea085 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:40.792580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 387/767] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Jun 27 18:33:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:40.798767 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e9825-a7e8-4c74-be1e-6ae4001ea085 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:40.813891 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83346a09-235a-4a49-86e3-c87e96cc7b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:40.814787 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83346a09-235a-4a49-86e3-c87e96cc7b40 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:40.814936 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83346a09-235a-4a49-86e3-c87e96cc7b40 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:40.815160 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83346a09-235a-4a49-86e3-c87e96cc7b40 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:40.815934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83346a09-235a-4a49-86e3-c87e96cc7b40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:40.816255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83346a09-235a-4a49-86e3-c87e96cc7b40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:40.817639 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83346a09-235a-4a49-86e3-c87e96cc7b40 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:40.825139 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:40.831476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 381/768] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:40.839880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83346a09-235a-4a49-86e3-c87e96cc7b40 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:40.897882 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:40.918342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e9825-a7e8-4c74-be1e-6ae4001ea085 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:40.950951 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83346a09-235a-4a49-86e3-c87e96cc7b40 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:40.954528 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb37da-9d6b-49e1-90c5-bb77e9231d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:40.955061 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb37da-9d6b-49e1-90c5-bb77e9231d06 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:40.955444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb37da-9d6b-49e1-90c5-bb77e9231d06 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:40.955896 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb37da-9d6b-49e1-90c5-bb77e9231d06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:40.956791 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb37da-9d6b-49e1-90c5-bb77e9231d06 None admin] RBAC: Adding query filter params (interface=public, service_id=3d65edca9d0048cca2d8eec90577edd5, region_id=RegionOne) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:40.957212 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb37da-9d6b-49e1-90c5-bb77e9231d06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:40.958680 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb37da-9d6b-49e1-90c5-bb77e9231d06 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:40.968349 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 388/769] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Jun 27 18:33:40 2022] GET /identity/v3/endpoints?service_id=3d65edca9d0048cca2d8eec90577edd5&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:40.976650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb37da-9d6b-49e1-90c5-bb77e9231d06 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:41.028683 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddffb74-061e-4780-abc2-493e42e881b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:41.029924 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddffb74-061e-4780-abc2-493e42e881b0 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:41.031100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddffb74-061e-4780-abc2-493e42e881b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:41.031616 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddffb74-061e-4780-abc2-493e42e881b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:41.044962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddffb74-061e-4780-abc2-493e42e881b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:41.047573 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddffb74-061e-4780-abc2-493e42e881b0 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:41.068296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-eddffb74-061e-4780-abc2-493e42e881b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:41.068296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:41.068296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:41.068296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:41.068296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:41.068296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:41.068296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:41.068296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:41.068296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:41.068296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:41.068296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:41.068296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:41.068296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:41.068296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:41.068296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:41.069316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:41.069316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:41.069316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:41.069316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:41.069316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:41.069316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:41.069316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:41.069316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:41.069316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:41.069316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:41.069316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:41.069316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:41.069316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:41.069316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:41.069316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:41.069316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:41.069316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:41.070231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:41.070231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:41.070231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:41.070231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:41.070231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:41.070231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:41.070231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:41.070231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:41.072734 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 382/770] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:41.074162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525614eb-38f2-419a-b75c-4b29f4e7883d None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:41.074660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525614eb-38f2-419a-b75c-4b29f4e7883d None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:41.074963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525614eb-38f2-419a-b75c-4b29f4e7883d None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:41.076381 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 383/771] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:41.082581 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525614eb-38f2-419a-b75c-4b29f4e7883d None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:41.110742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb37da-9d6b-49e1-90c5-bb77e9231d06 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:41.151303 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:41.154143 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d136689-8924-40bd-85ef-73607654f5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:41.154816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d136689-8924-40bd-85ef-73607654f5b8 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:41.155103 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d136689-8924-40bd-85ef-73607654f5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:41.155382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d136689-8924-40bd-85ef-73607654f5b8 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:41.156104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d136689-8924-40bd-85ef-73607654f5b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:41.157488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d136689-8924-40bd-85ef-73607654f5b8 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:41.165742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 389/772] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jun 27 18:33:40 2022] GET /identity/v3/services => generated 772 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:41.167483 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677aec80-f847-4d1f-bb86-b87e8eb7c088 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:41.168231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677aec80-f847-4d1f-bb86-b87e8eb7c088 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:41.168732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677aec80-f847-4d1f-bb86-b87e8eb7c088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:41.189371 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-677aec80-f847-4d1f-bb86-b87e8eb7c088 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:41.190974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-677aec80-f847-4d1f-bb86-b87e8eb7c088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:41.207929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:41.276156 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 390/773] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:33:41.291800 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525614eb-38f2-419a-b75c-4b29f4e7883d None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:41.343399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d8826-bc28-418b-8fe1-9daa10522b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:41.348099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677aec80-f847-4d1f-bb86-b87e8eb7c088 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:41.348482 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d8826-bc28-418b-8fe1-9daa10522b1a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:41.348670 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d8826-bc28-418b-8fe1-9daa10522b1a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:41.348952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d8826-bc28-418b-8fe1-9daa10522b1a None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:41.349797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d8826-bc28-418b-8fe1-9daa10522b1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:41.350132 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d8826-bc28-418b-8fe1-9daa10522b1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:41.352291 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d8826-bc28-418b-8fe1-9daa10522b1a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:41.371956 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 384/774] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:41.380642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d8826-bc28-418b-8fe1-9daa10522b1a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:41.480730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677aec80-f847-4d1f-bb86-b87e8eb7c088 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:41.497824 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d8826-bc28-418b-8fe1-9daa10522b1a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:41.518269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:41.528141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91b4a6-c2ce-4098-a22b-4d2976fc246b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:41.529777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91b4a6-c2ce-4098-a22b-4d2976fc246b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:41.530213 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91b4a6-c2ce-4098-a22b-4d2976fc246b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:41.530786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb91b4a6-c2ce-4098-a22b-4d2976fc246b None admin] PATH_INFO: `/v3/services/network` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:41.531758 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91b4a6-c2ce-4098-a22b-4d2976fc246b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:41.537339 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb91b4a6-c2ce-4098-a22b-4d2976fc246b None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:41.538590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:41.539992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff454980-b4d6-471d-b112-a4236b8cf939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:41.540725 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff454980-b4d6-471d-b112-a4236b8cf939 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:41.541079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff454980-b4d6-471d-b112-a4236b8cf939 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:41.541426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff454980-b4d6-471d-b112-a4236b8cf939 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:41.542397 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff454980-b4d6-471d-b112-a4236b8cf939 None admin] RBAC: Adding query filter params (role.id=62fd6b166d1847b19e812160b459d5db, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=6e6313c444eb4a788b6559eff17959f8) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:41.542781 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff454980-b4d6-471d-b112-a4236b8cf939 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:41.544321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff454980-b4d6-471d-b112-a4236b8cf939 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:41.550107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-cb91b4a6-c2ce-4098-a22b-4d2976fc246b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 18:33:41.550107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:41.550107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:33:41.550107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:33:41.550107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:33:41.550107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:33:41.550107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:33:41.550107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:41.550107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 18:33:41.550107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:41.550107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:33:41.550107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:41.550107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:41.550107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:41.550107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:41.550107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:41.550107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:41.551078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:41.551078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:41.551078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:41.551078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:41.551078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:41.551078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:41.551078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:33:41.551078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:33:41.551078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:33:41.551078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:33:41.551078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:41.551078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:41.551078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:41.551078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:41.551078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:41.551078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:41.551985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:41.551985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:41.551985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:41.551985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:41.551985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:41.551985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:41.551985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:41.551985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:41.551985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:41.551985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:41.551985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:33:41.551985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:41.551985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 18:33:41.551985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:41.554439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 391/776] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:41 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:41.554557 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 385/776] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:33:41 2022] GET /identity/v3/role_assignments?user.id=6e6313c444eb4a788b6559eff17959f8&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=62fd6b166d1847b19e812160b459d5db => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:41.560781 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff454980-b4d6-471d-b112-a4236b8cf939 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:41.732440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff454980-b4d6-471d-b112-a4236b8cf939 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:41.769921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168165a-db95-46e5-bd3f-0cab14dd2da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:41.770826 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168165a-db95-46e5-bd3f-0cab14dd2da0 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:41.771277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168165a-db95-46e5-bd3f-0cab14dd2da0 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:41.771738 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168165a-db95-46e5-bd3f-0cab14dd2da0 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:41.773125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168165a-db95-46e5-bd3f-0cab14dd2da0 None admin] RBAC: Adding query filter params (name=network) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:41.773593 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168165a-db95-46e5-bd3f-0cab14dd2da0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:41.775109 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168165a-db95-46e5-bd3f-0cab14dd2da0 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:41.780431 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 386/777] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jun 27 18:33:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:41.786121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91b4a6-c2ce-4098-a22b-4d2976fc246b None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:41.892806 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb91b4a6-c2ce-4098-a22b-4d2976fc246b None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:41.927313 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a79f0f-a732-47ca-b410-321a8e8f4be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:41.928856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a79f0f-a732-47ca-b410-321a8e8f4be7 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:41.929291 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a79f0f-a732-47ca-b410-321a8e8f4be7 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:41.929794 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a79f0f-a732-47ca-b410-321a8e8f4be7 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:41.930648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a79f0f-a732-47ca-b410-321a8e8f4be7 None admin] RBAC: Adding query filter params (type=network) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:41.931099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a79f0f-a732-47ca-b410-321a8e8f4be7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:41.932650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a79f0f-a732-47ca-b410-321a8e8f4be7 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:41.938352 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 392/778] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jun 27 18:33:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:41.944184 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168165a-db95-46e5-bd3f-0cab14dd2da0 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:41.997121 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:42.051593 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168165a-db95-46e5-bd3f-0cab14dd2da0 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:42.089064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84730423-9527-4f9e-8e31-a5776df0b5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:42.089970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84730423-9527-4f9e-8e31-a5776df0b5df None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:42.090401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84730423-9527-4f9e-8e31-a5776df0b5df None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:42.090854 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84730423-9527-4f9e-8e31-a5776df0b5df None admin] PATH_INFO: `/v3/endpoints` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:42.091806 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84730423-9527-4f9e-8e31-a5776df0b5df None admin] RBAC: Adding query filter params (interface=public, service_id=85c1a0fd8328493e903d7c477d68baad, region_id=RegionOne) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:42.092265 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84730423-9527-4f9e-8e31-a5776df0b5df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:42.093762 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84730423-9527-4f9e-8e31-a5776df0b5df None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:42.102699 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 387/779] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Jun 27 18:33:41 2022] GET /identity/v3/endpoints?service_id=85c1a0fd8328493e903d7c477d68baad&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:42.108600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a79f0f-a732-47ca-b410-321a8e8f4be7 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:42.110278 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa251bbb-4b71-4be6-9891-b9160e66d343 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:42.110566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa251bbb-4b71-4be6-9891-b9160e66d343 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:42.110844 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa251bbb-4b71-4be6-9891-b9160e66d343 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:42.112261 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 388/780] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:42.118758 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64384da2-314f-4c95-8e52-560d93714e01 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:42.119288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64384da2-314f-4c95-8e52-560d93714e01 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:42.119815 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64384da2-314f-4c95-8e52-560d93714e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:42.151073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-64384da2-314f-4c95-8e52-560d93714e01 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:42.152712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-64384da2-314f-4c95-8e52-560d93714e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:42.193854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:42.249890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 389/781] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:33:42.269148 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a79f0f-a732-47ca-b410-321a8e8f4be7 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:42.282345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64384da2-314f-4c95-8e52-560d93714e01 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:42.328704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e3a96-bc01-4449-b160-5754af99aa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:42.329641 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e3a96-bc01-4449-b160-5754af99aa45 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:42.329982 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e3a96-bc01-4449-b160-5754af99aa45 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:42.330263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6e3a96-bc01-4449-b160-5754af99aa45 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:42.331193 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e3a96-bc01-4449-b160-5754af99aa45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:42.333175 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6e3a96-bc01-4449-b160-5754af99aa45 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:42.340069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 393/782] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jun 27 18:33:42 2022] GET /identity/v3/services => generated 772 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:42.358972 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:42.460977 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64384da2-314f-4c95-8e52-560d93714e01 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:42.513845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb2e4d-094c-49ce-a0c3-d57a2311d4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:42.514677 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb2e4d-094c-49ce-a0c3-d57a2311d4bc None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:42.514968 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb2e4d-094c-49ce-a0c3-d57a2311d4bc None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:42.515250 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb2e4d-094c-49ce-a0c3-d57a2311d4bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:42.527400 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb2e4d-094c-49ce-a0c3-d57a2311d4bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:42.535197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-35cb2e4d-094c-49ce-a0c3-d57a2311d4bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:33:42.535197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:42.535197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:42.535197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:42.535197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:42.535197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:42.535197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:42.535197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:42.535197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:42.535197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:42.535197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:42.535197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:42.535197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:42.535197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:42.535197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:42.535197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:42.536190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:42.536190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:42.536190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:42.536190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:42.536190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:42.536190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:42.536190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:42.536190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:42.536190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:42.536190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:42.536190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:42.536190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:42.536190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:42.536190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:42.536190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:42.536190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:42.537040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:42.537040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:42.537040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:42.537040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:42.537040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:42.537040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:42.537040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:42.537040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:42.537040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:42.537040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:42.537040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:33:42.537040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:42.538849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 390/783] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:33:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:42.543956 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e3a96-bc01-4449-b160-5754af99aa45 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:42.655744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6e3a96-bc01-4449-b160-5754af99aa45 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:42.684461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:42.692541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac596d7c-a59d-4998-b206-6e24a3fbbcae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:42.693220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac596d7c-a59d-4998-b206-6e24a3fbbcae None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:42.693506 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac596d7c-a59d-4998-b206-6e24a3fbbcae None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:42.693846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac596d7c-a59d-4998-b206-6e24a3fbbcae None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:42.694603 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac596d7c-a59d-4998-b206-6e24a3fbbcae None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:42.694916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac596d7c-a59d-4998-b206-6e24a3fbbcae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:42.696416 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac596d7c-a59d-4998-b206-6e24a3fbbcae None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:42.705667 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 394/784] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:33:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:42.711484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb2e4d-094c-49ce-a0c3-d57a2311d4bc None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:42.845000 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:42.848287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb2e4d-094c-49ce-a0c3-d57a2311d4bc None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:42.928335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158c347-bacc-4e93-900a-98349506ba2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:42.929490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158c347-bacc-4e93-900a-98349506ba2b None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:42.929994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158c347-bacc-4e93-900a-98349506ba2b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:42.930470 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158c347-bacc-4e93-900a-98349506ba2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:42.946192 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158c347-bacc-4e93-900a-98349506ba2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:42.947988 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158c347-bacc-4e93-900a-98349506ba2b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:42.971062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-7158c347-bacc-4e93-900a-98349506ba2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:42.971062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:42.971062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:42.971062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:42.971062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:42.971062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:42.971062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:42.971062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:42.971062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:42.971062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:42.971062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:42.971062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:42.971062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:42.971062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:42.971062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:42.972052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:42.972052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:42.972052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:42.972052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:42.972052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:42.972052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:42.972052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:42.972052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:42.972052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:42.972052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:42.972052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:42.972052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:42.972052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:42.972052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:42.972052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:42.972052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:42.972052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:42.972955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:42.972955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:42.972955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:42.972955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:42.974881 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 391/785] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:42.980559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac596d7c-a59d-4998-b206-6e24a3fbbcae None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:43.084511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09767d06-aae9-44e6-9009-696ef4cb21a2 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:43.085147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09767d06-aae9-44e6-9009-696ef4cb21a2 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:43.085626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09767d06-aae9-44e6-9009-696ef4cb21a2 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:43.088452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 392/786] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:43.092894 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fefcd-d049-49fd-b74a-d3e4613bccfa None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:43.093428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fefcd-d049-49fd-b74a-d3e4613bccfa None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:43.093906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fefcd-d049-49fd-b74a-d3e4613bccfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:43.111386 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-c77fefcd-d049-49fd-b74a-d3e4613bccfa None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:43.112938 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c77fefcd-d049-49fd-b74a-d3e4613bccfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:43.151343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac596d7c-a59d-4998-b206-6e24a3fbbcae None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:43.204266 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 393/787] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:33:43.206221 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096294d-6f0b-442f-b5bc-49cc97bc349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:43.206893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096294d-6f0b-442f-b5bc-49cc97bc349c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:43.207180 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096294d-6f0b-442f-b5bc-49cc97bc349c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:43.207459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096294d-6f0b-442f-b5bc-49cc97bc349c None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:43.208217 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096294d-6f0b-442f-b5bc-49cc97bc349c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:43.208529 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096294d-6f0b-442f-b5bc-49cc97bc349c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:43.209940 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096294d-6f0b-442f-b5bc-49cc97bc349c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:43.222286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 395/788] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:43.227775 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fefcd-d049-49fd-b74a-d3e4613bccfa None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:43.260916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096294d-6f0b-442f-b5bc-49cc97bc349c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:43.341574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:43.364140 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:43.399033 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fefcd-d049-49fd-b74a-d3e4613bccfa None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:43.438859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096294d-6f0b-442f-b5bc-49cc97bc349c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:43.464369 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64b8f5-c33b-46fe-ba26-304c1ca4b236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:43.465092 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64b8f5-c33b-46fe-ba26-304c1ca4b236 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:43.465376 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64b8f5-c33b-46fe-ba26-304c1ca4b236 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:43.465649 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64b8f5-c33b-46fe-ba26-304c1ca4b236 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:43.479045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64b8f5-c33b-46fe-ba26-304c1ca4b236 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:43.480543 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64b8f5-c33b-46fe-ba26-304c1ca4b236 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:43.502779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624029da-514b-433e-ae43-88edbe90126a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:43.503593 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624029da-514b-433e-ae43-88edbe90126a None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:43.503881 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624029da-514b-433e-ae43-88edbe90126a None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:43.504157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624029da-514b-433e-ae43-88edbe90126a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:43.512298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-de64b8f5-c33b-46fe-ba26-304c1ca4b236 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 18:33:43.512298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:43.512298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:43.512298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:43.512298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:43.512298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:43.512298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:43.512298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:43.512298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:43.512298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:43.512298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:43.512298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:43.512298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:43.512298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:43.512298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:43.512298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:43.513520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:43.514466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:43.514466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:43.514466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:43.514466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:43.514466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:43.514466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:43.514466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:43.514466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:43.514466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 18:33:43.514466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:43.514466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 394/789] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:33:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:43.517608 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64b8f5-c33b-46fe-ba26-304c1ca4b236 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:43.536603 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624029da-514b-433e-ae43-88edbe90126a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:43.544639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-624029da-514b-433e-ae43-88edbe90126a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:33:43.544639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:43.544639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:43.544639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:43.544639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:43.544639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:43.544639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:43.544639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:43.544639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:43.544639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:43.544639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:43.544639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:43.544639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:43.544639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:43.544639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:43.544639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:43.545993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:43.545993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:43.545993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:43.545993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:43.545993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:43.545993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:43.545993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:43.545993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:43.545993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:43.545993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:43.545993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:43.545993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:43.545993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:43.545993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:43.545993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:43.545993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:43.547712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:43.547712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:43.547712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:43.547712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:43.547712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:43.547712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:43.547712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:43.547712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:43.547712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:43.547712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:43.547712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:33:43.547712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:43.547712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 396/790] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:33:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:43.551830 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624029da-514b-433e-ae43-88edbe90126a None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:43.657767 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624029da-514b-433e-ae43-88edbe90126a None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:43.671930 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:43.695883 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39dc1c-0112-433e-8342-695a755e8764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:43.697153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39dc1c-0112-433e-8342-695a755e8764 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:43.697635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39dc1c-0112-433e-8342-695a755e8764 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:43.698074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d39dc1c-0112-433e-8342-695a755e8764 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:43.706332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39dc1c-0112-433e-8342-695a755e8764 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:43.706332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39dc1c-0112-433e-8342-695a755e8764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:43.706332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d39dc1c-0112-433e-8342-695a755e8764 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:43.716379 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 397/791] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:33:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:43.718031 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39dc1c-0112-433e-8342-695a755e8764 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:43.723516 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64b8f5-c33b-46fe-ba26-304c1ca4b236 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:43.759740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb493a-60a9-43a8-836f-c3551949c105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:43.760417 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb493a-60a9-43a8-836f-c3551949c105 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:43.760707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb493a-60a9-43a8-836f-c3551949c105 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:43.760987 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb493a-60a9-43a8-836f-c3551949c105 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:43.761838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb493a-60a9-43a8-836f-c3551949c105 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:43.762152 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb493a-60a9-43a8-836f-c3551949c105 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:43.763678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb493a-60a9-43a8-836f-c3551949c105 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:43.778676 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:43.782765 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 395/792] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Jun 27 18:33:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:43.788812 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb493a-60a9-43a8-836f-c3551949c105 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:43.828879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d39dc1c-0112-433e-8342-695a755e8764 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:43.916614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f769138-2368-408f-8506-3b1cfec43f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:43.917388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f769138-2368-408f-8506-3b1cfec43f20 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:43.917674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f769138-2368-408f-8506-3b1cfec43f20 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:43.917953 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f769138-2368-408f-8506-3b1cfec43f20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:43.928794 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f769138-2368-408f-8506-3b1cfec43f20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:43.930248 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f769138-2368-408f-8506-3b1cfec43f20 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:43.948183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-9f769138-2368-408f-8506-3b1cfec43f20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:43.948183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:43.948183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:43.948183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:43.948183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:43.948183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:43.948183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:43.948183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:43.948183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:43.948183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:43.948183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:43.948183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:43.948183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:43.948183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:43.948183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:43.949138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:43.949138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:43.949138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:43.949138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:43.949138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:43.949138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:43.949138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:43.949138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:43.949138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:43.949138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:43.949138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:43.949138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:43.949138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:43.949138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:43.949138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:43.949138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:43.949138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:43.950040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:43.950040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:43.950040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:43.950040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:43.954064 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 398/793] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:43.955409 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497eadb-a694-4a5f-b3b6-8884e31c809a None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:43.955729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497eadb-a694-4a5f-b3b6-8884e31c809a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:43.956015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497eadb-a694-4a5f-b3b6-8884e31c809a None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:43.957540 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 399/794] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:43.958254 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497eadb-a694-4a5f-b3b6-8884e31c809a None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:43.964491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb493a-60a9-43a8-836f-c3551949c105 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:43.989621 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:44.004367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea3377-f1d5-4992-b6ae-50f98be09fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:44.005546 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea3377-f1d5-4992-b6ae-50f98be09fc1 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:44.006407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea3377-f1d5-4992-b6ae-50f98be09fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:44.006734 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea3377-f1d5-4992-b6ae-50f98be09fc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:44.019036 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea3377-f1d5-4992-b6ae-50f98be09fc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:44.020545 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea3377-f1d5-4992-b6ae-50f98be09fc1 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:44.039509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-06ea3377-f1d5-4992-b6ae-50f98be09fc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:44.039509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:44.039509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:44.039509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:44.039509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:44.039509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:44.039509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:44.039509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:44.039509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:44.039509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:44.039509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:44.039509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:44.039509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:44.039509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:44.039509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:44.040474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:44.040474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:44.040474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:44.040474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:44.040474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:44.040474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:44.040474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:44.040474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:44.040474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:44.040474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:44.040474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:44.040474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:44.040474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:44.040474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:44.040474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:44.040474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:44.040474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:44.041377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:44.041377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:44.041377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:44.041377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:44.041377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 396/795] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:44.042073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6795bad-928e-46bc-88e8-5133fea6b186 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:44.042255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6795bad-928e-46bc-88e8-5133fea6b186 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:44.042540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6795bad-928e-46bc-88e8-5133fea6b186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:44.058550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-f6795bad-928e-46bc-88e8-5133fea6b186 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:44.059762 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-f6795bad-928e-46bc-88e8-5133fea6b186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:44.075834 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497eadb-a694-4a5f-b3b6-8884e31c809a None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:44.108419 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:44.111418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0b92f-9224-4c00-a412-39a14f82561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:44.112117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0b92f-9224-4c00-a412-39a14f82561c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:44.112407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0b92f-9224-4c00-a412-39a14f82561c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:44.112692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0b92f-9224-4c00-a412-39a14f82561c None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:44.113436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0b92f-9224-4c00-a412-39a14f82561c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:44.113789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0b92f-9224-4c00-a412-39a14f82561c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:44.115138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0b92f-9224-4c00-a412-39a14f82561c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:44.130789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 400/796] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:44.130789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da53dc-ca88-4763-95d6-fef8e697396d None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:44.130789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da53dc-ca88-4763-95d6-fef8e697396d None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:44.130789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50da53dc-ca88-4763-95d6-fef8e697396d None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:44.130789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 401/797] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:44.130789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da53dc-ca88-4763-95d6-fef8e697396d None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:44.136138 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 397/798] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:33:44.137205 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6795bad-928e-46bc-88e8-5133fea6b186 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:44.236206 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:44.250952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6795bad-928e-46bc-88e8-5133fea6b186 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:44.253045 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50da53dc-ca88-4763-95d6-fef8e697396d None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:44.279172 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f9ce6-4c05-4591-815a-33d0569fad7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:44.279821 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f9ce6-4c05-4591-815a-33d0569fad7d None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:44.280105 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f9ce6-4c05-4591-815a-33d0569fad7d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:44.280381 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f9ce6-4c05-4591-815a-33d0569fad7d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:44.287468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f9ce6-4c05-4591-815a-33d0569fad7d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:44.289440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f9ce6-4c05-4591-815a-33d0569fad7d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:44.294000 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effacd93-5ef0-4579-9ff5-dd66b5c87267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:44.294671 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effacd93-5ef0-4579-9ff5-dd66b5c87267 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:44.294960 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effacd93-5ef0-4579-9ff5-dd66b5c87267 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:44.295241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effacd93-5ef0-4579-9ff5-dd66b5c87267 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:44.296001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effacd93-5ef0-4579-9ff5-dd66b5c87267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:44.296314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effacd93-5ef0-4579-9ff5-dd66b5c87267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:44.297673 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effacd93-5ef0-4579-9ff5-dd66b5c87267 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:44.303701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-c12f9ce6-4c05-4591-815a-33d0569fad7d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:33:44.303701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:44.303701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:44.303701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:44.303701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:44.303701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:44.303701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:44.303701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:44.303701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:44.303701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:44.303701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:44.303701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:44.303701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:44.303701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:44.303701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:44.303701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:44.304604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:44.305603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:44.305603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:44.305603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:44.305603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:44.305603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:44.305603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:44.305603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:44.305603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:44.305603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:33:44.305603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:44.305603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 398/799] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jun 27 18:33:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:44.307093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964919e-4585-47ae-8071-927c815ec99a None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:44.307093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964919e-4585-47ae-8071-927c815ec99a None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:44.307093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964919e-4585-47ae-8071-927c815ec99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:44.320230 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 402/800] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:44.320230 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effacd93-5ef0-4579-9ff5-dd66b5c87267 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:44.325022 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-e964919e-4585-47ae-8071-927c815ec99a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:44.326201 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e964919e-4585-47ae-8071-927c815ec99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:44.370283 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:44.402713 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 399/801] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:33:44.403908 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964919e-4585-47ae-8071-927c815ec99a None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:44.435641 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effacd93-5ef0-4579-9ff5-dd66b5c87267 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:44.471922 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554a686-ff3d-4d1e-b79e-2c5bf1982590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:44.473069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554a686-ff3d-4d1e-b79e-2c5bf1982590 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:44.473580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554a686-ff3d-4d1e-b79e-2c5bf1982590 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:44.474115 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554a686-ff3d-4d1e-b79e-2c5bf1982590 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:44.475653 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554a686-ff3d-4d1e-b79e-2c5bf1982590 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:44.477130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554a686-ff3d-4d1e-b79e-2c5bf1982590 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:44.489946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-d554a686-ff3d-4d1e-b79e-2c5bf1982590 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 18:33:44.489946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:44.489946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:33:44.489946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:33:44.489946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:33:44.489946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:33:44.489946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:33:44.489946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:44.489946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 18:33:44.489946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:44.489946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:33:44.489946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:44.489946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:44.489946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:44.489946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:44.489946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:44.491554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:44.491554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:44.491554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:44.491554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:44.491554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:44.491554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:44.491554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:44.491554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:33:44.491554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:33:44.491554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:33:44.491554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:33:44.491554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:44.491554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:44.491554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:44.491554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:44.491554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:44.492423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:44.492423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:44.492423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:44.492423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:44.492423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:44.492423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:44.492423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:44.492423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:44.492423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:44.492423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:44.492423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:44.492423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:33:44.492423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:44.492423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 27 18:33:44.492423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:44.492423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 403/802] 10.222.0.36 () {56 vars in 1129 bytes} [Mon Jun 27 18:33:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:44.493283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554a686-ff3d-4d1e-b79e-2c5bf1982590 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:44.507380 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:44.510259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964919e-4585-47ae-8071-927c815ec99a None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:44.554578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0daa8b-22c0-4dc9-8414-e6ed1e36fb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:44.555382 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0daa8b-22c0-4dc9-8414-e6ed1e36fb61 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:44.555673 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0daa8b-22c0-4dc9-8414-e6ed1e36fb61 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:44.555946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0daa8b-22c0-4dc9-8414-e6ed1e36fb61 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:44.556780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0daa8b-22c0-4dc9-8414-e6ed1e36fb61 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:44.557090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0daa8b-22c0-4dc9-8414-e6ed1e36fb61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:44.558537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0daa8b-22c0-4dc9-8414-e6ed1e36fb61 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:44.576138 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 400/803] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jun 27 18:33:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:44.577037 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0daa8b-22c0-4dc9-8414-e6ed1e36fb61 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:44.610394 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:44.615682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554a686-ff3d-4d1e-b79e-2c5bf1982590 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:44.651103 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281076b-bb21-4892-942b-c62da84e7b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:44.651936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281076b-bb21-4892-942b-c62da84e7b48 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:44.652221 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281076b-bb21-4892-942b-c62da84e7b48 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:44.652500 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281076b-bb21-4892-942b-c62da84e7b48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:44.659565 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281076b-bb21-4892-942b-c62da84e7b48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:44.661029 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281076b-bb21-4892-942b-c62da84e7b48 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:44.675696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-0281076b-bb21-4892-942b-c62da84e7b48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:44.675696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:44.675696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:44.675696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:44.675696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:44.675696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:44.675696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:44.675696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:44.675696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:44.675696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:44.675696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:44.675696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:44.675696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:44.675696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:44.675696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:44.676600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:44.676600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:44.676600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:44.676600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:44.676600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:44.676600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:44.676600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:44.676600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:44.676600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:44.676600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:44.676600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:44.676600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:44.676600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:44.676600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:44.676600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:44.676600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:44.676600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:44.677545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:44.677545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:44.677545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:44.677545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:44.677545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:44.677545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:44.677545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:44.677545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:44.677545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 404/804] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:44.678574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281076b-bb21-4892-942b-c62da84e7b48 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:44.690029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0daa8b-22c0-4dc9-8414-e6ed1e36fb61 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:44.726805 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d581cc-c187-413c-aa30-f555086da1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:44.727624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d581cc-c187-413c-aa30-f555086da1e3 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:44.727912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d581cc-c187-413c-aa30-f555086da1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:44.728190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d581cc-c187-413c-aa30-f555086da1e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:44.738638 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d581cc-c187-413c-aa30-f555086da1e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:44.746074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:44.746823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-67d581cc-c187-413c-aa30-f555086da1e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:44.746823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:44.746823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:44.746823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:44.746823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:44.746823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:44.746823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:44.746823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:44.746823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:44.746823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:44.746823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:44.746823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:44.746823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:44.746823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:44.746823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:44.746823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:44.747790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:44.747790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:44.747790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:44.747790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:44.747790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:44.747790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:44.747790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:44.747790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:44.747790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:44.747790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:44.747790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:44.747790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:44.747790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:44.747790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:44.747790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:44.747790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:44.748674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:44.748674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:44.748674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:44.748674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:44.748674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:44.748674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:44.748674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:44.748674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:44.748674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:44.748674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:44.748674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:44.748674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:44.748674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 401/805] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:44.749377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d581cc-c187-413c-aa30-f555086da1e3 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:44.789229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281076b-bb21-4892-942b-c62da84e7b48 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:44.826856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8df38a-76c0-4278-aa39-883a6f82f52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:44.827664 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8df38a-76c0-4278-aa39-883a6f82f52f None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:44.827890 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8df38a-76c0-4278-aa39-883a6f82f52f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:44.828163 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8df38a-76c0-4278-aa39-883a6f82f52f None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:44.828867 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8df38a-76c0-4278-aa39-883a6f82f52f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:44.829172 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8df38a-76c0-4278-aa39-883a6f82f52f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:44.830539 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8df38a-76c0-4278-aa39-883a6f82f52f None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:44.839740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 405/806] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Jun 27 18:33:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:44.839740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8df38a-76c0-4278-aa39-883a6f82f52f None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:44.853162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:44.863922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d581cc-c187-413c-aa30-f555086da1e3 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:44.901046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed297aec-938f-47ed-9dad-f5258a1fa5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:44.901694 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed297aec-938f-47ed-9dad-f5258a1fa5b3 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:44.901987 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed297aec-938f-47ed-9dad-f5258a1fa5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:44.902327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed297aec-938f-47ed-9dad-f5258a1fa5b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:44.941319 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8df38a-76c0-4278-aa39-883a6f82f52f None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:44.970065 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:44.971132 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed297aec-938f-47ed-9dad-f5258a1fa5b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:44.972625 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed297aec-938f-47ed-9dad-f5258a1fa5b3 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:44.976697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801e844-cede-4200-8575-51ba94a055c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:44.977351 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801e844-cede-4200-8575-51ba94a055c1 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:44.977636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801e844-cede-4200-8575-51ba94a055c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:44.977911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801e844-cede-4200-8575-51ba94a055c1 None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:44.982543 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801e844-cede-4200-8575-51ba94a055c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:44.982543 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801e844-cede-4200-8575-51ba94a055c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:44.982543 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801e844-cede-4200-8575-51ba94a055c1 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:44.993717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 406/807] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:44.994506 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801e844-cede-4200-8575-51ba94a055c1 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:45.065331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:45.075085 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 402/808] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:33:45.075924 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed297aec-938f-47ed-9dad-f5258a1fa5b3 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:45.093284 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801e844-cede-4200-8575-51ba94a055c1 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:45.127102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d4f63-1ef9-4e56-a184-38a5e3205642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:45.127801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d4f63-1ef9-4e56-a184-38a5e3205642 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:45.128098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d4f63-1ef9-4e56-a184-38a5e3205642 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:45.128375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d4f63-1ef9-4e56-a184-38a5e3205642 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:45.129125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d4f63-1ef9-4e56-a184-38a5e3205642 None admin] RBAC: Adding query filter params (name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:45.129435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d4f63-1ef9-4e56-a184-38a5e3205642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:45.130809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d4f63-1ef9-4e56-a184-38a5e3205642 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:45.138560 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 407/809] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:45.139780 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b727eb0-2a93-4f63-bd82-c02ef4b3f7c2 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:45.140074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b727eb0-2a93-4f63-bd82-c02ef4b3f7c2 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:45.140359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b727eb0-2a93-4f63-bd82-c02ef4b3f7c2 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:45.141728 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 408/810] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:45.142250 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b727eb0-2a93-4f63-bd82-c02ef4b3f7c2 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:45.175372 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed297aec-938f-47ed-9dad-f5258a1fa5b3 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:45.199923 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:45.208865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193b38f-d31a-44c1-a7a3-11b6137ba677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:45.210141 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193b38f-d31a-44c1-a7a3-11b6137ba677 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:45.211552 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193b38f-d31a-44c1-a7a3-11b6137ba677 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:45.211552 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193b38f-d31a-44c1-a7a3-11b6137ba677 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:45.211552 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193b38f-d31a-44c1-a7a3-11b6137ba677 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:45.211772 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193b38f-d31a-44c1-a7a3-11b6137ba677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:45.213103 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4193b38f-d31a-44c1-a7a3-11b6137ba677 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:45.217939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 403/811] 10.222.0.36 () {56 vars in 1124 bytes} [Mon Jun 27 18:33:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:45.218772 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193b38f-d31a-44c1-a7a3-11b6137ba677 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:45.247339 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b727eb0-2a93-4f63-bd82-c02ef4b3f7c2 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:45.278995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:45.280370 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dec7b3-4d4f-4b55-ad6c-968471e5eeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:45.281263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dec7b3-4d4f-4b55-ad6c-968471e5eeaa None admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:45.281548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dec7b3-4d4f-4b55-ad6c-968471e5eeaa None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:45.281828 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dec7b3-4d4f-4b55-ad6c-968471e5eeaa None admin] PATH_INFO: `/v3/projects/94dba2006b6747f8badff33745bde432/users/94555ff897d94c90968c470d82ff9e2a/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:45.283856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dec7b3-4d4f-4b55-ad6c-968471e5eeaa None admin] RBAC: Authorizing `identity:create_grant(project_id=94dba2006b6747f8badff33745bde432, user_id=94555ff897d94c90968c470d82ff9e2a, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:45.285307 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dec7b3-4d4f-4b55-ad6c-968471e5eeaa None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:45.323807 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193b38f-d31a-44c1-a7a3-11b6137ba677 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:45.356724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e027a-bc20-45a4-89e0-cdc55fc3370d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:45.357506 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e027a-bc20-45a4-89e0-cdc55fc3370d None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:45.357794 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e027a-bc20-45a4-89e0-cdc55fc3370d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:45.358075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e027a-bc20-45a4-89e0-cdc55fc3370d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:45.365013 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 409/812] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:33:45 2022] PUT /identity/v3/projects/94dba2006b6747f8badff33745bde432/users/94555ff897d94c90968c470d82ff9e2a/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:33:45.366729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226dc8f4-3426-4c77-8272-372664acfd55 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:45.370640 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226dc8f4-3426-4c77-8272-372664acfd55 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:45.370640 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226dc8f4-3426-4c77-8272-372664acfd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:45.373800 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e027a-bc20-45a4-89e0-cdc55fc3370d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:45.375317 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e027a-bc20-45a4-89e0-cdc55fc3370d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:45.395349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-f12e027a-bc20-45a4-89e0-cdc55fc3370d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:45.395349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:45.395349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:45.395349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:45.395349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:45.395349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:45.395349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:45.395349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:45.395349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:45.395349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:45.395349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:45.395349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:45.395349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:45.395349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:45.395349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:45.400410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:45.400410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:45.400410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:45.400410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:45.400410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:45.400410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:45.400410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:45.400410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:45.400410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:45.400410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:45.400410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:45.400410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:45.400410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:45.400410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:45.400410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:45.400410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:45.400410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:45.401367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:45.401367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:45.401367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:45.401367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:45.401367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 404/813] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:45.401367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e027a-bc20-45a4-89e0-cdc55fc3370d None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:45.401722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-226dc8f4-3426-4c77-8272-372664acfd55 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:45.401722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-226dc8f4-3426-4c77-8272-372664acfd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:45.487568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 410/814] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:33:45.487568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226dc8f4-3426-4c77-8272-372664acfd55 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:45.532920 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e027a-bc20-45a4-89e0-cdc55fc3370d None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:45.541097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:45.548758 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:45.568386 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1490f7-91b0-455a-9824-14166fbaccd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:45.569744 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1490f7-91b0-455a-9824-14166fbaccd9 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:45.570036 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1490f7-91b0-455a-9824-14166fbaccd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:45.570325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1490f7-91b0-455a-9824-14166fbaccd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:45.582272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1490f7-91b0-455a-9824-14166fbaccd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:45.583252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1490f7-91b0-455a-9824-14166fbaccd9 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:45.601651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-ad1490f7-91b0-455a-9824-14166fbaccd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:45.601651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:45.601651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:45.601651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:45.601651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:45.601651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:45.601651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:45.601651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:45.601651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:45.601651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:45.601651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:45.601651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:45.601651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:45.601651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:45.601651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:45.608661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:45.608661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:45.608661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:45.608661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:45.608661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:45.608661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:45.608661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:45.608661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:45.608661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:45.608661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:45.608661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:45.608661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:45.608661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:45.608661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:45.608661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:45.608661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:45.608661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:45.609793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:45.609793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:45.609793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:45.609793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:45.609793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 405/815] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:45.609793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1490f7-91b0-455a-9824-14166fbaccd9 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:45.619952 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226dc8f4-3426-4c77-8272-372664acfd55 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:45.656201 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317573c-7824-41db-a9d4-07d68f252065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:45.657167 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317573c-7824-41db-a9d4-07d68f252065 None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:45.657451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317573c-7824-41db-a9d4-07d68f252065 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:45.657727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317573c-7824-41db-a9d4-07d68f252065 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:45.658460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317573c-7824-41db-a9d4-07d68f252065 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:45.659859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317573c-7824-41db-a9d4-07d68f252065 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:45.710857 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1490f7-91b0-455a-9824-14166fbaccd9 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:45.744115 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 411/816] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jun 27 18:33:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:33:45.745335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317573c-7824-41db-a9d4-07d68f252065 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:45.761636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b491766-c795-4383-b36a-18b96f708b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:45.762332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b491766-c795-4383-b36a-18b96f708b34 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:45.762625 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b491766-c795-4383-b36a-18b96f708b34 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:45.763356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b491766-c795-4383-b36a-18b96f708b34 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:45.764461 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b491766-c795-4383-b36a-18b96f708b34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:45.764784 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b491766-c795-4383-b36a-18b96f708b34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:45.767123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b491766-c795-4383-b36a-18b96f708b34 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:45.785298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 406/817] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:45.786508 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b491766-c795-4383-b36a-18b96f708b34 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:45.827879 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:45.871942 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:45.875399 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317573c-7824-41db-a9d4-07d68f252065 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:45.920491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2a47f-9dbb-4c15-a6fb-bacde4e014c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:45.921296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2a47f-9dbb-4c15-a6fb-bacde4e014c1 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:45.921583 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2a47f-9dbb-4c15-a6fb-bacde4e014c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:45.921862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2a47f-9dbb-4c15-a6fb-bacde4e014c1 None admin] PATH_INFO: `/v3/services/network` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:45.922521 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2a47f-9dbb-4c15-a6fb-bacde4e014c1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:45.923975 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2a47f-9dbb-4c15-a6fb-bacde4e014c1 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:45.936154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b491766-c795-4383-b36a-18b96f708b34 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:45.943151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-b5d2a47f-9dbb-4c15-a6fb-bacde4e014c1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 18:33:45.943151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:45.943151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:33:45.943151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:33:45.943151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:33:45.943151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:33:45.943151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:33:45.943151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:45.943151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 18:33:45.943151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:45.943151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:33:45.943151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:45.943151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:45.943151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:45.943151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:45.943151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:45.943151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:45.944246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:45.944246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:45.944246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:45.944246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:45.944246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:45.944246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:45.944246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:33:45.944246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:33:45.944246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:33:45.944246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:33:45.944246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:45.944246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:45.944246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:45.944246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:45.944246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:45.944246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:45.945104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:45.945104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:45.945104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:45.945104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:45.945104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:45.945104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:45.945104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:45.945104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:45.945104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:45.945104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:45.945104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:33:45.945104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:45.945104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 27 18:33:45.945104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:45.945884 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 412/818] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:45 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:45.946991 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2a47f-9dbb-4c15-a6fb-bacde4e014c1 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:45.980958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e7aca-bef8-438a-8681-b201605dcfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:45.982246 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e7aca-bef8-438a-8681-b201605dcfa1 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:45.982747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e7aca-bef8-438a-8681-b201605dcfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:45.983219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8e7aca-bef8-438a-8681-b201605dcfa1 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:45.984161 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e7aca-bef8-438a-8681-b201605dcfa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:45.984665 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e7aca-bef8-438a-8681-b201605dcfa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:45.986314 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8e7aca-bef8-438a-8681-b201605dcfa1 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:45.999151 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 407/819] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:46.004451 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e7aca-bef8-438a-8681-b201605dcfa1 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:46.069253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2a47f-9dbb-4c15-a6fb-bacde4e014c1 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:46.110188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5a441-6a8d-4960-9edb-9a62698be594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:46.111055 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a441-6a8d-4960-9edb-9a62698be594 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:46.111344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a441-6a8d-4960-9edb-9a62698be594 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:46.111652 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5a441-6a8d-4960-9edb-9a62698be594 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:46.119435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5a441-6a8d-4960-9edb-9a62698be594 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:46.120928 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5a441-6a8d-4960-9edb-9a62698be594 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:46.137102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-c1b5a441-6a8d-4960-9edb-9a62698be594 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:46.137102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:46.137102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:46.137102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:46.137102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:46.137102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:46.137102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:46.137102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:46.137102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:46.137102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:46.137102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:46.137102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:46.137102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:46.137102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:46.137102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:46.138033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:46.138033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:46.138033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:46.138033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:46.138033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:46.138033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:46.138033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:46.138033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:46.138033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:46.138033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:46.138033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:46.138033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:46.138033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:46.138033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:46.138033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:46.138033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:46.138033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:46.139022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:46.139022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:46.139022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:46.139022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:46.139022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:46.139022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:46.139022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:46.139022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:46.139022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 413/820] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:46.139507 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5a441-6a8d-4960-9edb-9a62698be594 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:46.168148 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:46.202933 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:46.233366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8e7aca-bef8-438a-8681-b201605dcfa1 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:46.257192 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5a441-6a8d-4960-9edb-9a62698be594 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:46.272377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2cb18-54d7-4f61-9aa3-d51e3b79f14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:46.273197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2cb18-54d7-4f61-9aa3-d51e3b79f14a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:46.273751 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2cb18-54d7-4f61-9aa3-d51e3b79f14a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:46.274071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2cb18-54d7-4f61-9aa3-d51e3b79f14a None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:46.274876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2cb18-54d7-4f61-9aa3-d51e3b79f14a None admin] RBAC: Adding query filter params (name=network) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:46.275284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2cb18-54d7-4f61-9aa3-d51e3b79f14a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:46.276892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca2cb18-54d7-4f61-9aa3-d51e3b79f14a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:46.286108 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 408/821] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jun 27 18:33:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:46.286108 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2cb18-54d7-4f61-9aa3-d51e3b79f14a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:46.316324 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3dc2ae-b2e9-467c-ac73-18619d3f6354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:46.317411 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3dc2ae-b2e9-467c-ac73-18619d3f6354 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:46.317844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3dc2ae-b2e9-467c-ac73-18619d3f6354 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:46.318266 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3dc2ae-b2e9-467c-ac73-18619d3f6354 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:46.333054 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3dc2ae-b2e9-467c-ac73-18619d3f6354 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:46.334937 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3dc2ae-b2e9-467c-ac73-18619d3f6354 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:46.354182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-ab3dc2ae-b2e9-467c-ac73-18619d3f6354 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 18:33:46.354182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:46.354182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:46.354182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:46.354182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:46.354182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:46.354182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:46.354182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:46.354182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:46.354182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:46.354182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:46.354182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:46.354182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:46.354182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:46.354182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:46.354182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:46.355342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:46.356795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:46.356795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:46.356795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:46.356795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:46.356795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:46.356795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:46.356795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:46.356795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:46.356795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 18:33:46.356795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:46.364162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 414/822] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jun 27 18:33:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:46.365116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3dc2ae-b2e9-467c-ac73-18619d3f6354 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:46.395837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca2cb18-54d7-4f61-9aa3-d51e3b79f14a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:46.430397 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c4bc9-1346-40cc-af60-5bc6c8268849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:46.431348 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c4bc9-1346-40cc-af60-5bc6c8268849 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:46.431960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c4bc9-1346-40cc-af60-5bc6c8268849 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:46.432436 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c4bc9-1346-40cc-af60-5bc6c8268849 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:46.433416 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c4bc9-1346-40cc-af60-5bc6c8268849 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:46.433957 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c4bc9-1346-40cc-af60-5bc6c8268849 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:46.435620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c4bc9-1346-40cc-af60-5bc6c8268849 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:46.448274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 409/823] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:46.448581 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:46.460128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c4bc9-1346-40cc-af60-5bc6c8268849 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:46.473899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:46.500738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3dc2ae-b2e9-467c-ac73-18619d3f6354 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:46.549125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c37d2-8fc0-48e6-8232-581cbe0d9b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:46.549856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c37d2-8fc0-48e6-8232-581cbe0d9b1b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:46.550144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c37d2-8fc0-48e6-8232-581cbe0d9b1b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:46.550426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c37d2-8fc0-48e6-8232-581cbe0d9b1b None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:46.551190 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c37d2-8fc0-48e6-8232-581cbe0d9b1b None admin] RBAC: Adding query filter params (type=network) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:46.551509 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c37d2-8fc0-48e6-8232-581cbe0d9b1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:46.553483 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c37d2-8fc0-48e6-8232-581cbe0d9b1b None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:46.564621 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 415/824] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jun 27 18:33:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:46.564621 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c37d2-8fc0-48e6-8232-581cbe0d9b1b None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:46.571238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c4bc9-1346-40cc-af60-5bc6c8268849 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:46.607330 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dd07f-441e-42c3-afd9-bd934a6ce6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:46.608347 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dd07f-441e-42c3-afd9-bd934a6ce6f0 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:46.608821 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dd07f-441e-42c3-afd9-bd934a6ce6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:46.609310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dd07f-441e-42c3-afd9-bd934a6ce6f0 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:46.610315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0dd07f-441e-42c3-afd9-bd934a6ce6f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:46.610800 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0dd07f-441e-42c3-afd9-bd934a6ce6f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:46.612434 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0dd07f-441e-42c3-afd9-bd934a6ce6f0 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:46.634776 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 410/825] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Jun 27 18:33:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:46.636025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dd07f-441e-42c3-afd9-bd934a6ce6f0 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:46.691648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c37d2-8fc0-48e6-8232-581cbe0d9b1b None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:46.696248 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:46.751936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aaadf1-57c5-4a8a-8696-d7537c066fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:46.751936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aaadf1-57c5-4a8a-8696-d7537c066fa1 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:46.751936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aaadf1-57c5-4a8a-8696-d7537c066fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:46.751936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aaadf1-57c5-4a8a-8696-d7537c066fa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:46.752773 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aaadf1-57c5-4a8a-8696-d7537c066fa1 None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=da1746d29f9e4e8b8626ad4b11931cbd) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:46.752773 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aaadf1-57c5-4a8a-8696-d7537c066fa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:46.752773 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aaadf1-57c5-4a8a-8696-d7537c066fa1 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:46.752982 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dd07f-441e-42c3-afd9-bd934a6ce6f0 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:46.753391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 416/826] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:33:46 2022] GET /identity/v3/role_assignments?user.id=da1746d29f9e4e8b8626ad4b11931cbd&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=b156409c977248e1b23c26e589b1e04f => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:46.754532 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aaadf1-57c5-4a8a-8696-d7537c066fa1 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:46.788081 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:46.800814 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41697cb5-ceda-45b0-b4aa-ec3a58a64ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:46.804410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41697cb5-ceda-45b0-b4aa-ec3a58a64ef1 None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:46.804410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41697cb5-ceda-45b0-b4aa-ec3a58a64ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:46.804410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41697cb5-ceda-45b0-b4aa-ec3a58a64ef1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:46.804708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41697cb5-ceda-45b0-b4aa-ec3a58a64ef1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:46.806085 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41697cb5-ceda-45b0-b4aa-ec3a58a64ef1 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:46.900539 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 411/827] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jun 27 18:33:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:33:46.928732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aaadf1-57c5-4a8a-8696-d7537c066fa1 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:46.977324 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a195587-579d-42f1-9525-1ba583b21bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:46.978040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a195587-579d-42f1-9525-1ba583b21bb0 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:46.978321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a195587-579d-42f1-9525-1ba583b21bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:46.978597 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a195587-579d-42f1-9525-1ba583b21bb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:46.990809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a195587-579d-42f1-9525-1ba583b21bb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:46.992335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a195587-579d-42f1-9525-1ba583b21bb0 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:47.012283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-0a195587-579d-42f1-9525-1ba583b21bb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:47.012283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:47.012283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:47.012283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:47.012283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:47.012283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:47.012283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:47.012283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:47.012283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:47.012283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:47.012283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:47.012283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:47.012283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:47.012283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:47.012283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:47.013263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:47.013263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:47.013263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:47.013263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:47.013263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:47.013263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:47.013263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:47.013263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:47.013263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:47.013263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:47.013263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:47.013263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:47.013263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:47.013263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:47.013263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:47.013263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:47.013263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:47.014500 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:47.014500 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:47.014500 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:47.014500 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:47.014500 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 417/828] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:47.019747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41697cb5-ceda-45b0-b4aa-ec3a58a64ef1 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:47.139472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41697cb5-ceda-45b0-b4aa-ec3a58a64ef1 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:47.156508 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:47.179185 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab66423-32ae-4f4e-aa85-9457164f13ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:47.179903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab66423-32ae-4f4e-aa85-9457164f13ce None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:47.180165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab66423-32ae-4f4e-aa85-9457164f13ce None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:47.180441 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab66423-32ae-4f4e-aa85-9457164f13ce None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:47.181182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab66423-32ae-4f4e-aa85-9457164f13ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:47.181482 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab66423-32ae-4f4e-aa85-9457164f13ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:47.182842 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab66423-32ae-4f4e-aa85-9457164f13ce None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:47.196166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 412/829] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:47.201542 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a195587-579d-42f1-9525-1ba583b21bb0 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:47.267304 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:47.313421 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a195587-579d-42f1-9525-1ba583b21bb0 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:47.348637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26fed3a-8018-4a38-987c-b62b3908de86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:47.349450 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fed3a-8018-4a38-987c-b62b3908de86 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:47.350258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fed3a-8018-4a38-987c-b62b3908de86 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:47.350539 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26fed3a-8018-4a38-987c-b62b3908de86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:47.357821 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fed3a-8018-4a38-987c-b62b3908de86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:47.359284 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26fed3a-8018-4a38-987c-b62b3908de86 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:47.373813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-d26fed3a-8018-4a38-987c-b62b3908de86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:47.373813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:47.373813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:47.373813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:47.373813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:47.373813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:47.373813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:47.373813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:47.373813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:47.373813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:47.373813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:47.373813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:47.373813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:47.373813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:47.373813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:47.374759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:47.374759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:47.374759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:47.374759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:47.374759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:47.374759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:47.374759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:47.374759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:47.374759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:47.374759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:47.374759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:47.374759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:47.374759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:47.374759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:47.374759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:47.374759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:47.374759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:47.376198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:47.376198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:47.376198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:47.376198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:47.376198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:47.376198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:47.376198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:47.376198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:47.376198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 418/830] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:47.381195 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab66423-32ae-4f4e-aa85-9457164f13ce None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:47.480371 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d8f53-a302-43c7-bb2e-b500fc532740 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:47.480704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d8f53-a302-43c7-bb2e-b500fc532740 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:47.481187 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d8f53-a302-43c7-bb2e-b500fc532740 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:47.482937 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 419/831] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:33:47.487922 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69726baa-9e10-437b-9d76-cf96f7341be7 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:47.488135 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69726baa-9e10-437b-9d76-cf96f7341be7 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:47.488413 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69726baa-9e10-437b-9d76-cf96f7341be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:47.498690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab66423-32ae-4f4e-aa85-9457164f13ce None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:47.506206 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-69726baa-9e10-437b-9d76-cf96f7341be7 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:47.507502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-69726baa-9e10-437b-9d76-cf96f7341be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:47.536176 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062edc42-ce67-4966-8649-f8c34d5ceba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:47.536991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062edc42-ce67-4966-8649-f8c34d5ceba0 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:47.537831 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062edc42-ce67-4966-8649-f8c34d5ceba0 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:47.538113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062edc42-ce67-4966-8649-f8c34d5ceba0 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:47.539023 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062edc42-ce67-4966-8649-f8c34d5ceba0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:47.539334 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062edc42-ce67-4966-8649-f8c34d5ceba0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:47.540870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062edc42-ce67-4966-8649-f8c34d5ceba0 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:47.554194 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 413/832] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:47.564689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062edc42-ce67-4966-8649-f8c34d5ceba0 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:47.604287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 420/833] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:33:47.609595 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:47.623037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69726baa-9e10-437b-9d76-cf96f7341be7 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:47.676018 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:47.686289 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062edc42-ce67-4966-8649-f8c34d5ceba0 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:47.722002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5d4bc-a1ef-4653-82f1-2408cf488cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:47.722990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5d4bc-a1ef-4653-82f1-2408cf488cfb None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:47.723342 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5d4bc-a1ef-4653-82f1-2408cf488cfb None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:47.723707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5d4bc-a1ef-4653-82f1-2408cf488cfb None admin] PATH_INFO: `/v3/projects/94dba2006b6747f8badff33745bde432/users/6e6313c444eb4a788b6559eff17959f8/roles/62fd6b166d1847b19e812160b459d5db` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:47.729059 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69726baa-9e10-437b-9d76-cf96f7341be7 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:47.740097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5d4bc-a1ef-4653-82f1-2408cf488cfb None admin] RBAC: Authorizing `identity:create_grant(project_id=94dba2006b6747f8badff33745bde432, user_id=6e6313c444eb4a788b6559eff17959f8, role_id=62fd6b166d1847b19e812160b459d5db)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:47.741759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5d4bc-a1ef-4653-82f1-2408cf488cfb None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:47.764299 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069a243-61e4-4478-b94f-eb43a08d13b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:47.765091 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069a243-61e4-4478-b94f-eb43a08d13b7 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:47.765375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069a243-61e4-4478-b94f-eb43a08d13b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:47.765656 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069a243-61e4-4478-b94f-eb43a08d13b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:47.777678 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069a243-61e4-4478-b94f-eb43a08d13b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:47.786470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-5069a243-61e4-4478-b94f-eb43a08d13b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:33:47.786470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:47.786470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:47.786470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:47.786470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:47.786470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:47.786470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:47.786470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:47.786470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:47.786470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:47.786470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:47.786470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:47.786470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:47.786470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:47.786470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:47.786470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:47.788546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:47.788546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:47.788546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:47.788546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:47.788546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:47.788546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:47.788546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:47.788546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:47.788546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:47.788546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:47.788546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:47.788546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:47.788546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:47.788546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:47.788546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:47.788546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:47.789407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:47.789407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:47.789407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:47.789407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:47.789407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:47.789407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:47.789407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:47.789407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:47.789407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:47.789407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:47.789407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:33:47.789407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:47.789407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 421/834] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:33:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:47.792789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069a243-61e4-4478-b94f-eb43a08d13b7 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:47.819728 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 414/835] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:33:47 2022] PUT /identity/v3/projects/94dba2006b6747f8badff33745bde432/users/6e6313c444eb4a788b6559eff17959f8/roles/62fd6b166d1847b19e812160b459d5db => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:33:47.882963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca597f-74c4-4a3e-a982-769d224de879 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:47.883804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca597f-74c4-4a3e-a982-769d224de879 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:47.884309 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca597f-74c4-4a3e-a982-769d224de879 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:47.886407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 415/836] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:47.893399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db01d98-772d-4873-844e-269104c6d2d8 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:47.894145 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db01d98-772d-4873-844e-269104c6d2d8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:47.894697 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db01d98-772d-4873-844e-269104c6d2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:47.911894 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069a243-61e4-4478-b94f-eb43a08d13b7 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:47.914989 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-1db01d98-772d-4873-844e-269104c6d2d8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:47.916517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-1db01d98-772d-4873-844e-269104c6d2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:47.924207 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:47.949650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb704db-34d3-4aa5-97c9-3ce9ef807a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:47.950337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb704db-34d3-4aa5-97c9-3ce9ef807a51 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:47.950678 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb704db-34d3-4aa5-97c9-3ce9ef807a51 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:47.950960 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb704db-34d3-4aa5-97c9-3ce9ef807a51 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:47.951795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb704db-34d3-4aa5-97c9-3ce9ef807a51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:47.952109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb704db-34d3-4aa5-97c9-3ce9ef807a51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:47.953544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb704db-34d3-4aa5-97c9-3ce9ef807a51 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:47.967140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 422/837] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:33:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:47.969441 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb704db-34d3-4aa5-97c9-3ce9ef807a51 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:48.004594 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 416/838] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:33:48.033451 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db01d98-772d-4873-844e-269104c6d2d8 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:48.050332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:48.145026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db01d98-772d-4873-844e-269104c6d2d8 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:48.183140 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370724c-b36c-4267-876b-c4c29c221ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:48.184376 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370724c-b36c-4267-876b-c4c29c221ce4 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:48.184844 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370724c-b36c-4267-876b-c4c29c221ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:48.185301 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370724c-b36c-4267-876b-c4c29c221ce4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:48.186230 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370724c-b36c-4267-876b-c4c29c221ce4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:48.188055 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370724c-b36c-4267-876b-c4c29c221ce4 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:48.196574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb704db-34d3-4aa5-97c9-3ce9ef807a51 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:48.201290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-8370724c-b36c-4267-876b-c4c29c221ce4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 18:33:48.201290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:48.201290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:33:48.201290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:33:48.201290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:33:48.201290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:33:48.201290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:33:48.201290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:48.201290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 18:33:48.201290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:48.201290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:33:48.201290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:48.201290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:48.201290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:48.201290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:48.201290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:48.201290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:48.202345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:48.202345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:48.202345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:48.202345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:48.202345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:48.202345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:48.202345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:33:48.202345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:33:48.202345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:33:48.202345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:33:48.202345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:48.202345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:48.202345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:48.202345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:48.202345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:48.202345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:48.203197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:48.203197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:48.203197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:48.203197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:48.203197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:48.203197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:48.203197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:48.203197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:48.203197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:48.203197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:48.203197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:33:48.203197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:48.203197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 18:33:48.203197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:48.205783 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 417/839] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:33:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:48.214006 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370724c-b36c-4267-876b-c4c29c221ce4 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:48.233805 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95214832-9828-4bc3-959f-a00bf7d153d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:48.234660 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95214832-9828-4bc3-959f-a00bf7d153d3 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:48.235046 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95214832-9828-4bc3-959f-a00bf7d153d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:48.235330 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95214832-9828-4bc3-959f-a00bf7d153d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:48.248452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95214832-9828-4bc3-959f-a00bf7d153d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:48.250043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95214832-9828-4bc3-959f-a00bf7d153d3 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:48.268432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-95214832-9828-4bc3-959f-a00bf7d153d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:48.268432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:48.268432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:48.268432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:48.268432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:48.268432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:48.268432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:48.268432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:48.268432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:48.268432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:48.268432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:48.268432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:48.268432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:48.268432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:48.268432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:48.269393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:48.269393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:48.269393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:48.269393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:48.269393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:48.269393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:48.269393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:48.269393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:48.269393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:48.269393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:48.269393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:48.269393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:48.269393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:48.269393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:48.269393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:48.269393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:48.269393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:48.270305 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:48.270305 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:48.270305 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:48.270305 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:48.270305 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 423/840] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:48.275837 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95214832-9828-4bc3-959f-a00bf7d153d3 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:48.303313 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:48.308643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:48.336576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370724c-b36c-4267-876b-c4c29c221ce4 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:48.371723 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee66dd7-07e5-44bf-8f86-e203e3f9c437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:48.372515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee66dd7-07e5-44bf-8f86-e203e3f9c437 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:48.372873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee66dd7-07e5-44bf-8f86-e203e3f9c437 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:48.373225 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee66dd7-07e5-44bf-8f86-e203e3f9c437 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:48.374015 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee66dd7-07e5-44bf-8f86-e203e3f9c437 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:48.374397 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee66dd7-07e5-44bf-8f86-e203e3f9c437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:48.375925 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee66dd7-07e5-44bf-8f86-e203e3f9c437 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:48.386061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 418/841] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:33:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:48.388369 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee66dd7-07e5-44bf-8f86-e203e3f9c437 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:48.394334 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95214832-9828-4bc3-959f-a00bf7d153d3 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:48.441452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda783-187f-436f-80e5-d84e2495f961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:48.442561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda783-187f-436f-80e5-d84e2495f961 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:48.442561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda783-187f-436f-80e5-d84e2495f961 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:48.443005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bda783-187f-436f-80e5-d84e2495f961 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:48.444405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bda783-187f-436f-80e5-d84e2495f961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:48.444820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bda783-187f-436f-80e5-d84e2495f961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:48.446294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bda783-187f-436f-80e5-d84e2495f961 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:48.458341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 424/842] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:48.463784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda783-187f-436f-80e5-d84e2495f961 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:48.522274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee66dd7-07e5-44bf-8f86-e203e3f9c437 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:48.571159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9994365-d969-47e2-b0db-f93a48cbb808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:48.572671 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9994365-d969-47e2-b0db-f93a48cbb808 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:48.573141 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9994365-d969-47e2-b0db-f93a48cbb808 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:48.573607 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9994365-d969-47e2-b0db-f93a48cbb808 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:48.574939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9994365-d969-47e2-b0db-f93a48cbb808 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:48.575427 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9994365-d969-47e2-b0db-f93a48cbb808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:48.577684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9994365-d969-47e2-b0db-f93a48cbb808 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:48.583257 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:48.592188 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 419/843] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:33:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:48.605008 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bda783-187f-436f-80e5-d84e2495f961 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:48.642971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b52795-c869-4705-b400-3c6cd6ed55ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:48.643809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b52795-c869-4705-b400-3c6cd6ed55ee None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:48.644160 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b52795-c869-4705-b400-3c6cd6ed55ee None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:48.644442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b52795-c869-4705-b400-3c6cd6ed55ee None admin] PATH_INFO: `/v3/users/swift` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:48.652841 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b52795-c869-4705-b400-3c6cd6ed55ee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:48.654393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b52795-c869-4705-b400-3c6cd6ed55ee None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:48.671849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-b0b52795-c869-4705-b400-3c6cd6ed55ee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 27 18:33:48.671849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:48.671849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:48.671849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:48.671849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:48.671849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:48.671849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:48.671849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:48.671849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:48.671849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:48.671849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:48.671849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:48.671849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:48.671849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:48.671849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:48.671849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:48.672911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:48.674765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:48.674765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:48.674765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:48.674765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:48.674765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:48.674765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:48.674765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:48.674765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:48.674765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 27 18:33:48.674765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:48.674765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 425/844] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:33:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:48.679437 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9994365-d969-47e2-b0db-f93a48cbb808 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:48.683895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:48.788958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9994365-d969-47e2-b0db-f93a48cbb808 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:48.824484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a808c48-0159-4e99-98ac-a2d9ac00b088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:48.825052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a808c48-0159-4e99-98ac-a2d9ac00b088 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:48.825334 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a808c48-0159-4e99-98ac-a2d9ac00b088 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:48.825611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a808c48-0159-4e99-98ac-a2d9ac00b088 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:48.826532 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a808c48-0159-4e99-98ac-a2d9ac00b088 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:48.826845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a808c48-0159-4e99-98ac-a2d9ac00b088 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:48.828318 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a808c48-0159-4e99-98ac-a2d9ac00b088 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:48.846659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 420/845] 10.222.0.36 () {56 vars in 1135 bytes} [Mon Jun 27 18:33:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:48.852670 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b52795-c869-4705-b400-3c6cd6ed55ee None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:48.958197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b52795-c869-4705-b400-3c6cd6ed55ee None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:48.995602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199feeef-5444-47a4-8307-f8c564869c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:48.996392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199feeef-5444-47a4-8307-f8c564869c2b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:48.996679 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199feeef-5444-47a4-8307-f8c564869c2b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:48.996955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199feeef-5444-47a4-8307-f8c564869c2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:49.012221 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:49.069354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199feeef-5444-47a4-8307-f8c564869c2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:49.070796 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199feeef-5444-47a4-8307-f8c564869c2b None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:49.172150 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 426/846] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:33:49.180635 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a808c48-0159-4e99-98ac-a2d9ac00b088 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:49.242449 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:49.245027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5297789-89f1-46c2-92f4-4ae0cb9e72c6 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:49.245318 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5297789-89f1-46c2-92f4-4ae0cb9e72c6 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:49.245592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5297789-89f1-46c2-92f4-4ae0cb9e72c6 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:49.247080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 427/847] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:33:49.254097 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bd3f1-07ed-44c4-896e-554c3f4d57ab None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:49.254682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bd3f1-07ed-44c4-896e-554c3f4d57ab None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:49.255165 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bd3f1-07ed-44c4-896e-554c3f4d57ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:49.274455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-bd6bd3f1-07ed-44c4-896e-554c3f4d57ab None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:49.275682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-bd6bd3f1-07ed-44c4-896e-554c3f4d57ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:49.288135 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a808c48-0159-4e99-98ac-a2d9ac00b088 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:49.328052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a1fa0-25b6-4516-876e-0cc89bc00018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:49.328499 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:49.328847 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1fa0-25b6-4516-876e-0cc89bc00018 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:49.329134 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1fa0-25b6-4516-876e-0cc89bc00018 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:49.329414 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a1fa0-25b6-4516-876e-0cc89bc00018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:49.341361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a1fa0-25b6-4516-876e-0cc89bc00018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:49.343022 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a1fa0-25b6-4516-876e-0cc89bc00018 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:49.362849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-e75a1fa0-25b6-4516-876e-0cc89bc00018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:49.362849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:49.362849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:49.362849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:49.362849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:49.362849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:49.362849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:49.362849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:49.362849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:49.362849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:49.362849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:49.362849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:49.362849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:49.362849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:49.362849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:49.364054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:49.364054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:49.364054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:49.364054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:49.364054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:49.364054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:49.364054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:49.364054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:49.364054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:49.364054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:49.364054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:49.364054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:49.364054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:49.364054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:49.364054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:49.364054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:49.364054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:49.365667 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:49.365667 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:49.365667 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:49.365667 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:49.365667 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 421/848] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:49.366242 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 428/849] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:33:49.372446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a1fa0-25b6-4516-876e-0cc89bc00018 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:49.390235 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bd3f1-07ed-44c4-896e-554c3f4d57ab None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:49.475683 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a1fa0-25b6-4516-876e-0cc89bc00018 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:49.487844 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:49.508207 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cc67e-8ea4-43d8-8ef9-72ace7c37cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:49.512147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cc67e-8ea4-43d8-8ef9-72ace7c37cc4 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:49.512147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cc67e-8ea4-43d8-8ef9-72ace7c37cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:49.512147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cc67e-8ea4-43d8-8ef9-72ace7c37cc4 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:49.512147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cc67e-8ea4-43d8-8ef9-72ace7c37cc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:49.512147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cc67e-8ea4-43d8-8ef9-72ace7c37cc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:49.512147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cc67e-8ea4-43d8-8ef9-72ace7c37cc4 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:49.530885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bd3f1-07ed-44c4-896e-554c3f4d57ab None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:49.531888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 422/850] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:49.536856 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cc67e-8ea4-43d8-8ef9-72ace7c37cc4 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:49.572407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bea7df-d7a5-4925-9c2d-70e10accb210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:49.573580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bea7df-d7a5-4925-9c2d-70e10accb210 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:49.573868 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bea7df-d7a5-4925-9c2d-70e10accb210 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:49.574142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bea7df-d7a5-4925-9c2d-70e10accb210 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:49.575072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bea7df-d7a5-4925-9c2d-70e10accb210 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:49.576633 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bea7df-d7a5-4925-9c2d-70e10accb210 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:49.591710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-40bea7df-d7a5-4925-9c2d-70e10accb210 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 18:33:49.591710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:49.591710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:33:49.591710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:33:49.591710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:33:49.591710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:33:49.591710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:33:49.591710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:49.591710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 18:33:49.591710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:49.591710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:33:49.591710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:49.591710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:49.591710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:49.591710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:49.591710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:49.592702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:49.592702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:49.592702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:49.592702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:49.592702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:49.592702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:49.592702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:49.592702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:33:49.592702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:33:49.592702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:33:49.592702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:33:49.592702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:49.592702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:49.592702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:49.592702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:49.592702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:49.593843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:49.593843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:49.593843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:49.593843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:49.593843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:49.593843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:49.593843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:49.593843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:49.593843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:49.593843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:49.593843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:49.593843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:33:49.593843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:49.593843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 18:33:49.593843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:49.593843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 429/851] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Jun 27 18:33:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:49.598618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bea7df-d7a5-4925-9c2d-70e10accb210 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:49.644839 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:49.664713 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cc67e-8ea4-43d8-8ef9-72ace7c37cc4 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:49.701955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111053b-3cc6-412d-aadc-c59ffd007a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:49.703087 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111053b-3cc6-412d-aadc-c59ffd007a40 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:49.703731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111053b-3cc6-412d-aadc-c59ffd007a40 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:49.704158 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111053b-3cc6-412d-aadc-c59ffd007a40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:49.711517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111053b-3cc6-412d-aadc-c59ffd007a40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:49.713131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111053b-3cc6-412d-aadc-c59ffd007a40 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:49.713752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bea7df-d7a5-4925-9c2d-70e10accb210 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:49.728761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-7111053b-3cc6-412d-aadc-c59ffd007a40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:49.728761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:49.728761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:49.728761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:49.728761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:49.728761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:49.728761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:49.728761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:49.728761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:49.728761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:49.728761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:49.728761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:49.728761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:49.728761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:49.728761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:49.729829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:49.729829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:49.729829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:49.729829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:49.729829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:49.729829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:49.729829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:49.729829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:49.729829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:49.729829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:49.729829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:49.729829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:49.729829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:49.729829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:49.729829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:49.729829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:49.729829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:49.730749 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:49.730749 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:49.730749 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:49.730749 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:49.730749 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:49.730749 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:49.730749 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:49.730749 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:49.733520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 423/852] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:49.738832 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111053b-3cc6-412d-aadc-c59ffd007a40 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:49.753284 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e555429-3d7a-49a3-a11f-714a45be0385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:49.754089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e555429-3d7a-49a3-a11f-714a45be0385 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:49.754446 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e555429-3d7a-49a3-a11f-714a45be0385 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:49.754852 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e555429-3d7a-49a3-a11f-714a45be0385 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:49.755629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e555429-3d7a-49a3-a11f-714a45be0385 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:49.756112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e555429-3d7a-49a3-a11f-714a45be0385 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:49.757997 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e555429-3d7a-49a3-a11f-714a45be0385 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:49.763564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 430/853] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jun 27 18:33:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:49.768836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e555429-3d7a-49a3-a11f-714a45be0385 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:49.783586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:49.858665 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111053b-3cc6-412d-aadc-c59ffd007a40 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:49.888529 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e555429-3d7a-49a3-a11f-714a45be0385 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:49.891035 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:49.895019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375e93b-7a37-484a-aff8-6e5bbf9ffd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:49.895733 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375e93b-7a37-484a-aff8-6e5bbf9ffd1b None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:49.896050 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375e93b-7a37-484a-aff8-6e5bbf9ffd1b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:49.896838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375e93b-7a37-484a-aff8-6e5bbf9ffd1b None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:49.897627 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375e93b-7a37-484a-aff8-6e5bbf9ffd1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:49.897941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375e93b-7a37-484a-aff8-6e5bbf9ffd1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:49.899665 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375e93b-7a37-484a-aff8-6e5bbf9ffd1b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:49.912636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 424/854] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:49.921698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375e93b-7a37-484a-aff8-6e5bbf9ffd1b None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:49.932125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7492684a-e58f-4625-888a-0524e552206f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:49.932878 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492684a-e58f-4625-888a-0524e552206f None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:49.933234 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492684a-e58f-4625-888a-0524e552206f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:49.933588 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7492684a-e58f-4625-888a-0524e552206f None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:49.934375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492684a-e58f-4625-888a-0524e552206f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:49.934915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492684a-e58f-4625-888a-0524e552206f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:49.936552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7492684a-e58f-4625-888a-0524e552206f None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:49.942058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 431/855] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jun 27 18:33:49 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:49.985493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb8ce4-dfae-4029-b21d-8bf2fb7493f8 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:49.985741 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb8ce4-dfae-4029-b21d-8bf2fb7493f8 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:49.985978 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb8ce4-dfae-4029-b21d-8bf2fb7493f8 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:49.987658 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 432/856] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:33:49.993343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337d9f6-5608-4ef3-9d54-8e2709e58911 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:49.993538 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337d9f6-5608-4ef3-9d54-8e2709e58911 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:49.993789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337d9f6-5608-4ef3-9d54-8e2709e58911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:50.013403 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-9337d9f6-5608-4ef3-9d54-8e2709e58911 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:50.014692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9337d9f6-5608-4ef3-9d54-8e2709e58911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:50.052878 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375e93b-7a37-484a-aff8-6e5bbf9ffd1b None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:50.066616 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:50.095964 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 433/857] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:33:50.098506 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffaa591-5953-493f-9c82-173cd8d19970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:50.099158 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffaa591-5953-493f-9c82-173cd8d19970 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:50.099466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffaa591-5953-493f-9c82-173cd8d19970 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:50.100347 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffaa591-5953-493f-9c82-173cd8d19970 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:50.101186 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffaa591-5953-493f-9c82-173cd8d19970 None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=94555ff897d94c90968c470d82ff9e2a) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:50.101499 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffaa591-5953-493f-9c82-173cd8d19970 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:50.102914 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffaa591-5953-493f-9c82-173cd8d19970 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:50.109208 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 425/858] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:33:49 2022] GET /identity/v3/role_assignments?user.id=94555ff897d94c90968c470d82ff9e2a&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=b156409c977248e1b23c26e589b1e04f => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:50.114821 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337d9f6-5608-4ef3-9d54-8e2709e58911 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:50.228153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337d9f6-5608-4ef3-9d54-8e2709e58911 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:50.229873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:50.266656 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf3f9b-3bea-4310-b1b6-8c8cfd1f71dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:50.267420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf3f9b-3bea-4310-b1b6-8c8cfd1f71dc None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:50.267742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf3f9b-3bea-4310-b1b6-8c8cfd1f71dc None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:50.268065 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf3f9b-3bea-4310-b1b6-8c8cfd1f71dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:50.279952 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf3f9b-3bea-4310-b1b6-8c8cfd1f71dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:50.288887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-6bcf3f9b-3bea-4310-b1b6-8c8cfd1f71dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:50.288887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:50.288887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:50.288887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:50.288887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:50.288887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:50.288887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:50.288887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:50.288887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:50.288887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:50.288887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:50.288887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:50.288887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:50.288887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:50.288887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:50.288887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:50.289880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:50.289880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:50.289880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:50.289880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:50.289880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:50.289880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:50.289880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:50.289880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:50.289880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:50.289880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:50.289880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:50.289880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:50.289880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:50.289880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:50.289880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:50.289880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:50.290829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:50.290829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:50.290829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:50.290829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:50.290829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:50.290829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:50.290829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:50.290829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:50.290829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:50.290829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:50.290829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:33:50.290829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:50.296711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 434/859] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:33:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:50.303741 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffaa591-5953-493f-9c82-173cd8d19970 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:50.410315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffaa591-5953-493f-9c82-173cd8d19970 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:50.446205 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee01e83-6fe8-47b5-819a-3df278900a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:50.446880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee01e83-6fe8-47b5-819a-3df278900a0d None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:50.447165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee01e83-6fe8-47b5-819a-3df278900a0d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:50.447440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee01e83-6fe8-47b5-819a-3df278900a0d None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:50.448237 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee01e83-6fe8-47b5-819a-3df278900a0d None admin] RBAC: Adding query filter params (name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:50.448549 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee01e83-6fe8-47b5-819a-3df278900a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:50.449909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee01e83-6fe8-47b5-819a-3df278900a0d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:50.458751 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 426/860] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:33:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:50.464045 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf3f9b-3bea-4310-b1b6-8c8cfd1f71dc None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:50.571271 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf3f9b-3bea-4310-b1b6-8c8cfd1f71dc None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:50.606264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af109f3e-0720-4591-ab19-b8f1c29989dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:50.607422 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af109f3e-0720-4591-ab19-b8f1c29989dc None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:50.607931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af109f3e-0720-4591-ab19-b8f1c29989dc None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:50.608422 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af109f3e-0720-4591-ab19-b8f1c29989dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:50.619398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af109f3e-0720-4591-ab19-b8f1c29989dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:50.621180 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af109f3e-0720-4591-ab19-b8f1c29989dc None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:50.638847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-af109f3e-0720-4591-ab19-b8f1c29989dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:50.638847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:50.638847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:50.638847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:50.638847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:50.638847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:50.638847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:50.638847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:50.638847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:50.638847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:50.638847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:50.638847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:50.638847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:50.638847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:50.638847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:50.639813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:50.639813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:50.639813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:50.639813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:50.639813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:50.639813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:50.639813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:50.639813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:50.639813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:50.639813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:50.639813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:50.639813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:50.639813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:50.639813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:50.639813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:50.639813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:50.639813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:50.640714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:50.640714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:50.640714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:50.640714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:50.642889 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 435/861] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:50.648699 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee01e83-6fe8-47b5-819a-3df278900a0d None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:50.672346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:50.763008 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee01e83-6fe8-47b5-819a-3df278900a0d None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:50.777996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a60deb-3a50-46ad-b7bd-29fabf506d59 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:50.778406 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a60deb-3a50-46ad-b7bd-29fabf506d59 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:50.778754 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a60deb-3a50-46ad-b7bd-29fabf506d59 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:50.781297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 436/862] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:50.785194 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf862ac-230f-4edd-9ff0-d05f013ffe54 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:50.785485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf862ac-230f-4edd-9ff0-d05f013ffe54 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:50.785770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf862ac-230f-4edd-9ff0-d05f013ffe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:50.799292 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f11345-1160-46ef-91de-1322d8296c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:50.799984 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f11345-1160-46ef-91de-1322d8296c48 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:50.800277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f11345-1160-46ef-91de-1322d8296c48 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:50.800556 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f11345-1160-46ef-91de-1322d8296c48 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:50.801285 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f11345-1160-46ef-91de-1322d8296c48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:50.801630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f11345-1160-46ef-91de-1322d8296c48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:50.803067 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f11345-1160-46ef-91de-1322d8296c48 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:50.805546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-bcf862ac-230f-4edd-9ff0-d05f013ffe54 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:50.809486 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-bcf862ac-230f-4edd-9ff0-d05f013ffe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:50.809591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:50.817682 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 427/863] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:50.823568 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f11345-1160-46ef-91de-1322d8296c48 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:50.890763 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 437/864] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:33:50.914024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf862ac-230f-4edd-9ff0-d05f013ffe54 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:50.928619 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:50.952083 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f11345-1160-46ef-91de-1322d8296c48 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:51.002002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f05bc-b006-4667-8f05-30e836d08232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:51.002870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f05bc-b006-4667-8f05-30e836d08232 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:51.003159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f05bc-b006-4667-8f05-30e836d08232 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:51.003438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272f05bc-b006-4667-8f05-30e836d08232 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:51.013775 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f05bc-b006-4667-8f05-30e836d08232 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:51.015899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272f05bc-b006-4667-8f05-30e836d08232 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:51.025562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf862ac-230f-4edd-9ff0-d05f013ffe54 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:51.036032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-272f05bc-b006-4667-8f05-30e836d08232 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 18:33:51.036032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:51.036032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:51.036032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:51.036032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:51.036032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:51.036032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:51.036032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:51.036032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:51.036032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:51.036032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:51.036032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:51.036032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:51.036032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:51.036032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:51.036032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:51.037051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:51.038042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:51.038042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:51.038042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:51.038042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:51.038042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:51.038042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:51.038042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:51.038042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:51.038042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 18:33:51.038042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:51.042148 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 428/865] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jun 27 18:33:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:51.043255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f05bc-b006-4667-8f05-30e836d08232 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:51.066847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec7fb3-bf57-450a-aa1d-e5cc630e2f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:51.067912 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec7fb3-bf57-450a-aa1d-e5cc630e2f4e None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:51.068978 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec7fb3-bf57-450a-aa1d-e5cc630e2f4e None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:51.069460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec7fb3-bf57-450a-aa1d-e5cc630e2f4e None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:51.070392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec7fb3-bf57-450a-aa1d-e5cc630e2f4e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:51.072030 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec7fb3-bf57-450a-aa1d-e5cc630e2f4e None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:51.150137 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:51.159728 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272f05bc-b006-4667-8f05-30e836d08232 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:51.163933 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 438/866] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jun 27 18:33:50 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:33:51.212823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65df528-9789-4659-bd45-eef5bccf5220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:51.213510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65df528-9789-4659-bd45-eef5bccf5220 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:51.213796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65df528-9789-4659-bd45-eef5bccf5220 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:51.214074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65df528-9789-4659-bd45-eef5bccf5220 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:51.214979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65df528-9789-4659-bd45-eef5bccf5220 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:51.215298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65df528-9789-4659-bd45-eef5bccf5220 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:51.216849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65df528-9789-4659-bd45-eef5bccf5220 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:51.219979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:51.238120 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 429/867] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Jun 27 18:33:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:51.244599 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec7fb3-bf57-450a-aa1d-e5cc630e2f4e None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:51.359169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec7fb3-bf57-450a-aa1d-e5cc630e2f4e None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:51.394537 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0266d-4557-4f8f-b2cf-90bf22db3a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:51.395188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0266d-4557-4f8f-b2cf-90bf22db3a7f None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:51.395471 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0266d-4557-4f8f-b2cf-90bf22db3a7f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:51.395821 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0266d-4557-4f8f-b2cf-90bf22db3a7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:51.461302 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:51.464634 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0266d-4557-4f8f-b2cf-90bf22db3a7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:51.466175 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0266d-4557-4f8f-b2cf-90bf22db3a7f None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:51.566899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 439/868] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:51 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:33:51.572730 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65df528-9789-4659-bd45-eef5bccf5220 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:51.682204 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65df528-9789-4659-bd45-eef5bccf5220 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:51.718279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737f2c8-6490-45a4-aa3a-0828ae4d74ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:51.719447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737f2c8-6490-45a4-aa3a-0828ae4d74ec None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:51.719979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737f2c8-6490-45a4-aa3a-0828ae4d74ec None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:51.720451 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737f2c8-6490-45a4-aa3a-0828ae4d74ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:51.732490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737f2c8-6490-45a4-aa3a-0828ae4d74ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:51.734335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737f2c8-6490-45a4-aa3a-0828ae4d74ec None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:51.753326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-d737f2c8-6490-45a4-aa3a-0828ae4d74ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:51.753326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:51.753326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:51.753326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:51.753326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:51.753326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:51.753326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:51.753326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:51.753326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:51.753326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:51.753326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:51.753326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:51.753326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:51.753326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:51.753326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:51.754252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:51.754252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:51.754252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:51.754252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:51.754252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:51.754252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:51.754252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:51.754252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:51.754252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:51.754252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:51.754252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:51.754252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:51.754252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:51.754252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:51.754252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:51.754252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:51.754252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:51.755148 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:51.755148 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:51.755148 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:51.755148 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:51.757493 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 430/869] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:51.763887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0266d-4557-4f8f-b2cf-90bf22db3a7f None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:51.862321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:51.866537 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0266d-4557-4f8f-b2cf-90bf22db3a7f None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:51.900747 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37c52d-c717-4f76-8b37-cf2fd8175c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:51.901398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37c52d-c717-4f76-8b37-cf2fd8175c90 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:51.901688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37c52d-c717-4f76-8b37-cf2fd8175c90 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:51.901968 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37c52d-c717-4f76-8b37-cf2fd8175c90 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:51.902693 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37c52d-c717-4f76-8b37-cf2fd8175c90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:51.903004 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37c52d-c717-4f76-8b37-cf2fd8175c90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:51.904408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37c52d-c717-4f76-8b37-cf2fd8175c90 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:51.917166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 440/870] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:51.922321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737f2c8-6490-45a4-aa3a-0828ae4d74ec None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:51.976654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:52.034610 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737f2c8-6490-45a4-aa3a-0828ae4d74ec None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:52.048767 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d6668-a788-4561-89e6-8e062edea4ef None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:52.049062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d6668-a788-4561-89e6-8e062edea4ef None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:52.049334 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d6668-a788-4561-89e6-8e062edea4ef None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:52.050925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 441/871] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:52.055699 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ab528-9111-48d7-b985-8b04b6e4826a None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:52.055985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ab528-9111-48d7-b985-8b04b6e4826a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:52.056261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ab528-9111-48d7-b985-8b04b6e4826a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:52.076915 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35000a-193f-440f-a1ef-69bbf31c3ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:52.077714 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35000a-193f-440f-a1ef-69bbf31c3ac4 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:52.078000 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35000a-193f-440f-a1ef-69bbf31c3ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:52.078274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35000a-193f-440f-a1ef-69bbf31c3ac4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:52.078674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-543ab528-9111-48d7-b985-8b04b6e4826a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:52.079910 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-543ab528-9111-48d7-b985-8b04b6e4826a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:52.086808 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35000a-193f-440f-a1ef-69bbf31c3ac4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:52.088286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35000a-193f-440f-a1ef-69bbf31c3ac4 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:52.106845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-ff35000a-193f-440f-a1ef-69bbf31c3ac4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:52.106845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:52.106845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:52.106845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:52.106845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:52.106845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:52.106845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:52.106845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:52.106845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:52.106845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:52.106845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:52.106845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:52.106845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:52.106845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:52.106845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:52.107811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:52.107811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:52.107811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:52.107811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:52.107811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:52.107811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:52.107811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:52.107811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:52.107811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:52.107811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:52.107811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:52.107811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:52.107811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:52.107811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:52.107811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:52.107811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:52.107811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:52.108747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:52.108747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:52.108747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:52.108747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:52.108747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:52.108747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:52.108747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:52.108747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:52.109695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 431/872] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:52.115410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35000a-193f-440f-a1ef-69bbf31c3ac4 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:52.169340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 442/873] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:52 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:33:52.190790 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ab528-9111-48d7-b985-8b04b6e4826a None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:52.236798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35000a-193f-440f-a1ef-69bbf31c3ac4 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:52.244674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:52.272157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506e0b0-074f-45dd-8488-1de9f9cb7489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:52.273227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506e0b0-074f-45dd-8488-1de9f9cb7489 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:52.273711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506e0b0-074f-45dd-8488-1de9f9cb7489 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:52.274213 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506e0b0-074f-45dd-8488-1de9f9cb7489 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:52.275196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506e0b0-074f-45dd-8488-1de9f9cb7489 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:52.275839 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506e0b0-074f-45dd-8488-1de9f9cb7489 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:52.278017 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506e0b0-074f-45dd-8488-1de9f9cb7489 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:52.292120 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 432/874] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:52.298677 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506e0b0-074f-45dd-8488-1de9f9cb7489 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:52.310698 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:52.323550 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ab528-9111-48d7-b985-8b04b6e4826a None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:52.360771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ad5ea-f803-409e-939b-58639ad2a0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:52.361735 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ad5ea-f803-409e-939b-58639ad2a0aa None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:52.362021 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ad5ea-f803-409e-939b-58639ad2a0aa None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:52.362297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ad5ea-f803-409e-939b-58639ad2a0aa None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:52.363026 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ad5ea-f803-409e-939b-58639ad2a0aa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:52.364425 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ad5ea-f803-409e-939b-58639ad2a0aa None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:52.412682 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506e0b0-074f-45dd-8488-1de9f9cb7489 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:52.445936 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6adf0-3295-4564-a279-2006b13d50f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:52.446578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6adf0-3295-4564-a279-2006b13d50f5 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:52.446861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6adf0-3295-4564-a279-2006b13d50f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:52.447136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6adf0-3295-4564-a279-2006b13d50f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:52.447997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6adf0-3295-4564-a279-2006b13d50f5 None admin] RBAC: Adding query filter params (role.id=62fd6b166d1847b19e812160b459d5db, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=6e6313c444eb4a788b6559eff17959f8) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:52.448310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6adf0-3295-4564-a279-2006b13d50f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:52.449727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6adf0-3295-4564-a279-2006b13d50f5 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:52.455493 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 433/875] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:33:52 2022] GET /identity/v3/role_assignments?user.id=6e6313c444eb4a788b6559eff17959f8&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=62fd6b166d1847b19e812160b459d5db => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:52.455493 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0de79-6a1a-44ff-a876-4e68e9135871 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:52.455493 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0de79-6a1a-44ff-a876-4e68e9135871 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:52.455493 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0de79-6a1a-44ff-a876-4e68e9135871 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:52.467452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 434/876] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:52 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:52.469008 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619499a-ee53-41fa-8fd3-699f8ff7b187 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:52.469384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619499a-ee53-41fa-8fd3-699f8ff7b187 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:52.469667 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619499a-ee53-41fa-8fd3-699f8ff7b187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:52.471968 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 443/877] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jun 27 18:33:52 2022] POST /identity/v3/services => generated 269 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:33:52.489586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-2619499a-ee53-41fa-8fd3-699f8ff7b187 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:52.490839 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-2619499a-ee53-41fa-8fd3-699f8ff7b187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:52.520432 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:52.586975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 435/878] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:33:52.610446 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ad5ea-f803-409e-939b-58639ad2a0aa None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:52.722752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ad5ea-f803-409e-939b-58639ad2a0aa None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:52.759439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeb4d2-99c6-424a-a557-992834d80476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:52.760216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeb4d2-99c6-424a-a557-992834d80476 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:52.760502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeb4d2-99c6-424a-a557-992834d80476 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:52.760782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedeb4d2-99c6-424a-a557-992834d80476 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:52.761454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedeb4d2-99c6-424a-a557-992834d80476 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:52.762831 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedeb4d2-99c6-424a-a557-992834d80476 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:52.776140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-eedeb4d2-99c6-424a-a557-992834d80476 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 18:33:52.776140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:52.776140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:33:52.776140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:33:52.776140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:33:52.776140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:33:52.776140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:33:52.776140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:52.776140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 18:33:52.776140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:52.776140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:33:52.776140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:52.776140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:52.776140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:52.776140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:52.776140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:52.776140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:52.777186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:52.777186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:52.777186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:52.777186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:52.777186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:52.777186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:52.777186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:33:52.777186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:33:52.777186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:33:52.777186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:33:52.777186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:52.777186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:52.777186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:52.777186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:52.777186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:52.777186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:52.778087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:52.778087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:52.778087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:52.778087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:52.778087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:52.778087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:52.778087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:52.778087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:52.778087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:52.778087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:52.778087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:33:52.778087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:52.778087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 18:33:52.778087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:52.778087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 444/879] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jun 27 18:33:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:52.783952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619499a-ee53-41fa-8fd3-699f8ff7b187 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:52.897155 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619499a-ee53-41fa-8fd3-699f8ff7b187 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:52.932926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e17fd8-ba53-45e2-a386-6e7c0918d6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:52.933975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e17fd8-ba53-45e2-a386-6e7c0918d6eb None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:52.934488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e17fd8-ba53-45e2-a386-6e7c0918d6eb None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:52.934972 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e17fd8-ba53-45e2-a386-6e7c0918d6eb None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:52.935920 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e17fd8-ba53-45e2-a386-6e7c0918d6eb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:52.936453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e17fd8-ba53-45e2-a386-6e7c0918d6eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:52.938039 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e17fd8-ba53-45e2-a386-6e7c0918d6eb None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:52.943677 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 436/880] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jun 27 18:33:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:52.949525 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeb4d2-99c6-424a-a557-992834d80476 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:52.967450 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:53.057441 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedeb4d2-99c6-424a-a557-992834d80476 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:53.091919 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ade7c-bda6-4a9a-8e5f-b6e873384aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:53.092592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ade7c-bda6-4a9a-8e5f-b6e873384aa2 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:53.092879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ade7c-bda6-4a9a-8e5f-b6e873384aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:53.093157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ade7c-bda6-4a9a-8e5f-b6e873384aa2 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:53.093866 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ade7c-bda6-4a9a-8e5f-b6e873384aa2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:53.094177 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ade7c-bda6-4a9a-8e5f-b6e873384aa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:53.095558 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ade7c-bda6-4a9a-8e5f-b6e873384aa2 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:53.101120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 445/881] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jun 27 18:33:52 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:53.335107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876c178-481c-416e-8bfa-5b8102a3f6e2 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:53.335504 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876c178-481c-416e-8bfa-5b8102a3f6e2 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:53.335732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876c178-481c-416e-8bfa-5b8102a3f6e2 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:53.337206 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 437/882] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:53.342329 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f441e0f-86a4-40fa-99c6-f10df51fd555 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:53.342621 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f441e0f-86a4-40fa-99c6-f10df51fd555 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:53.342898 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f441e0f-86a4-40fa-99c6-f10df51fd555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:53.360528 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-2f441e0f-86a4-40fa-99c6-f10df51fd555 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:53.361720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2f441e0f-86a4-40fa-99c6-f10df51fd555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:53.433747 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 446/883] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:33:53.456366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876c178-481c-416e-8bfa-5b8102a3f6e2 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:53.478692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:53.560494 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876c178-481c-416e-8bfa-5b8102a3f6e2 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:53.595206 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fc00a-9fda-4c5a-bd78-4086777bc28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:53.595975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fc00a-9fda-4c5a-bd78-4086777bc28a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:53.596259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fc00a-9fda-4c5a-bd78-4086777bc28a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:53.596534 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fc00a-9fda-4c5a-bd78-4086777bc28a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:53.597190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fc00a-9fda-4c5a-bd78-4086777bc28a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:53.598552 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fc00a-9fda-4c5a-bd78-4086777bc28a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:53.611706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-863fc00a-9fda-4c5a-bd78-4086777bc28a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 18:33:53.611706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:53.611706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:33:53.611706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:33:53.611706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:33:53.611706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:33:53.611706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:33:53.611706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:53.611706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 18:33:53.611706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:53.611706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:33:53.611706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:53.611706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:53.611706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:53.611706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:53.611706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:53.611706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:53.612727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:53.612727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:53.612727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:53.612727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:53.612727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:53.612727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:53.612727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:33:53.612727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:33:53.612727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:33:53.612727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:33:53.612727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:53.612727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:53.612727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:53.612727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:53.612727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:53.612727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:53.613571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:53.613571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:53.613571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:53.613571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:53.613571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:53.613571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:53.613571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:53.613571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:53.613571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:53.613571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:53.613571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:33:53.613571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:53.613571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 18:33:53.613571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:53.617034 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 438/884] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:33:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:53.619646 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f441e0f-86a4-40fa-99c6-f10df51fd555 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:53.628551 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:53.723474 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f441e0f-86a4-40fa-99c6-f10df51fd555 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:53.758567 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dc7ee-c271-43e7-82c6-0b98bf0791b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:53.759525 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dc7ee-c271-43e7-82c6-0b98bf0791b8 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:53.760017 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dc7ee-c271-43e7-82c6-0b98bf0791b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:53.760473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566dc7ee-c271-43e7-82c6-0b98bf0791b8 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:53.761353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566dc7ee-c271-43e7-82c6-0b98bf0791b8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:53.761867 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566dc7ee-c271-43e7-82c6-0b98bf0791b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:53.763417 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566dc7ee-c271-43e7-82c6-0b98bf0791b8 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:53.768766 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 447/885] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:33:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:53.777650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fc00a-9fda-4c5a-bd78-4086777bc28a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:53.866897 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:53.885385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fc00a-9fda-4c5a-bd78-4086777bc28a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:53.920579 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39782bf-efb7-4bae-bd0b-b74a783d8ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:53.921513 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39782bf-efb7-4bae-bd0b-b74a783d8ad6 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:53.921981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39782bf-efb7-4bae-bd0b-b74a783d8ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:53.922456 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39782bf-efb7-4bae-bd0b-b74a783d8ad6 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:53.923348 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39782bf-efb7-4bae-bd0b-b74a783d8ad6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:53.923875 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39782bf-efb7-4bae-bd0b-b74a783d8ad6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:53.925477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39782bf-efb7-4bae-bd0b-b74a783d8ad6 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:53.931007 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 439/886] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:33:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:53.936650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dc7ee-c271-43e7-82c6-0b98bf0791b8 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:54.011232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:54.044835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566dc7ee-c271-43e7-82c6-0b98bf0791b8 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:54.079491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87bbaa-ff10-41ba-816f-082b6387baef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:54.080489 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87bbaa-ff10-41ba-816f-082b6387baef None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:54.080987 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87bbaa-ff10-41ba-816f-082b6387baef None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:54.081458 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87bbaa-ff10-41ba-816f-082b6387baef None admin] PATH_INFO: `/v3/endpoints` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:54.082451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87bbaa-ff10-41ba-816f-082b6387baef None admin] RBAC: Adding query filter params (interface=public, service_id=bdcb4dc6cc01421b9113b17a331107c4, region_id=RegionOne) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:54.082961 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87bbaa-ff10-41ba-816f-082b6387baef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:54.085178 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87bbaa-ff10-41ba-816f-082b6387baef None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:54.095102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 448/887] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Jun 27 18:33:53 2022] GET /identity/v3/endpoints?service_id=bdcb4dc6cc01421b9113b17a331107c4&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:54.096695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39782bf-efb7-4bae-bd0b-b74a783d8ad6 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:54.197386 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39782bf-efb7-4bae-bd0b-b74a783d8ad6 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:54.234175 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d58796-9aa7-4b02-9c86-32af1d73ef7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:54.234175 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d58796-9aa7-4b02-9c86-32af1d73ef7c None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:54.234175 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d58796-9aa7-4b02-9c86-32af1d73ef7c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:54.234175 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d58796-9aa7-4b02-9c86-32af1d73ef7c None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:54.234663 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d58796-9aa7-4b02-9c86-32af1d73ef7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:54.235440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d58796-9aa7-4b02-9c86-32af1d73ef7c None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:54.242805 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 440/888] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jun 27 18:33:54 2022] GET /identity/v3/services => generated 1268 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:33:54.554219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ede18-809f-4115-9fa4-6e8026d4cdb8 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:54.554557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ede18-809f-4115-9fa4-6e8026d4cdb8 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:54.554779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ede18-809f-4115-9fa4-6e8026d4cdb8 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:54.556428 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 449/889] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:54.561594 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67b575-5635-43cf-a132-850add3d71ab None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:54.561887 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67b575-5635-43cf-a132-850add3d71ab None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:54.562171 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67b575-5635-43cf-a132-850add3d71ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:54.579100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-7a67b575-5635-43cf-a132-850add3d71ab None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:54.580309 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-7a67b575-5635-43cf-a132-850add3d71ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:54.589416 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:54.651075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 441/890] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:33:54.673734 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ede18-809f-4115-9fa4-6e8026d4cdb8 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:54.781917 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ede18-809f-4115-9fa4-6e8026d4cdb8 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:54.817878 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1f692-88f4-4342-879c-5af93712ea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:54.818702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1f692-88f4-4342-879c-5af93712ea9e None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:54.818985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1f692-88f4-4342-879c-5af93712ea9e None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:54.819261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1f692-88f4-4342-879c-5af93712ea9e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:54.819954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1f692-88f4-4342-879c-5af93712ea9e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:54.821330 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1f692-88f4-4342-879c-5af93712ea9e None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:54.823199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:54.834393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-dbd1f692-88f4-4342-879c-5af93712ea9e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 18:33:54.834393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:54.834393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:33:54.834393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:33:54.834393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:33:54.834393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:33:54.834393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:33:54.834393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:54.834393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 18:33:54.834393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:54.834393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:33:54.834393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:54.834393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:54.834393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:54.834393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:54.834393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:54.835373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:54.835373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:54.835373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:54.835373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:54.835373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:54.835373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:54.835373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:54.835373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:33:54.835373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:33:54.835373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:33:54.835373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:33:54.835373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:54.835373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:54.835373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:54.835373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:54.835373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:54.836261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:54.836261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:54.836261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:54.836261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:54.836261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:54.836261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:54.836261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:54.836261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:54.836261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:54.836261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:54.836261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:54.836261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:33:54.836261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:54.836261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 18:33:54.836261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:54.836261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 450/891] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Jun 27 18:33:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:54.844631 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67b575-5635-43cf-a132-850add3d71ab None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:54.896657 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fe315-a4ef-49e3-871a-5088838456ea None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:54.897045 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fe315-a4ef-49e3-871a-5088838456ea None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:54.897398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85fe315-a4ef-49e3-871a-5088838456ea None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:54.899168 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 451/892] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:33:54.904237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0409a-b117-41bc-b0d3-2b656b503cbf None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:54.904610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0409a-b117-41bc-b0d3-2b656b503cbf None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:54.905039 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0409a-b117-41bc-b0d3-2b656b503cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:54.923232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-85b0409a-b117-41bc-b0d3-2b656b503cbf None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:54.924570 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-85b0409a-b117-41bc-b0d3-2b656b503cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:54.954673 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67b575-5635-43cf-a132-850add3d71ab None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:54.993199 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5796f7-d60c-405e-a0f2-eab4ba3a77d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:54.993959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5796f7-d60c-405e-a0f2-eab4ba3a77d2 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:54.994244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5796f7-d60c-405e-a0f2-eab4ba3a77d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:54.994527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5796f7-d60c-405e-a0f2-eab4ba3a77d2 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:54.995233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5796f7-d60c-405e-a0f2-eab4ba3a77d2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:54.995560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5796f7-d60c-405e-a0f2-eab4ba3a77d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:54.996996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5796f7-d60c-405e-a0f2-eab4ba3a77d2 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:55.007550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 442/893] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jun 27 18:33:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:55.007906 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 452/894] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:33:55.008601 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5796f7-d60c-405e-a0f2-eab4ba3a77d2 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:55.017239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:55.024648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0409a-b117-41bc-b0d3-2b656b503cbf None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:55.118595 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5796f7-d60c-405e-a0f2-eab4ba3a77d2 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:55.131452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0409a-b117-41bc-b0d3-2b656b503cbf None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:55.156594 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6dda5-4972-4e8f-ac7b-d023b270ebf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:55.157662 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6dda5-4972-4e8f-ac7b-d023b270ebf4 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:55.158125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6dda5-4972-4e8f-ac7b-d023b270ebf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:55.158536 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6dda5-4972-4e8f-ac7b-d023b270ebf4 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:55.159559 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6dda5-4972-4e8f-ac7b-d023b270ebf4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:55.159877 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6dda5-4972-4e8f-ac7b-d023b270ebf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:55.160589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:55.163634 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef6dda5-4972-4e8f-ac7b-d023b270ebf4 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:55.169331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96e582-ae83-4441-8f02-bf5f82dedc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:55.171264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96e582-ae83-4441-8f02-bf5f82dedc24 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:55.171264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96e582-ae83-4441-8f02-bf5f82dedc24 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:55.171264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96e582-ae83-4441-8f02-bf5f82dedc24 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:55.174250 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 443/895] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jun 27 18:33:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:55.175457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6dda5-4972-4e8f-ac7b-d023b270ebf4 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:55.183550 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96e582-ae83-4441-8f02-bf5f82dedc24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:55.193281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-7b96e582-ae83-4441-8f02-bf5f82dedc24 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 18:33:55.193281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:55.193281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:55.193281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:55.193281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:55.193281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:55.193281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:55.193281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:55.193281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:55.193281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:55.193281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:55.193281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:55.193281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:55.193281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:55.193281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:55.193281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:55.195402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:55.195402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:55.195402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:55.195402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:55.195402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:55.195402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:55.195402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:55.195402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:55.195402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:55.195402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:55.195402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:55.195402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:55.195402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:55.195402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:55.195402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:55.195402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:55.197498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:55.197498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:55.197498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:55.197498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:55.197498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:55.197498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:55.197498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:55.197498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:55.197498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:55.197498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:55.197498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 18:33:55.197498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:55.205273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 453/896] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Jun 27 18:33:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:55.205273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96e582-ae83-4441-8f02-bf5f82dedc24 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:55.254440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:55.292156 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6dda5-4972-4e8f-ac7b-d023b270ebf4 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:55.303320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96e582-ae83-4441-8f02-bf5f82dedc24 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:55.331158 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0025068-eab6-4da7-97b7-77955d3b55f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:55.331847 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0025068-eab6-4da7-97b7-77955d3b55f9 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:55.332378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0025068-eab6-4da7-97b7-77955d3b55f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:55.332378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0025068-eab6-4da7-97b7-77955d3b55f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:55.333189 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0025068-eab6-4da7-97b7-77955d3b55f9 None admin] RBAC: Adding query filter params (interface=public, service_id=2a1ccda1716a450a9017a232aa5add49, region_id=RegionOne) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:55.334185 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0025068-eab6-4da7-97b7-77955d3b55f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:55.335584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0025068-eab6-4da7-97b7-77955d3b55f9 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:55.340564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454dcf4-83ca-4e09-8ace-7b645712b211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:55.345328 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 444/897] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Jun 27 18:33:55 2022] GET /identity/v3/endpoints?service_id=2a1ccda1716a450a9017a232aa5add49&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:55.345435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454dcf4-83ca-4e09-8ace-7b645712b211 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:55.345435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454dcf4-83ca-4e09-8ace-7b645712b211 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:55.345435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454dcf4-83ca-4e09-8ace-7b645712b211 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:55.345660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d1ab7-3859-4719-84c4-de32df6f7efc None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:55.345660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d1ab7-3859-4719-84c4-de32df6f7efc None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:55.345804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454dcf4-83ca-4e09-8ace-7b645712b211 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:55.345879 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d1ab7-3859-4719-84c4-de32df6f7efc None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:55.345947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454dcf4-83ca-4e09-8ace-7b645712b211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:55.345947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454dcf4-83ca-4e09-8ace-7b645712b211 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:55.348098 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 445/898] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:55.348869 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d1ab7-3859-4719-84c4-de32df6f7efc None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:55.354555 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 454/899] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Jun 27 18:33:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:55.357194 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecf8f0-d060-400d-b6c4-8f9274e90f10 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:55.357712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecf8f0-d060-400d-b6c4-8f9274e90f10 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:55.358748 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aecf8f0-d060-400d-b6c4-8f9274e90f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:55.377505 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-5aecf8f0-d060-400d-b6c4-8f9274e90f10 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:55.379186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-5aecf8f0-d060-400d-b6c4-8f9274e90f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:55.433044 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:55.454871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 455/900] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:33:55.455624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d1ab7-3859-4719-84c4-de32df6f7efc None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:55.456110 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecf8f0-d060-400d-b6c4-8f9274e90f10 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:55.503256 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbbc3e-78ef-4d1b-8f6e-894cd3f86377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:55.503950 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbbc3e-78ef-4d1b-8f6e-894cd3f86377 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:55.504245 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbbc3e-78ef-4d1b-8f6e-894cd3f86377 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:55.504512 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbbc3e-78ef-4d1b-8f6e-894cd3f86377 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:55.505197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbbc3e-78ef-4d1b-8f6e-894cd3f86377 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:55.506594 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbbc3e-78ef-4d1b-8f6e-894cd3f86377 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:55.507683 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:55.519751 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 446/901] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jun 27 18:33:55 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:33:55.519751 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbbc3e-78ef-4d1b-8f6e-894cd3f86377 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:55.568919 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aecf8f0-d060-400d-b6c4-8f9274e90f10 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:55.610151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b61b5e-ee3f-4e4b-8374-ffa30abe866c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:55.610974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b61b5e-ee3f-4e4b-8374-ffa30abe866c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:55.611311 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b61b5e-ee3f-4e4b-8374-ffa30abe866c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:55.611622 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b61b5e-ee3f-4e4b-8374-ffa30abe866c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:55.623674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b61b5e-ee3f-4e4b-8374-ffa30abe866c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:55.625166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b61b5e-ee3f-4e4b-8374-ffa30abe866c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:55.645689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-81b61b5e-ee3f-4e4b-8374-ffa30abe866c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:55.645689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:55.645689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:55.645689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:55.645689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:55.645689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:55.645689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:55.645689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:55.645689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:55.645689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:55.645689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:55.645689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:55.645689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:55.645689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:55.645689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:55.646711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:55.646711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:55.646711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:55.646711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:55.646711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:55.646711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:55.646711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:55.646711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:55.646711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:55.646711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:55.646711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:55.646711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:55.646711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:55.646711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:55.646711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:55.646711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:55.646711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:55.647648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:55.647648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:55.647648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:55.647648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:55.651826 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 456/902] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:55.652768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b61b5e-ee3f-4e4b-8374-ffa30abe866c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:55.664396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbbc3e-78ef-4d1b-8f6e-894cd3f86377 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:55.688903 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:55.714191 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb959700-7124-48f0-b564-091342c21ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:55.714860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb959700-7124-48f0-b564-091342c21ff5 None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:55.715444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb959700-7124-48f0-b564-091342c21ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:55.715444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb959700-7124-48f0-b564-091342c21ff5 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:55.716179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb959700-7124-48f0-b564-091342c21ff5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:55.717553 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb959700-7124-48f0-b564-091342c21ff5 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:55.767785 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b61b5e-ee3f-4e4b-8374-ffa30abe866c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:55.778197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 447/903] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jun 27 18:33:55 2022] POST /identity/v3/services => generated 241 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:33:55.819136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285a106-29d2-4c0c-a2f3-6aa74c087c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:55.819847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285a106-29d2-4c0c-a2f3-6aa74c087c6d None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:55.820129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285a106-29d2-4c0c-a2f3-6aa74c087c6d None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:55.820402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285a106-29d2-4c0c-a2f3-6aa74c087c6d None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:55.821223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285a106-29d2-4c0c-a2f3-6aa74c087c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:55.821527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285a106-29d2-4c0c-a2f3-6aa74c087c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:55.823098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f285a106-29d2-4c0c-a2f3-6aa74c087c6d None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:55.838083 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 457/904] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:55.843785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb959700-7124-48f0-b564-091342c21ff5 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:55.909529 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:55.958022 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb959700-7124-48f0-b564-091342c21ff5 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:55.995033 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02bc76-82f0-47fc-8445-7c86112f4d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:55.995888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02bc76-82f0-47fc-8445-7c86112f4d6c None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:55.996175 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02bc76-82f0-47fc-8445-7c86112f4d6c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:55.996453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02bc76-82f0-47fc-8445-7c86112f4d6c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:56.006197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02bc76-82f0-47fc-8445-7c86112f4d6c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:56.007760 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02bc76-82f0-47fc-8445-7c86112f4d6c None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:56.023332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-9d02bc76-82f0-47fc-8445-7c86112f4d6c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 18:33:56.023332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:56.023332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:56.023332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:56.023332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:56.023332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:56.023332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:56.023332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:56.023332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:56.023332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:56.023332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:56.023332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:56.023332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:33:56.023332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:33:56.023332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:33:56.023332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:56.024349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:56.025322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:56.025322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:56.025322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:33:56.025322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:33:56.025322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:33:56.025322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:33:56.025322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:33:56.025322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:33:56.025322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 18:33:56.025322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:56.025322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 448/905] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jun 27 18:33:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:56.030631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285a106-29d2-4c0c-a2f3-6aa74c087c6d None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:56.127210 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:56.140062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f285a106-29d2-4c0c-a2f3-6aa74c087c6d None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:56.175810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3049e-04ff-4230-b407-65b25076cb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:56.176451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3049e-04ff-4230-b407-65b25076cb1f None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:56.176736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3049e-04ff-4230-b407-65b25076cb1f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:56.177011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3049e-04ff-4230-b407-65b25076cb1f None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:56.178477 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3049e-04ff-4230-b407-65b25076cb1f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:56.178786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3049e-04ff-4230-b407-65b25076cb1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:56.180243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3049e-04ff-4230-b407-65b25076cb1f None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:56.198384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 458/906] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Jun 27 18:33:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:56.203775 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02bc76-82f0-47fc-8445-7c86112f4d6c None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:56.309773 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02bc76-82f0-47fc-8445-7c86112f4d6c None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:56.324010 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef479c6-ec9d-42e4-bbc9-d8d9448a84de None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:56.324293 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef479c6-ec9d-42e4-bbc9-d8d9448a84de None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:56.324569 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef479c6-ec9d-42e4-bbc9-d8d9448a84de None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:56.327110 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 459/907] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:33:56.330990 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64fd34-8141-46d1-a531-94b2c593072f None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:56.331275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64fd34-8141-46d1-a531-94b2c593072f None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:56.331510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:56.331632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64fd34-8141-46d1-a531-94b2c593072f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:56.346135 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6d865-652d-41f3-b6ae-5a26e509b5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:56.347057 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d865-652d-41f3-b6ae-5a26e509b5e6 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:56.347339 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d865-652d-41f3-b6ae-5a26e509b5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:56.347651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6d865-652d-41f3-b6ae-5a26e509b5e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:56.351572 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-7e64fd34-8141-46d1-a531-94b2c593072f None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:56.353735 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-7e64fd34-8141-46d1-a531-94b2c593072f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:56.430831 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6d865-652d-41f3-b6ae-5a26e509b5e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:56.432918 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6d865-652d-41f3-b6ae-5a26e509b5e6 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:56.441565 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 460/908] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:33:56.468570 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64fd34-8141-46d1-a531-94b2c593072f None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:56.562364 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 449/909] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:33:56 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:33:56.563002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:56.568717 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6d865-652d-41f3-b6ae-5a26e509b5e6 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:56.591273 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:56.601983 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64fd34-8141-46d1-a531-94b2c593072f None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:56.644502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352172fb-55e7-437a-888b-9b709780f04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:56.645754 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352172fb-55e7-437a-888b-9b709780f04a None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:56.646545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352172fb-55e7-437a-888b-9b709780f04a None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:56.646821 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352172fb-55e7-437a-888b-9b709780f04a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:56.647478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352172fb-55e7-437a-888b-9b709780f04a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:56.649147 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352172fb-55e7-437a-888b-9b709780f04a None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:56.665469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-352172fb-55e7-437a-888b-9b709780f04a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 18:33:56.665469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:56.665469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:33:56.665469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:33:56.665469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:33:56.665469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:33:56.665469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:33:56.665469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:56.665469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 18:33:56.665469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:56.665469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:33:56.665469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:56.665469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:56.665469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:56.665469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:56.665469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:56.665469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:56.666508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:56.666508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:56.666508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:56.666508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:56.666508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:56.666508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:56.666508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:33:56.666508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:33:56.666508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:33:56.666508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:33:56.666508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:56.666508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:56.666508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:56.666508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:56.666508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:56.666508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:56.667373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:56.667373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:56.667373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:56.667373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:56.667373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:56.667373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:56.667373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:56.667373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:56.667373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:56.667373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:56.667373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:33:56.667373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:56.667373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 27 18:33:56.667373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:56.667373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 461/910] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:33:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:56.672642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352172fb-55e7-437a-888b-9b709780f04a None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:56.700210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6d865-652d-41f3-b6ae-5a26e509b5e6 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:56.739320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c3729-5831-4764-a81a-1693b4ab9249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:56.740363 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c3729-5831-4764-a81a-1693b4ab9249 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:56.740731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c3729-5831-4764-a81a-1693b4ab9249 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:56.741085 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c3729-5831-4764-a81a-1693b4ab9249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:56.753393 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c3729-5831-4764-a81a-1693b4ab9249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:56.755148 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c3729-5831-4764-a81a-1693b4ab9249 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:56.775755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-f55c3729-5831-4764-a81a-1693b4ab9249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:56.775755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:56.775755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:56.775755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:56.775755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:56.775755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:56.775755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:56.775755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:56.775755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:56.775755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:56.775755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:56.775755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:56.775755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:33:56.775755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:33:56.775755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:33:56.776708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:33:56.776708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:56.776708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:56.776708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:56.776708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:56.776708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:56.776708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:56.776708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:56.776708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:56.776708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:56.776708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:56.776708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:56.776708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:56.776708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:56.776708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:56.776708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:56.776708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:56.777606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:33:56.777606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:33:56.777606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:33:56.777606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:56.777606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 450/911] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:56.783329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c3729-5831-4764-a81a-1693b4ab9249 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:56.788026 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352172fb-55e7-437a-888b-9b709780f04a None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:56.824856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5f9f6-f801-4117-9a1c-6c967bb5d0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:56.825896 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5f9f6-f801-4117-9a1c-6c967bb5d0d7 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:56.826463 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5f9f6-f801-4117-9a1c-6c967bb5d0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:56.826970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5f9f6-f801-4117-9a1c-6c967bb5d0d7 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:56.827916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5f9f6-f801-4117-9a1c-6c967bb5d0d7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:56.828434 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5f9f6-f801-4117-9a1c-6c967bb5d0d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:56.830031 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5f9f6-f801-4117-9a1c-6c967bb5d0d7 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:56.835621 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 462/912] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:33:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:56.841383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5f9f6-f801-4117-9a1c-6c967bb5d0d7 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:56.845257 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:56.861833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:56.893581 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c3729-5831-4764-a81a-1693b4ab9249 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:56.930151 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe79c3d-6132-4633-a6de-ec2ce158755e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:56.930853 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe79c3d-6132-4633-a6de-ec2ce158755e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:56.931139 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe79c3d-6132-4633-a6de-ec2ce158755e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:56.931413 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe79c3d-6132-4633-a6de-ec2ce158755e None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:56.932167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe79c3d-6132-4633-a6de-ec2ce158755e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:56.932531 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe79c3d-6132-4633-a6de-ec2ce158755e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:56.933821 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe79c3d-6132-4633-a6de-ec2ce158755e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:56.945974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 451/913] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:56.950816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe79c3d-6132-4633-a6de-ec2ce158755e None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:56.971058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5f9f6-f801-4117-9a1c-6c967bb5d0d7 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:57.011997 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbe13b-1507-44db-b9ed-cce23453c811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:57.013231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbe13b-1507-44db-b9ed-cce23453c811 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:57.013740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbe13b-1507-44db-b9ed-cce23453c811 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:57.014217 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbe13b-1507-44db-b9ed-cce23453c811 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:57.015124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbe13b-1507-44db-b9ed-cce23453c811 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:57.015721 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbe13b-1507-44db-b9ed-cce23453c811 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:57.017400 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbe13b-1507-44db-b9ed-cce23453c811 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:57.027740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 463/914] 10.222.0.36 () {56 vars in 1114 bytes} [Mon Jun 27 18:33:56 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:57.029138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbe13b-1507-44db-b9ed-cce23453c811 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:57.059912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe79c3d-6132-4633-a6de-ec2ce158755e None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:57.089745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:57.096083 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd8fd4-b044-4e82-83de-9121a66b603b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:57.096922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd8fd4-b044-4e82-83de-9121a66b603b None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:57.097249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd8fd4-b044-4e82-83de-9121a66b603b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:57.097535 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd8fd4-b044-4e82-83de-9121a66b603b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:57.103975 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:57.104911 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd8fd4-b044-4e82-83de-9121a66b603b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:57.106622 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd8fd4-b044-4e82-83de-9121a66b603b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:57.121840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-cdfd8fd4-b044-4e82-83de-9121a66b603b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:57.121840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:57.121840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:57.121840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:57.121840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:57.121840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:57.121840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:57.121840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:57.121840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:57.121840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:57.121840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:57.121840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:57.121840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:57.121840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:57.121840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:57.122952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:57.122952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:57.122952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:57.122952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:57.122952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:57.122952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:57.122952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:57.122952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:57.122952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:57.122952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:57.122952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:57.122952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:57.122952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:57.122952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:57.122952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:57.122952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:57.122952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:57.124524 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:57.124524 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:57.124524 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:57.124524 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:57.124524 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:57.124524 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:57.124524 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:57.124524 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:57.131868 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 452/915] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:57.139096 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd8fd4-b044-4e82-83de-9121a66b603b None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:57.143425 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbe13b-1507-44db-b9ed-cce23453c811 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:57.180688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345be6db-9038-4197-b29d-2c7108aace0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:57.181405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345be6db-9038-4197-b29d-2c7108aace0c None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:57.181691 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345be6db-9038-4197-b29d-2c7108aace0c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:57.181969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345be6db-9038-4197-b29d-2c7108aace0c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:57.182812 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345be6db-9038-4197-b29d-2c7108aace0c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:57.184309 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345be6db-9038-4197-b29d-2c7108aace0c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:57.240792 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd8fd4-b044-4e82-83de-9121a66b603b None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:57.268356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 464/916] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jun 27 18:33:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:33:57.284066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377781ef-2f68-4ac7-a37b-f7e8f6dc42a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:57.285127 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377781ef-2f68-4ac7-a37b-f7e8f6dc42a8 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:57.285623 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377781ef-2f68-4ac7-a37b-f7e8f6dc42a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:57.286104 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377781ef-2f68-4ac7-a37b-f7e8f6dc42a8 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:57.287843 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377781ef-2f68-4ac7-a37b-f7e8f6dc42a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:57.288432 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377781ef-2f68-4ac7-a37b-f7e8f6dc42a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:57.290136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377781ef-2f68-4ac7-a37b-f7e8f6dc42a8 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:57.304353 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 453/917] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:33:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:57.310709 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345be6db-9038-4197-b29d-2c7108aace0c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:57.429646 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345be6db-9038-4197-b29d-2c7108aace0c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:57.456547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:57.467427 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2891963f-5d41-424a-bc6c-28bbca7cc7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:57.468102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891963f-5d41-424a-bc6c-28bbca7cc7d3 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:57.468382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891963f-5d41-424a-bc6c-28bbca7cc7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:57.491720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2891963f-5d41-424a-bc6c-28bbca7cc7d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:57.491720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891963f-5d41-424a-bc6c-28bbca7cc7d3 None admin] RBAC: Adding query filter params (role.id=bd1fd5ae539d44b2be1d4ee708a949c9, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=6e6313c444eb4a788b6559eff17959f8) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:57.491720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891963f-5d41-424a-bc6c-28bbca7cc7d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:57.491720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2891963f-5d41-424a-bc6c-28bbca7cc7d3 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:57.491720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 465/918] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:33:57 2022] GET /identity/v3/role_assignments?user.id=6e6313c444eb4a788b6559eff17959f8&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=bd1fd5ae539d44b2be1d4ee708a949c9 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:57.698842 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f13da6-75c6-40b8-80bd-3c3e67cf7618 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:57.699281 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f13da6-75c6-40b8-80bd-3c3e67cf7618 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:57.699596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f13da6-75c6-40b8-80bd-3c3e67cf7618 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:57.701191 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 454/919] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:57.706490 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89cb96-9920-4018-880d-f4b06c6ccc3a None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:57.706783 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89cb96-9920-4018-880d-f4b06c6ccc3a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:57.707060 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89cb96-9920-4018-880d-f4b06c6ccc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:57.724851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-4d89cb96-9920-4018-880d-f4b06c6ccc3a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:57.726033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-4d89cb96-9920-4018-880d-f4b06c6ccc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:57.796709 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 466/920] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:33:57.820950 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f13da6-75c6-40b8-80bd-3c3e67cf7618 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:57.872654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:57.905955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e54800-4e85-4fe7-b8e1-d0cc53acb64b None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:57.906291 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e54800-4e85-4fe7-b8e1-d0cc53acb64b None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:57.906517 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e54800-4e85-4fe7-b8e1-d0cc53acb64b None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:57.908489 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 467/921] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:57.915332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef1dd0-695b-43a3-984d-ce8c10a84b95 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:57.915643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef1dd0-695b-43a3-984d-ce8c10a84b95 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:57.915912 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef1dd0-695b-43a3-984d-ce8c10a84b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:57.933857 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-66ef1dd0-695b-43a3-984d-ce8c10a84b95 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:57.935069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-66ef1dd0-695b-43a3-984d-ce8c10a84b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:57.942057 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f13da6-75c6-40b8-80bd-3c3e67cf7618 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:57.991055 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0bd52-dcd0-4250-a15c-1dcd9c51420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:57.992464 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0bd52-dcd0-4250-a15c-1dcd9c51420f None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:57.992749 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0bd52-dcd0-4250-a15c-1dcd9c51420f None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:57.993026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0bd52-dcd0-4250-a15c-1dcd9c51420f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:57.993691 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0bd52-dcd0-4250-a15c-1dcd9c51420f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:57.995060 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0bd52-dcd0-4250-a15c-1dcd9c51420f None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:58.013611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-1df0bd52-dcd0-4250-a15c-1dcd9c51420f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 18:33:58.013611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:58.013611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:33:58.013611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:33:58.013611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:33:58.013611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:33:58.013611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:33:58.013611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:58.013611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 18:33:58.013611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:58.013611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:33:58.013611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:58.013611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:58.013611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:58.013611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:58.013611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:58.014736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:58.014736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:58.014736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:58.014736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:58.014736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:58.014736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:58.014736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:58.014736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:33:58.014736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:33:58.014736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:33:58.014736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:33:58.014736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:58.014736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:58.014736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:58.014736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:58.014736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:58.015718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:58.015718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:58.015718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:58.015718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:58.015718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:58.015718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:58.015718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:58.015718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:58.015718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:58.015718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:58.015718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:58.015718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:33:58.015718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:58.015718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 27 18:33:58.015718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:58.019947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 455/922] 10.222.0.36 () {56 vars in 1132 bytes} [Mon Jun 27 18:33:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:58.020834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0bd52-dcd0-4250-a15c-1dcd9c51420f None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:58.023009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 468/923] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:33:58.045583 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef1dd0-695b-43a3-984d-ce8c10a84b95 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:58.098290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:58.139313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0bd52-dcd0-4250-a15c-1dcd9c51420f None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:58.151720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:58.156522 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef1dd0-695b-43a3-984d-ce8c10a84b95 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:58.177611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ddb4c-d3af-4a07-9399-90ce0de5aa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:58.178411 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ddb4c-d3af-4a07-9399-90ce0de5aa14 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:58.178796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ddb4c-d3af-4a07-9399-90ce0de5aa14 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:58.179172 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ddb4c-d3af-4a07-9399-90ce0de5aa14 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:58.180554 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ddb4c-d3af-4a07-9399-90ce0de5aa14 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:58.180987 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ddb4c-d3af-4a07-9399-90ce0de5aa14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:58.183125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ddb4c-d3af-4a07-9399-90ce0de5aa14 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:58.191671 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 456/924] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jun 27 18:33:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:58.196167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ddb4c-d3af-4a07-9399-90ce0de5aa14 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:58.201900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d72b7-723d-492c-af5b-e412c144e7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:58.202794 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d72b7-723d-492c-af5b-e412c144e7ae None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:58.203079 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d72b7-723d-492c-af5b-e412c144e7ae None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:58.203362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d72b7-723d-492c-af5b-e412c144e7ae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:58.204072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d72b7-723d-492c-af5b-e412c144e7ae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:58.205643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223d72b7-723d-492c-af5b-e412c144e7ae None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:58.220038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-223d72b7-723d-492c-af5b-e412c144e7ae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 18:33:58.220038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:58.220038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:33:58.220038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:33:58.220038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:33:58.220038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:33:58.220038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:33:58.220038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:58.220038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 18:33:58.220038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:58.220038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:33:58.220038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:58.220038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:58.220038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:58.220038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:58.220038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:58.220038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:58.221080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:58.221080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:58.221080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:58.221080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:58.221080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:58.221080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:58.221080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:33:58.221080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:33:58.221080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:33:58.221080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:33:58.221080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:58.221080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:58.221080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:58.221080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:58.221080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:58.221080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:58.228124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:58.228124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:58.228124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:58.228124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:58.228124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:58.228124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:58.228124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:58.228124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:58.228124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:58.228124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:58.228124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:33:58.228124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:33:58.228124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 18:33:58.228124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:58.228124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 469/925] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jun 27 18:33:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:58.228934 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d72b7-723d-492c-af5b-e412c144e7ae None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:58.339990 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d72b7-723d-492c-af5b-e412c144e7ae None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:58.340587 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ddb4c-d3af-4a07-9399-90ce0de5aa14 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:58.353929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:58.375573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c03494-a6cb-48e5-80a8-5668665991e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:58.376810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c03494-a6cb-48e5-80a8-5668665991e1 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:58.377320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c03494-a6cb-48e5-80a8-5668665991e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:58.378019 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c03494-a6cb-48e5-80a8-5668665991e1 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:58.378947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c03494-a6cb-48e5-80a8-5668665991e1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:58.379692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c03494-a6cb-48e5-80a8-5668665991e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:58.381845 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c03494-a6cb-48e5-80a8-5668665991e1 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:58.391660 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 470/926] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jun 27 18:33:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:33:58.392325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aca395-38c7-4954-94dd-c77b34e2e117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:58.392995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aca395-38c7-4954-94dd-c77b34e2e117 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:58.393285 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aca395-38c7-4954-94dd-c77b34e2e117 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:58.393566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aca395-38c7-4954-94dd-c77b34e2e117 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:58.394282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aca395-38c7-4954-94dd-c77b34e2e117 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:58.394597 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aca395-38c7-4954-94dd-c77b34e2e117 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:58.396544 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aca395-38c7-4954-94dd-c77b34e2e117 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:58.397394 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c03494-a6cb-48e5-80a8-5668665991e1 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:58.406740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 457/927] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jun 27 18:33:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:58.407663 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aca395-38c7-4954-94dd-c77b34e2e117 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:58.450424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:58.523947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c03494-a6cb-48e5-80a8-5668665991e1 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:58.534288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aca395-38c7-4954-94dd-c77b34e2e117 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:58.561018 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a7ff4-ba5e-47ba-8c10-8778ef201e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:58.561687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a7ff4-ba5e-47ba-8c10-8778ef201e5b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:58.561974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a7ff4-ba5e-47ba-8c10-8778ef201e5b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:58.562253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a7ff4-ba5e-47ba-8c10-8778ef201e5b None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:58.562965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a7ff4-ba5e-47ba-8c10-8778ef201e5b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:58.563282 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a7ff4-ba5e-47ba-8c10-8778ef201e5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:58.564801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a7ff4-ba5e-47ba-8c10-8778ef201e5b None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:58.575375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 471/928] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jun 27 18:33:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:58.576287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a7ff4-ba5e-47ba-8c10-8778ef201e5b None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:58.585419 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122211b2-c23d-4d79-8dfd-16d47f949654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:58.586084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122211b2-c23d-4d79-8dfd-16d47f949654 None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:58.586370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122211b2-c23d-4d79-8dfd-16d47f949654 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:58.586653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122211b2-c23d-4d79-8dfd-16d47f949654 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:58.587407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122211b2-c23d-4d79-8dfd-16d47f949654 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:58.588812 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122211b2-c23d-4d79-8dfd-16d47f949654 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:58.626867 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:58.695798 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a7ff4-ba5e-47ba-8c10-8778ef201e5b None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:58.696308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 458/929] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jun 27 18:33:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:33:58.742495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c7f50-4719-446b-8ecf-2f4682b977e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:58.743225 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c7f50-4719-446b-8ecf-2f4682b977e8 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:58.743513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c7f50-4719-446b-8ecf-2f4682b977e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:58.743818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c7f50-4719-446b-8ecf-2f4682b977e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:58.744614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c7f50-4719-446b-8ecf-2f4682b977e8 None admin] RBAC: Adding query filter params (interface=public, service_id=4a2de615aab84eb5bcf40132971e11bf, region_id=RegionOne) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:33:58.744930 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c7f50-4719-446b-8ecf-2f4682b977e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:58.746328 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c7f50-4719-446b-8ecf-2f4682b977e8 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:58.752755 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 472/930] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Jun 27 18:33:58 2022] GET /identity/v3/endpoints?service_id=4a2de615aab84eb5bcf40132971e11bf&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:33:58.759080 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122211b2-c23d-4d79-8dfd-16d47f949654 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:58.872449 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:58.883252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122211b2-c23d-4d79-8dfd-16d47f949654 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:58.914986 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661c4f9-8b76-499d-a886-ddb3d0b25456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:58.919706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661c4f9-8b76-499d-a886-ddb3d0b25456 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:58.919706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661c4f9-8b76-499d-a886-ddb3d0b25456 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:58.919706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661c4f9-8b76-499d-a886-ddb3d0b25456 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:58.919706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661c4f9-8b76-499d-a886-ddb3d0b25456 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:58.919706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661c4f9-8b76-499d-a886-ddb3d0b25456 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:58.925702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 459/931] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jun 27 18:33:58 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:33:59.428464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddffc2-a70f-424c-abb8-c5a08ea6dde3 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:59.429011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddffc2-a70f-424c-abb8-c5a08ea6dde3 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:59.429011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddffc2-a70f-424c-abb8-c5a08ea6dde3 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:59.430591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 473/932] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:33:59.435857 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e26f9a-06bb-4321-8a85-f6835267dc24 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:59.436258 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e26f9a-06bb-4321-8a85-f6835267dc24 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:59.436433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e26f9a-06bb-4321-8a85-f6835267dc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:59.454206 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-c1e26f9a-06bb-4321-8a85-f6835267dc24 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:59.455839 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c1e26f9a-06bb-4321-8a85-f6835267dc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:59.527602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 460/933] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:33:59.552569 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddffc2-a70f-424c-abb8-c5a08ea6dde3 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:59.562574 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80ca89-1de3-411c-8a94-7406ba955f3a None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:59.562866 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80ca89-1de3-411c-8a94-7406ba955f3a None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:59.563151 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80ca89-1de3-411c-8a94-7406ba955f3a None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:59.564813 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 461/934] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:33:59.570032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc98af-51b9-499a-a144-3c2a55d83454 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:59.570318 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc98af-51b9-499a-a144-3c2a55d83454 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:59.570595 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc98af-51b9-499a-a144-3c2a55d83454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:59.587522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-57cc98af-51b9-499a-a144-3c2a55d83454 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:33:59.588726 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-57cc98af-51b9-499a-a144-3c2a55d83454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:33:59.658190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 462/935] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:33:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:33:59.672908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:59.677471 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddffc2-a70f-424c-abb8-c5a08ea6dde3 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:59.680710 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc98af-51b9-499a-a144-3c2a55d83454 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:59.699201 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:59.727854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608e93b-5632-41d4-828d-5096a9165c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:59.729182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608e93b-5632-41d4-828d-5096a9165c0a None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:59.731336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608e93b-5632-41d4-828d-5096a9165c0a None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:59.731667 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608e93b-5632-41d4-828d-5096a9165c0a None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:59.732383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608e93b-5632-41d4-828d-5096a9165c0a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:59.733843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608e93b-5632-41d4-828d-5096a9165c0a None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:59.736127 dv-cinder-844601-6-smb devstack@keystone.service[86869]: WARNING keystone.server.flask.common [None req-e608e93b-5632-41d4-828d-5096a9165c0a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 27 18:33:59.788431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.sql.core [None req-e608e93b-5632-41d4-828d-5096a9165c0a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 27 18:33:59.788431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 27 18:33:59.788431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [parameters: {'id': 'a7f17cc394a643c5880dbfe7794c5662', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 27 18:33:59.788431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86869) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 27 18:33:59.794909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc98af-51b9-499a-a144-3c2a55d83454 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:59.798559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-e608e93b-5632-41d4-828d-5096a9165c0a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a7f17cc394a643c5880dbfe7794c5662.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a7f17cc394a643c5880dbfe7794c5662. Jun 27 18:33:59.798559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:59.798559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 18:33:59.798559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 18:33:59.798559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 18:33:59.798559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 18:33:59.798559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 18:33:59.798559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 18:33:59.798559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 18:33:59.798559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application conn.query(q) Jun 27 18:33:59.798559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 18:33:59.798559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 18:33:59.798559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application result.read() Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 27 18:33:59.799418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 27 18:33:59.800480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 18:33:59.800480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application next(self.gen) Jun 27 18:33:59.800480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 27 18:33:59.800480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application yield resource Jun 27 18:33:59.800480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 18:33:59.800480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application next(self.gen) Jun 27 18:33:59.800480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 27 18:33:59.800480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self.session.rollback() Jun 27 18:33:59.800480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 27 18:33:59.800480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self.force_reraise() Jun 27 18:33:59.800480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 27 18:33:59.800480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise self.value Jun 27 18:33:59.800480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 27 18:33:59.800480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 27 18:33:59.800480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 27 18:33:59.800480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application session.commit() Jun 27 18:33:59.800480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 27 18:33:59.801436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 27 18:33:59.801436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 27 18:33:59.801436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._prepare_impl() Jun 27 18:33:59.801436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 27 18:33:59.801436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self.session.flush() Jun 27 18:33:59.801436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 27 18:33:59.801436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._flush(objects) Jun 27 18:33:59.801436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 27 18:33:59.801436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 27 18:33:59.801436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 27 18:33:59.801436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application compat.raise_( Jun 27 18:33:59.801436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 18:33:59.801436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception Jun 27 18:33:59.801436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 27 18:33:59.801436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application flush_context.execute() Jun 27 18:33:59.801436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 27 18:33:59.801436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rec.execute(self) Jun 27 18:33:59.802453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 27 18:33:59.802453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 27 18:33:59.802453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 27 18:33:59.802453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 27 18:33:59.802453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 27 18:33:59.802453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 27 18:33:59.802453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 27 18:33:59.802453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 27 18:33:59.802453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 27 18:33:59.802453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 27 18:33:59.802453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 27 18:33:59.802453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 27 18:33:59.802453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 27 18:33:59.802453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 27 18:33:59.802453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 27 18:33:59.803278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 27 18:33:59.803278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 18:33:59.803278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception Jun 27 18:33:59.803278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 18:33:59.803278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 18:33:59.803278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 18:33:59.803278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 18:33:59.803278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 18:33:59.803278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 18:33:59.803278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 18:33:59.803278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application conn.query(q) Jun 27 18:33:59.803278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 18:33:59.803278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 18:33:59.803278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 18:33:59.803278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application result.read() Jun 27 18:33:59.803278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 18:33:59.803278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 18:33:59.804183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 18:33:59.804183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 18:33:59.804183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 18:33:59.804183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 18:33:59.804183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 18:33:59.804183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 18:33:59.804183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 27 18:33:59.804183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 27 18:33:59.804183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [parameters: {'id': 'a7f17cc394a643c5880dbfe7794c5662', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 27 18:33:59.804183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 27 18:33:59.804183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:59.804183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:33:59.804183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:59.804183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:59.804183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 27 18:33:59.805014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 27 18:33:59.805014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 27 18:33:59.805014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 27 18:33:59.805014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 27 18:33:59.805014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:59.805014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:33:59.805014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:59.805014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:59.805014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:59.805014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:59.805014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:59.805014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:59.805014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:59.805014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:59.805014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:59.805014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:59.805014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:59.805963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:59.805963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 27 18:33:59.805963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 27 18:33:59.805963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:59.805963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:59.805963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 27 18:33:59.805963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 27 18:33:59.805963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a7f17cc394a643c5880dbfe7794c5662. Jun 27 18:33:59.805963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:59.805963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 474/936] 10.222.0.36 () {60 vars in 1140 bytes} [Mon Jun 27 18:33:59 2022] POST /identity/v3/projects => generated 262 bytes in 248 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:33:59.808717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608e93b-5632-41d4-828d-5096a9165c0a None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:59.843935 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c03c-c085-4d19-b2bb-ac661bfb64d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:59.844925 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c03c-c085-4d19-b2bb-ac661bfb64d7 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:59.845196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c03c-c085-4d19-b2bb-ac661bfb64d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:59.845472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103c03c-c085-4d19-b2bb-ac661bfb64d7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:59.864864 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103c03c-c085-4d19-b2bb-ac661bfb64d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:33:59.875500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-e103c03c-c085-4d19-b2bb-ac661bfb64d7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 18:33:59.875500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:59.875500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:59.875500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:59.875500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:59.875500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:59.875500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:59.875500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:59.875500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:59.875500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:59.875500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:59.875500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:59.875500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:33:59.875500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:33:59.875500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:33:59.875500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:33:59.876475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:33:59.876475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:33:59.876475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:33:59.876475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:33:59.876475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:59.876475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:59.876475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:59.876475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:59.876475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:59.876475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:59.876475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:59.876475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:59.876475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:59.876475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:59.876475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:59.876475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:59.877329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:59.877329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:59.877329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:59.877329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:59.877329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:33:59.877329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:33:59.877329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:33:59.877329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:33:59.877329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:33:59.877329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:33:59.877329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 18:33:59.877329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:33:59.883552 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 463/937] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Jun 27 18:33:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:33:59.884560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c03c-c085-4d19-b2bb-ac661bfb64d7 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:33:59.931196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608e93b-5632-41d4-828d-5096a9165c0a None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:33:59.966454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d073d6-cb96-4ae4-9245-06f755aafe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:33:59.967257 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d073d6-cb96-4ae4-9245-06f755aafe1c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:33:59.967565 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d073d6-cb96-4ae4-9245-06f755aafe1c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:33:59.967851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d073d6-cb96-4ae4-9245-06f755aafe1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:33:59.975315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d073d6-cb96-4ae4-9245-06f755aafe1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:33:59.977115 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d073d6-cb96-4ae4-9245-06f755aafe1c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:33:59.980207 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:33:59.992769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-69d073d6-cb96-4ae4-9245-06f755aafe1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:59.992769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:33:59.992769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:33:59.992769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:33:59.992769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:33:59.992769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:33:59.992769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:33:59.992769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:33:59.992769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:33:59.992769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:33:59.992769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:33:59.992769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:33:59.992769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:33:59.992769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:33:59.992769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:33:59.995085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:33:59.995085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:33:59.995085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:33:59.995085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:33:59.995085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:33:59.995085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:33:59.995085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:33:59.995085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:33:59.995085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:33:59.995085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:33:59.995085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:33:59.995085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:33:59.995085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:33:59.995085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:33:59.995085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:33:59.995085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:33:59.995085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:33:59.996269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:33:59.996269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:33:59.996269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:33:59.996269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:33:59.996269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:33:59.996269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:33:59.996269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:33:59.996269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:33:59.996269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 475/938] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:33:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:00.000666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d073d6-cb96-4ae4-9245-06f755aafe1c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:00.010875 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103c03c-c085-4d19-b2bb-ac661bfb64d7 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:00.032392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:00.054937 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51b196-09da-4eba-b17d-11d3639ae9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:00.057537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51b196-09da-4eba-b17d-11d3639ae9be None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:00.057537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51b196-09da-4eba-b17d-11d3639ae9be None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:00.057537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51b196-09da-4eba-b17d-11d3639ae9be None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:00.057846 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51b196-09da-4eba-b17d-11d3639ae9be None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:00.058211 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51b196-09da-4eba-b17d-11d3639ae9be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:00.059881 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51b196-09da-4eba-b17d-11d3639ae9be None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:00.076146 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 464/939] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Jun 27 18:33:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:00.077384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51b196-09da-4eba-b17d-11d3639ae9be None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:00.132800 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d073d6-cb96-4ae4-9245-06f755aafe1c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:00.175757 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a3f1e-17b5-404b-ad54-5830cbc194c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:00.176423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a3f1e-17b5-404b-ad54-5830cbc194c1 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:00.176708 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a3f1e-17b5-404b-ad54-5830cbc194c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:00.177597 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a3f1e-17b5-404b-ad54-5830cbc194c1 None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:00.178358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a3f1e-17b5-404b-ad54-5830cbc194c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:00.178671 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a3f1e-17b5-404b-ad54-5830cbc194c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:00.180262 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a3f1e-17b5-404b-ad54-5830cbc194c1 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:00.208373 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51b196-09da-4eba-b17d-11d3639ae9be None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:00.211284 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 476/940] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jun 27 18:33:59 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:00.252269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1454c5-d8a7-421d-afd9-5878fb6b1702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:00.253081 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1454c5-d8a7-421d-afd9-5878fb6b1702 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:00.253368 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1454c5-d8a7-421d-afd9-5878fb6b1702 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:00.253649 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1454c5-d8a7-421d-afd9-5878fb6b1702 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:00.267270 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1454c5-d8a7-421d-afd9-5878fb6b1702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:00.268826 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1454c5-d8a7-421d-afd9-5878fb6b1702 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:00.272101 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:00.289366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-1b1454c5-d8a7-421d-afd9-5878fb6b1702 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:00.289366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:00.289366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:00.289366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:00.289366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:00.289366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:00.289366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:00.289366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:00.289366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:00.289366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:00.289366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:00.289366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:00.289366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:34:00.289366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:34:00.289366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:34:00.291795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:34:00.291795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:00.291795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:00.291795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:00.291795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:00.291795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:00.291795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:00.291795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:00.291795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:00.291795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:00.291795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:00.291795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:00.291795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:00.291795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:00.291795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:00.291795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:00.291795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:00.292708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:34:00.292708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:34:00.292708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:00.292708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:00.292708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 465/941] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:00.296290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a3f1e-17b5-404b-ad54-5830cbc194c1 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:00.390145 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:00.414935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a3f1e-17b5-404b-ad54-5830cbc194c1 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:00.451637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfb288-f7e3-4e9a-9d9a-77d1cd62caf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:00.452406 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfb288-f7e3-4e9a-9d9a-77d1cd62caf0 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:00.452644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfb288-f7e3-4e9a-9d9a-77d1cd62caf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:00.452929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfb288-f7e3-4e9a-9d9a-77d1cd62caf0 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:00.453747 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfb288-f7e3-4e9a-9d9a-77d1cd62caf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:00.454018 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfb288-f7e3-4e9a-9d9a-77d1cd62caf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:00.455470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cfb288-f7e3-4e9a-9d9a-77d1cd62caf0 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:00.468355 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 477/942] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:00.474560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1454c5-d8a7-421d-afd9-5878fb6b1702 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:00.584064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1454c5-d8a7-421d-afd9-5878fb6b1702 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:00.619589 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6099a7-974c-423c-8c4d-0c633212900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:00.620409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6099a7-974c-423c-8c4d-0c633212900c None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:00.620754 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6099a7-974c-423c-8c4d-0c633212900c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:00.621042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6099a7-974c-423c-8c4d-0c633212900c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:00.629135 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6099a7-974c-423c-8c4d-0c633212900c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:00.631165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6099a7-974c-423c-8c4d-0c633212900c None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:00.646233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-af6099a7-974c-423c-8c4d-0c633212900c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 18:34:00.646233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:00.646233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:00.646233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:00.646233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:00.646233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:00.646233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:00.646233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:00.646233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:00.646233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:00.646233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:00.646233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:00.646233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:34:00.646233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:34:00.646233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:34:00.646233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:00.647269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:00.648293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:00.648293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:00.648293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:34:00.648293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:34:00.648293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:34:00.648293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:34:00.648293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:34:00.648293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:34:00.648293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 18:34:00.648293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:00.648293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 466/943] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jun 27 18:34:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:00.655220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfb288-f7e3-4e9a-9d9a-77d1cd62caf0 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:00.760632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfb288-f7e3-4e9a-9d9a-77d1cd62caf0 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:00.795973 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544ad6d-830f-47d9-b245-d5ee61d6f625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:00.797049 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ad6d-830f-47d9-b245-d5ee61d6f625 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:00.797553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ad6d-830f-47d9-b245-d5ee61d6f625 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:00.798047 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544ad6d-830f-47d9-b245-d5ee61d6f625 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:00.799084 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544ad6d-830f-47d9-b245-d5ee61d6f625 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:00.799626 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544ad6d-830f-47d9-b245-d5ee61d6f625 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:00.801286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544ad6d-830f-47d9-b245-d5ee61d6f625 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:00.805027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:00.820792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 478/944] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Jun 27 18:34:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:00.826491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6099a7-974c-423c-8c4d-0c633212900c None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:00.877479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f376de-4474-4885-892d-1de6bd23cfec None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:00.877769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f376de-4474-4885-892d-1de6bd23cfec None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:00.878047 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f376de-4474-4885-892d-1de6bd23cfec None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:00.879698 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 479/945] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:00.884352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:00.884655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f6d5-0cbd-4182-aeb7-8e27c51db9d3 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:00.884943 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f6d5-0cbd-4182-aeb7-8e27c51db9d3 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:00.885247 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9f6d5-0cbd-4182-aeb7-8e27c51db9d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:00.902185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-89a9f6d5-0cbd-4182-aeb7-8e27c51db9d3 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:00.903752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-89a9f6d5-0cbd-4182-aeb7-8e27c51db9d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:00.943431 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6099a7-974c-423c-8c4d-0c633212900c None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:00.988021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f3a41-b033-4287-b46e-f51a0d3bf281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:00.988819 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3a41-b033-4287-b46e-f51a0d3bf281 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:00.989107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3a41-b033-4287-b46e-f51a0d3bf281 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:00.989944 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f3a41-b033-4287-b46e-f51a0d3bf281 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:00.991624 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 480/946] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:34:01.006494 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f3a41-b033-4287-b46e-f51a0d3bf281 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:01.007994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f3a41-b033-4287-b46e-f51a0d3bf281 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:01.013155 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9f6d5-0cbd-4182-aeb7-8e27c51db9d3 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:01.034035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-f22f3a41-b033-4287-b46e-f51a0d3bf281 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:01.034035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:01.034035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:01.034035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:01.034035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:01.034035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:01.034035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:01.034035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:01.034035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:01.034035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:01.034035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:01.034035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:01.034035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:34:01.034035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:34:01.034035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:34:01.034945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:34:01.034945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:01.034945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:01.034945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:01.034945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:01.034945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:01.034945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:01.034945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:01.034945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:01.034945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:01.034945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:01.034945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:01.034945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:01.034945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:01.034945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:01.034945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:01.034945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:01.037358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:34:01.037358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:34:01.037358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:01.037358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:01.037358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 467/947] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:01.037358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0470779-b42c-4460-92a0-a3b91808b51f None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:01.037358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0470779-b42c-4460-92a0-a3b91808b51f None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:01.037763 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0470779-b42c-4460-92a0-a3b91808b51f None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:01.039111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 468/948] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:01.041254 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0470779-b42c-4460-92a0-a3b91808b51f None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:01.131679 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9f6d5-0cbd-4182-aeb7-8e27c51db9d3 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:01.157138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:01.162229 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0470779-b42c-4460-92a0-a3b91808b51f None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:01.164757 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:01.169970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33466d2f-7463-402d-921c-c439698bc218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:01.170813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33466d2f-7463-402d-921c-c439698bc218 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:01.171108 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33466d2f-7463-402d-921c-c439698bc218 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:01.171386 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33466d2f-7463-402d-921c-c439698bc218 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:01.172133 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33466d2f-7463-402d-921c-c439698bc218 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:01.173512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33466d2f-7463-402d-921c-c439698bc218 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:01.185647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-33466d2f-7463-402d-921c-c439698bc218 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 18:34:01.185647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:01.185647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:34:01.185647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:34:01.185647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:34:01.185647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:34:01.185647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:34:01.185647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:01.185647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 18:34:01.185647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:01.185647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:34:01.185647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:01.185647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:01.185647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:01.185647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:01.185647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:01.185647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:01.186825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:01.186825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:01.186825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:01.186825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:01.186825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:01.186825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:01.186825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:34:01.186825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:34:01.186825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:34:01.186825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:34:01.186825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:01.186825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:01.186825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:01.186825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:01.186825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:01.186825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:01.188012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:01.188012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:01.188012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:01.188012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:01.188012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:01.188012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:01.188012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:01.188012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:01.188012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:01.188012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:01.188012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:34:01.188012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:01.188012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 18:34:01.188012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:01.191862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 481/949] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:34:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:34:01.193016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e16f4e-c9d2-4c21-b4a8-56d81587d2d3 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:01.193324 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e16f4e-c9d2-4c21-b4a8-56d81587d2d3 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:01.193589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e16f4e-c9d2-4c21-b4a8-56d81587d2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:01.200085 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcda7d-176b-47ca-82be-3d73bddca3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:01.200742 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcda7d-176b-47ca-82be-3d73bddca3e5 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:01.201025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcda7d-176b-47ca-82be-3d73bddca3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:01.201310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcda7d-176b-47ca-82be-3d73bddca3e5 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:01.202031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcda7d-176b-47ca-82be-3d73bddca3e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:01.202341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcda7d-176b-47ca-82be-3d73bddca3e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:01.203732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcda7d-176b-47ca-82be-3d73bddca3e5 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:01.213656 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-33e16f4e-c9d2-4c21-b4a8-56d81587d2d3 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:01.215401 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-33e16f4e-c9d2-4c21-b4a8-56d81587d2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:01.220571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 469/950] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:01.220571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcda7d-176b-47ca-82be-3d73bddca3e5 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:01.286792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 482/951] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:01.287874 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e16f4e-c9d2-4c21-b4a8-56d81587d2d3 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:01.328768 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcda7d-176b-47ca-82be-3d73bddca3e5 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:01.366218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76541466-5d64-4cc4-9b72-7aaf45ad92a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:01.366903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76541466-5d64-4cc4-9b72-7aaf45ad92a6 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:01.367188 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76541466-5d64-4cc4-9b72-7aaf45ad92a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:01.367459 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76541466-5d64-4cc4-9b72-7aaf45ad92a6 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:01.368214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76541466-5d64-4cc4-9b72-7aaf45ad92a6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:01.368527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76541466-5d64-4cc4-9b72-7aaf45ad92a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:01.369923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76541466-5d64-4cc4-9b72-7aaf45ad92a6 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:01.379097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 470/952] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jun 27 18:34:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:01.379097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76541466-5d64-4cc4-9b72-7aaf45ad92a6 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:01.404231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:01.412778 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e16f4e-c9d2-4c21-b4a8-56d81587d2d3 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:01.432536 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:01.451675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7127b-8894-40bf-bdf4-3d26a39ed4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:01.452588 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7127b-8894-40bf-bdf4-3d26a39ed4d3 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:01.452874 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7127b-8894-40bf-bdf4-3d26a39ed4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:01.453159 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be7127b-8894-40bf-bdf4-3d26a39ed4d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:01.461914 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7127b-8894-40bf-bdf4-3d26a39ed4d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:01.464233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be7127b-8894-40bf-bdf4-3d26a39ed4d3 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:01.480108 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76541466-5d64-4cc4-9b72-7aaf45ad92a6 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:01.480915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-7be7127b-8894-40bf-bdf4-3d26a39ed4d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:34:01.480915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:01.480915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:01.480915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:01.480915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:01.480915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:01.480915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:01.480915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:01.480915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:01.480915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:01.480915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:01.480915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:01.480915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:34:01.480915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:34:01.480915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:34:01.481816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:34:01.481816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:01.481816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:01.481816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:01.481816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:01.481816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:01.481816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:01.481816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:01.481816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:01.481816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:01.481816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:01.481816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:01.481816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:01.481816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:01.481816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:01.481816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:01.481816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:01.482775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:34:01.482775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:34:01.482775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:34:01.482775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:34:01.482775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:34:01.482775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:34:01.482775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:34:01.482775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:01.482775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 483/953] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:34:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:01.483975 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7127b-8894-40bf-bdf4-3d26a39ed4d3 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:01.527398 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1d8c2-9988-481f-8498-a09fd1d5eb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:01.528239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1d8c2-9988-481f-8498-a09fd1d5eb33 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:01.528529 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1d8c2-9988-481f-8498-a09fd1d5eb33 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:01.528811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1d8c2-9988-481f-8498-a09fd1d5eb33 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:01.529497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1d8c2-9988-481f-8498-a09fd1d5eb33 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:01.530927 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1d8c2-9988-481f-8498-a09fd1d5eb33 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:01.544562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-68f1d8c2-9988-481f-8498-a09fd1d5eb33 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 18:34:01.544562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:01.544562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:34:01.544562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:34:01.544562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:34:01.544562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:34:01.544562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:34:01.544562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:01.544562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 18:34:01.544562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:01.544562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:34:01.544562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:01.544562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:01.544562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:01.544562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:01.544562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:01.544562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:01.545720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:01.545720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:01.545720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:01.545720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:01.545720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:01.545720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:01.545720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:34:01.545720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:34:01.545720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:34:01.545720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:34:01.545720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:01.545720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:01.545720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:01.545720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:01.545720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:01.545720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:01.546606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:01.546606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:01.546606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:01.546606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:01.546606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:01.546606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:01.546606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:01.546606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:01.546606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:01.546606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:01.546606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:34:01.546606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:01.546606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 18:34:01.546606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:01.546606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 471/954] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jun 27 18:34:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:01.547886 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1d8c2-9988-481f-8498-a09fd1d5eb33 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:01.613429 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be7127b-8894-40bf-bdf4-3d26a39ed4d3 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:01.645408 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:01.650605 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938350ad-abde-4dc1-a2c8-d19782344dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:01.651795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938350ad-abde-4dc1-a2c8-d19782344dfa None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:01.654631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938350ad-abde-4dc1-a2c8-d19782344dfa None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:01.654631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938350ad-abde-4dc1-a2c8-d19782344dfa None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:01.654631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938350ad-abde-4dc1-a2c8-d19782344dfa None admin] RBAC: Adding query filter params (type=compute) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:01.654631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938350ad-abde-4dc1-a2c8-d19782344dfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:01.654926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1d8c2-9988-481f-8498-a09fd1d5eb33 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:01.655871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938350ad-abde-4dc1-a2c8-d19782344dfa None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:01.671568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 484/955] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jun 27 18:34:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:01.671568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938350ad-abde-4dc1-a2c8-d19782344dfa None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:01.710060 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5008a-a3a5-4014-8f1e-b5b6adb164fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:01.711807 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5008a-a3a5-4014-8f1e-b5b6adb164fd None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:01.712176 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5008a-a3a5-4014-8f1e-b5b6adb164fd None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:01.712532 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5008a-a3a5-4014-8f1e-b5b6adb164fd None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:01.713476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5008a-a3a5-4014-8f1e-b5b6adb164fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:01.713875 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5008a-a3a5-4014-8f1e-b5b6adb164fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:01.715427 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5008a-a3a5-4014-8f1e-b5b6adb164fd None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:01.720781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:01.741112 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 472/956] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:34:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:01.747991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5008a-a3a5-4014-8f1e-b5b6adb164fd None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:01.794094 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938350ad-abde-4dc1-a2c8-d19782344dfa None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:01.835055 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73e697-75d2-4fc7-a41a-cecf285c6a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:01.835929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73e697-75d2-4fc7-a41a-cecf285c6a4c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:01.836300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73e697-75d2-4fc7-a41a-cecf285c6a4c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:01.843620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73e697-75d2-4fc7-a41a-cecf285c6a4c None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:01.843620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73e697-75d2-4fc7-a41a-cecf285c6a4c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:01.843620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73e697-75d2-4fc7-a41a-cecf285c6a4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:01.843620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73e697-75d2-4fc7-a41a-cecf285c6a4c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:01.847313 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 485/957] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jun 27 18:34:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:01.854088 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73e697-75d2-4fc7-a41a-cecf285c6a4c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:01.907580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5008a-a3a5-4014-8f1e-b5b6adb164fd None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:01.952261 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c8fc8-6296-44f6-9bde-69cc28f1dd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:01.953438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8fc8-6296-44f6-9bde-69cc28f1dd4c None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:01.953723 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8fc8-6296-44f6-9bde-69cc28f1dd4c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:01.954001 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8fc8-6296-44f6-9bde-69cc28f1dd4c None admin] PATH_INFO: `/v3/projects/94dba2006b6747f8badff33745bde432/users/6e6313c444eb4a788b6559eff17959f8/roles/bd1fd5ae539d44b2be1d4ee708a949c9` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:01.957144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c8fc8-6296-44f6-9bde-69cc28f1dd4c None admin] RBAC: Authorizing `identity:create_grant(project_id=94dba2006b6747f8badff33745bde432, user_id=6e6313c444eb4a788b6559eff17959f8, role_id=bd1fd5ae539d44b2be1d4ee708a949c9)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:01.959381 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c8fc8-6296-44f6-9bde-69cc28f1dd4c None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:01.966172 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73e697-75d2-4fc7-a41a-cecf285c6a4c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:01.974989 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:02.001342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344dd63-9ecf-4c1d-ba81-35226c507279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:02.002345 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344dd63-9ecf-4c1d-ba81-35226c507279 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:02.002853 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344dd63-9ecf-4c1d-ba81-35226c507279 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:02.003328 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9344dd63-9ecf-4c1d-ba81-35226c507279 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:02.004298 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344dd63-9ecf-4c1d-ba81-35226c507279 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:02.008514 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344dd63-9ecf-4c1d-ba81-35226c507279 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:02.008514 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9344dd63-9ecf-4c1d-ba81-35226c507279 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:02.011650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 486/958] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jun 27 18:34:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:02.017216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344dd63-9ecf-4c1d-ba81-35226c507279 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:02.054644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 473/959] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:34:01 2022] PUT /identity/v3/projects/94dba2006b6747f8badff33745bde432/users/6e6313c444eb4a788b6559eff17959f8/roles/bd1fd5ae539d44b2be1d4ee708a949c9 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:34:02.143561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9344dd63-9ecf-4c1d-ba81-35226c507279 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:02.182399 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0231e07-2185-473a-b00f-53d7e0e5c435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:02.183081 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231e07-2185-473a-b00f-53d7e0e5c435 None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:02.183373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231e07-2185-473a-b00f-53d7e0e5c435 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:02.183695 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231e07-2185-473a-b00f-53d7e0e5c435 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:02.184455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0231e07-2185-473a-b00f-53d7e0e5c435 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:02.185859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0231e07-2185-473a-b00f-53d7e0e5c435 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:02.269084 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 487/960] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jun 27 18:34:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:34:02.419011 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f5447-c989-48fb-9a57-99c36fc30f8c None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:02.419238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f5447-c989-48fb-9a57-99c36fc30f8c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:02.419473 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f5447-c989-48fb-9a57-99c36fc30f8c None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:02.421150 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 474/961] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:02.426420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a9f95-1a45-4063-a845-25cc90a42945 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:02.426899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a9f95-1a45-4063-a845-25cc90a42945 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:02.427188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a9f95-1a45-4063-a845-25cc90a42945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:02.445767 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-af7a9f95-1a45-4063-a845-25cc90a42945 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:02.446974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-af7a9f95-1a45-4063-a845-25cc90a42945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:02.469899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:02.527065 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 488/962] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:02.553014 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f5447-c989-48fb-9a57-99c36fc30f8c None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:02.569874 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:02.662651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f5447-c989-48fb-9a57-99c36fc30f8c None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:02.698012 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656453c-e764-45de-920c-c1ca8a0b7c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:02.698600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656453c-e764-45de-920c-c1ca8a0b7c56 None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:02.698884 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656453c-e764-45de-920c-c1ca8a0b7c56 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:02.699161 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656453c-e764-45de-920c-c1ca8a0b7c56 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:02.699897 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656453c-e764-45de-920c-c1ca8a0b7c56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:02.701327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656453c-e764-45de-920c-c1ca8a0b7c56 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:02.702626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: WARNING keystone.server.flask.common [None req-5656453c-e764-45de-920c-c1ca8a0b7c56 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 27 18:34:02.747614 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.sql.core [None req-5656453c-e764-45de-920c-c1ca8a0b7c56 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 27 18:34:02.747614 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 27 18:34:02.747614 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [parameters: {'user_id': '4205636634b144f6b60cb27bc249e7ac', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 27 18:34:02.747614 dv-cinder-844601-6-smb devstack@keystone.service[86870]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86870) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 27 18:34:02.764475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-5656453c-e764-45de-920c-c1ca8a0b7c56 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 27 18:34:02.764475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:02.764475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 18:34:02.764475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 18:34:02.764475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 18:34:02.764475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 18:34:02.764475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 18:34:02.764475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 18:34:02.764475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 18:34:02.764475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application conn.query(q) Jun 27 18:34:02.764475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 18:34:02.764475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 18:34:02.764475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 18:34:02.764475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application result.read() Jun 27 18:34:02.764475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 18:34:02.765443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application next(self.gen) Jun 27 18:34:02.766486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 27 18:34:02.766486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application yield resource Jun 27 18:34:02.766486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 27 18:34:02.766486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application next(self.gen) Jun 27 18:34:02.766486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 27 18:34:02.766486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self.session.rollback() Jun 27 18:34:02.766486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 27 18:34:02.766486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self.force_reraise() Jun 27 18:34:02.766486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 27 18:34:02.766486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise self.value Jun 27 18:34:02.766486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 27 18:34:02.766486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 27 18:34:02.766486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 27 18:34:02.766486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application session.commit() Jun 27 18:34:02.766486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 27 18:34:02.766486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 27 18:34:02.766486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 27 18:34:02.767409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._prepare_impl() Jun 27 18:34:02.767409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 27 18:34:02.767409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self.session.flush() Jun 27 18:34:02.767409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 27 18:34:02.767409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._flush(objects) Jun 27 18:34:02.767409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 27 18:34:02.767409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 27 18:34:02.767409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 27 18:34:02.767409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application compat.raise_( Jun 27 18:34:02.767409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 18:34:02.767409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception Jun 27 18:34:02.767409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 27 18:34:02.767409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application flush_context.execute() Jun 27 18:34:02.767409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 27 18:34:02.767409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rec.execute(self) Jun 27 18:34:02.767409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 27 18:34:02.767409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 27 18:34:02.769492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 27 18:34:02.769492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 27 18:34:02.769492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 27 18:34:02.769492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 27 18:34:02.769492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 27 18:34:02.769492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 27 18:34:02.769492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 27 18:34:02.769492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 27 18:34:02.769492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 27 18:34:02.769492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 27 18:34:02.769492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 27 18:34:02.769492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 27 18:34:02.769492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 27 18:34:02.769492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 27 18:34:02.769492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 27 18:34:02.769492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception Jun 27 18:34:02.772028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 27 18:34:02.772028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 27 18:34:02.772028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 27 18:34:02.772028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 27 18:34:02.772028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 27 18:34:02.772028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application result = self._query(query) Jun 27 18:34:02.772028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 27 18:34:02.772028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application conn.query(q) Jun 27 18:34:02.772028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 27 18:34:02.772028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 27 18:34:02.772028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 27 18:34:02.772028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application result.read() Jun 27 18:34:02.772028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 27 18:34:02.772028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 27 18:34:02.772028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 27 18:34:02.772028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 27 18:34:02.773570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 27 18:34:02.773570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 27 18:34:02.773570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 27 18:34:02.773570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 27 18:34:02.773570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 27 18:34:02.773570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 27 18:34:02.773570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [parameters: {'user_id': '4205636634b144f6b60cb27bc249e7ac', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 27 18:34:02.773570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 27 18:34:02.773570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:02.773570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:34:02.773570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:02.773570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:02.773570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:02.773570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:02.773570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:02.775026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:02.775026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:02.775026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:02.775026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:02.775026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:02.775026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:02.775026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:02.775026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 27 18:34:02.775026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 27 18:34:02.775026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:02.775026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:02.775026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:34:02.775026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:34:02.775026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:34:02.775026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:34:02.775026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 27 18:34:02.775026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 27 18:34:02.784869 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 27 18:34:02.784869 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 27 18:34:02.784869 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 27 18:34:02.784869 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 27 18:34:02.784869 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 27 18:34:02.784869 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:02.784869 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 475/963] 10.222.0.36 () {60 vars in 1131 bytes} [Mon Jun 27 18:34:02 2022] POST /identity/v3/users => generated 160 bytes in 214 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:02.785788 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a9f95-1a45-4063-a845-25cc90a42945 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:02.890499 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a9f95-1a45-4063-a845-25cc90a42945 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:02.924449 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7acd504-c0c0-4ca1-a276-a19dbe248269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:02.925235 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acd504-c0c0-4ca1-a276-a19dbe248269 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:02.925515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acd504-c0c0-4ca1-a276-a19dbe248269 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:02.925788 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7acd504-c0c0-4ca1-a276-a19dbe248269 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:02.933308 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acd504-c0c0-4ca1-a276-a19dbe248269 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:02.934746 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7acd504-c0c0-4ca1-a276-a19dbe248269 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:02.949818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-c7acd504-c0c0-4ca1-a276-a19dbe248269 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 18:34:02.949818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:02.949818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:02.949818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:02.949818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:02.949818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:02.949818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:02.949818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:02.949818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:02.949818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:02.949818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:02.949818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:02.949818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:34:02.949818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:34:02.949818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:34:02.949818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:02.950781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:02.951797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:02.951797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:02.951797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:34:02.951797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:34:02.951797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:34:02.951797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:34:02.951797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:34:02.951797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:34:02.951797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 27 18:34:02.951797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:02.951797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 489/964] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:34:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:02.958921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656453c-e764-45de-920c-c1ca8a0b7c56 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:03.037561 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:03.062487 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656453c-e764-45de-920c-c1ca8a0b7c56 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:03.095434 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33c9202-1f3d-4481-8fa2-bc6c80838a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:03.097514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c9202-1f3d-4481-8fa2-bc6c80838a5b None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:03.097514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c9202-1f3d-4481-8fa2-bc6c80838a5b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:03.097514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c9202-1f3d-4481-8fa2-bc6c80838a5b None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:03.097514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c9202-1f3d-4481-8fa2-bc6c80838a5b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:03.097815 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c9202-1f3d-4481-8fa2-bc6c80838a5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:03.099962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33c9202-1f3d-4481-8fa2-bc6c80838a5b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:03.138103 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 476/965] 10.222.0.36 () {56 vars in 1101 bytes} [Mon Jun 27 18:34:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:03.814591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c1c20-b0ea-4c1b-bc2c-ba04177bffc5 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:03.815123 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c1c20-b0ea-4c1b-bc2c-ba04177bffc5 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:03.815123 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c1c20-b0ea-4c1b-bc2c-ba04177bffc5 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:03.816568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 490/966] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:03.822227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fae2a-4789-467e-971b-a8e4bf23f912 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:03.822637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fae2a-4789-467e-971b-a8e4bf23f912 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:03.822812 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247fae2a-4789-467e-971b-a8e4bf23f912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:03.840200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-247fae2a-4789-467e-971b-a8e4bf23f912 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:03.843455 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-247fae2a-4789-467e-971b-a8e4bf23f912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:03.908813 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 477/967] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:03.931007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c1c20-b0ea-4c1b-bc2c-ba04177bffc5 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:03.946133 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:04.032643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c1c20-b0ea-4c1b-bc2c-ba04177bffc5 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:04.066500 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef6b9b-6b97-42f3-adb1-8040bf90c6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:04.067080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef6b9b-6b97-42f3-adb1-8040bf90c6b9 None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:04.067927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef6b9b-6b97-42f3-adb1-8040bf90c6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:04.068206 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef6b9b-6b97-42f3-adb1-8040bf90c6b9 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:04.068937 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef6b9b-6b97-42f3-adb1-8040bf90c6b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:04.070302 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef6b9b-6b97-42f3-adb1-8040bf90c6b9 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:04.137822 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 491/968] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jun 27 18:34:03 2022] POST /identity/v3/services => generated 242 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:34:04.181566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee8304-5fae-4e45-b792-a23e96ba69af None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:04.181858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee8304-5fae-4e45-b792-a23e96ba69af None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:04.182145 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee8304-5fae-4e45-b792-a23e96ba69af None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:04.183615 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 478/969] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:04.189648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf739d8-e3be-4cc5-afa3-7076f3f87103 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:04.190003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf739d8-e3be-4cc5-afa3-7076f3f87103 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:04.190222 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf739d8-e3be-4cc5-afa3-7076f3f87103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:04.208891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-9bf739d8-e3be-4cc5-afa3-7076f3f87103 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:04.210108 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9bf739d8-e3be-4cc5-afa3-7076f3f87103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:04.283867 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:04.294111 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 492/970] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:04.316875 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee8304-5fae-4e45-b792-a23e96ba69af None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:04.384410 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d283afe-b729-441c-827a-94295ac73d05 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:04.384747 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d283afe-b729-441c-827a-94295ac73d05 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:04.384957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d283afe-b729-441c-827a-94295ac73d05 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:04.385416 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:04.386472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 493/971] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:34:04.391400 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214b42-677a-4526-bb94-d68cf726e3c9 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:04.391718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214b42-677a-4526-bb94-d68cf726e3c9 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:04.392002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf214b42-677a-4526-bb94-d68cf726e3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:04.409168 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-bf214b42-677a-4526-bb94-d68cf726e3c9 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:04.410551 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-bf214b42-677a-4526-bb94-d68cf726e3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:04.428338 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee8304-5fae-4e45-b792-a23e96ba69af None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:04.465448 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac00d0-5de6-42af-a41b-9a4c78b3fa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:04.466256 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac00d0-5de6-42af-a41b-9a4c78b3fa21 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:04.466542 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac00d0-5de6-42af-a41b-9a4c78b3fa21 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:04.466818 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac00d0-5de6-42af-a41b-9a4c78b3fa21 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:04.478085 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaac00d0-5de6-42af-a41b-9a4c78b3fa21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:34:04.487571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 494/972] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:04 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:34:04.487722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-eaac00d0-5de6-42af-a41b-9a4c78b3fa21 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 18:34:04.487722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:04.487722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:04.487722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:04.487722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:04.487722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:04.487722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:04.487722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:04.487722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:04.487722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:04.487722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:04.487722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:04.487722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:34:04.487722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:34:04.487722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:34:04.487722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:34:04.488643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:34:04.488643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:34:04.488643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:34:04.488643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:34:04.488643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:04.488643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:04.488643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:04.488643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:04.488643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:04.488643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:04.488643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:04.488643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:04.488643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:04.488643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:04.488643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:04.488643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:04.489527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:04.489527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:04.489527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:04.489527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:04.489527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:34:04.489527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:34:04.489527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:34:04.489527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:34:04.489527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:34:04.489527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:34:04.489527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 18:34:04.489527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:04.489527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 479/973] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Jun 27 18:34:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:04.493723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214b42-677a-4526-bb94-d68cf726e3c9 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:04.511083 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac00d0-5de6-42af-a41b-9a4c78b3fa21 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:04.610961 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf214b42-677a-4526-bb94-d68cf726e3c9 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:04.616512 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac00d0-5de6-42af-a41b-9a4c78b3fa21 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:04.640645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:04.643787 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:04.652347 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae682b-6070-4e00-948b-633df5b18bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:04.653150 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae682b-6070-4e00-948b-633df5b18bdd None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:04.653375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fb78d-549d-4f18-b2ac-a8dbafc0908a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:04.653491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae682b-6070-4e00-948b-633df5b18bdd None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:04.653698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae682b-6070-4e00-948b-633df5b18bdd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:04.654038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fb78d-549d-4f18-b2ac-a8dbafc0908a None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:04.654321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fb78d-549d-4f18-b2ac-a8dbafc0908a None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:04.654417 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae682b-6070-4e00-948b-633df5b18bdd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:04.654597 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83fb78d-549d-4f18-b2ac-a8dbafc0908a None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:04.655340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83fb78d-549d-4f18-b2ac-a8dbafc0908a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:04.655798 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83fb78d-549d-4f18-b2ac-a8dbafc0908a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:04.655895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae682b-6070-4e00-948b-633df5b18bdd None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:04.657357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83fb78d-549d-4f18-b2ac-a8dbafc0908a None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:04.665951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 495/974] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Jun 27 18:34:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:04.668954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-0aae682b-6070-4e00-948b-633df5b18bdd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 18:34:04.668954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:04.668954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:34:04.668954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:34:04.668954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:34:04.668954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:34:04.668954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:34:04.668954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:04.668954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 18:34:04.668954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:04.668954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:34:04.668954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:04.668954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:04.668954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:04.668954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:04.668954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:04.668954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:04.670051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:04.670051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:04.670051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:04.670051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:04.670051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:04.670051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:04.670051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:34:04.670051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:34:04.670051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:34:04.670051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:34:04.670051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:04.670051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:04.670051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:04.670051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:04.670051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:04.670051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:04.672740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:04.672740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:04.672740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:04.672740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:04.672740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:04.672740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:04.672740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:04.672740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:04.672740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:04.672740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:04.672740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:34:04.672740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:04.672740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 18:34:04.672740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:04.672740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 480/975] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jun 27 18:34:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:04.675727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae682b-6070-4e00-948b-633df5b18bdd None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:04.675832 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fb78d-549d-4f18-b2ac-a8dbafc0908a None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:04.780219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83fb78d-549d-4f18-b2ac-a8dbafc0908a None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:04.780672 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae682b-6070-4e00-948b-633df5b18bdd None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:04.814219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae57483-b3e0-45e7-b7d2-0a2fbcd98bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:04.814667 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad1f83-4312-4989-8164-9c445bfe8f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:04.815095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57483-b3e0-45e7-b7d2-0a2fbcd98bb2 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:04.815559 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad1f83-4312-4989-8164-9c445bfe8f6c None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:04.815653 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57483-b3e0-45e7-b7d2-0a2fbcd98bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:04.815729 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad1f83-4312-4989-8164-9c445bfe8f6c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:04.815917 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae57483-b3e0-45e7-b7d2-0a2fbcd98bb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:04.816022 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad1f83-4312-4989-8164-9c445bfe8f6c None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:04.816588 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad1f83-4312-4989-8164-9c445bfe8f6c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:04.816927 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad1f83-4312-4989-8164-9c445bfe8f6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:04.818827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad1f83-4312-4989-8164-9c445bfe8f6c None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:04.823936 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 481/976] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jun 27 18:34:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:04.828696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae57483-b3e0-45e7-b7d2-0a2fbcd98bb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:04.829557 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad1f83-4312-4989-8164-9c445bfe8f6c None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:04.829969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae57483-b3e0-45e7-b7d2-0a2fbcd98bb2 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:04.848533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-9ae57483-b3e0-45e7-b7d2-0a2fbcd98bb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:04.848533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:04.848533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:04.848533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:04.848533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:04.848533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:04.848533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:04.848533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:04.848533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:04.848533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:04.848533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:04.848533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:04.848533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:34:04.848533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:34:04.848533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:34:04.850336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:34:04.850336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:04.850336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:04.850336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:04.850336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:04.850336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:04.850336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:04.850336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:04.850336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:04.850336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:04.850336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:04.850336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:04.850336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:04.850336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:04.850336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:04.850336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:04.850336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:04.851691 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:34:04.851691 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:34:04.851691 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:04.851691 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:04.851691 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 496/977] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:04.855333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae57483-b3e0-45e7-b7d2-0a2fbcd98bb2 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:04.889021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:04.911494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:04.945981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad1f83-4312-4989-8164-9c445bfe8f6c None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:04.973109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae57483-b3e0-45e7-b7d2-0a2fbcd98bb2 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:04.980873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9797cf-7f71-41a1-987b-8fb6fe02eaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:04.981526 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9797cf-7f71-41a1-987b-8fb6fe02eaf2 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:04.981808 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9797cf-7f71-41a1-987b-8fb6fe02eaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:04.982081 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9797cf-7f71-41a1-987b-8fb6fe02eaf2 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:04.982778 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9797cf-7f71-41a1-987b-8fb6fe02eaf2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:04.983087 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9797cf-7f71-41a1-987b-8fb6fe02eaf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:04.984481 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9797cf-7f71-41a1-987b-8fb6fe02eaf2 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:04.989972 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 482/978] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jun 27 18:34:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:04.995604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9797cf-7f71-41a1-987b-8fb6fe02eaf2 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:05.010471 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35698f6-e04f-4bdd-8603-f35ab7443a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:05.011136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35698f6-e04f-4bdd-8603-f35ab7443a8f None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:05.011422 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35698f6-e04f-4bdd-8603-f35ab7443a8f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:05.011802 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35698f6-e04f-4bdd-8603-f35ab7443a8f None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:05.012589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35698f6-e04f-4bdd-8603-f35ab7443a8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:05.012905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35698f6-e04f-4bdd-8603-f35ab7443a8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:05.014376 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35698f6-e04f-4bdd-8603-f35ab7443a8f None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:05.030523 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 497/979] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:05.031631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35698f6-e04f-4bdd-8603-f35ab7443a8f None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:05.102222 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9797cf-7f71-41a1-987b-8fb6fe02eaf2 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:05.116120 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:05.136701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a7621-6eb4-45d7-aba2-a8c1c9a9e688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:05.137384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a7621-6eb4-45d7-aba2-a8c1c9a9e688 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:05.137643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a7621-6eb4-45d7-aba2-a8c1c9a9e688 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:05.137929 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a7621-6eb4-45d7-aba2-a8c1c9a9e688 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:05.138726 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a7621-6eb4-45d7-aba2-a8c1c9a9e688 None admin] RBAC: Adding query filter params (interface=admin, service_id=4a2de615aab84eb5bcf40132971e11bf, region_id=RegionOne) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:05.139095 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a7621-6eb4-45d7-aba2-a8c1c9a9e688 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:05.140442 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a7621-6eb4-45d7-aba2-a8c1c9a9e688 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:05.140863 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35698f6-e04f-4bdd-8603-f35ab7443a8f None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:05.142796 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:05.146214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 483/980] 10.222.0.36 () {56 vars in 1249 bytes} [Mon Jun 27 18:34:04 2022] GET /identity/v3/endpoints?service_id=4a2de615aab84eb5bcf40132971e11bf&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:05.151721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a7621-6eb4-45d7-aba2-a8c1c9a9e688 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:05.178485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44283e6-4330-4020-ab85-12094ccc9d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:05.179293 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44283e6-4330-4020-ab85-12094ccc9d8b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:05.179609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44283e6-4330-4020-ab85-12094ccc9d8b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:05.179878 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44283e6-4330-4020-ab85-12094ccc9d8b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:05.187386 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44283e6-4330-4020-ab85-12094ccc9d8b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:05.188905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44283e6-4330-4020-ab85-12094ccc9d8b None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:05.204573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-e44283e6-4330-4020-ab85-12094ccc9d8b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 18:34:05.204573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:05.204573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:05.204573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:05.204573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:05.204573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:05.204573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:05.204573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:05.204573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:05.204573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:05.204573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:05.204573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:05.204573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:34:05.204573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:34:05.204573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:34:05.204573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:05.205663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:05.211353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:05.211353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:05.211353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:34:05.211353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:34:05.211353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:34:05.211353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:34:05.211353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:34:05.211353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:34:05.211353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 27 18:34:05.211353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:05.211353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 498/981] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jun 27 18:34:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:34:05.211353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44283e6-4330-4020-ab85-12094ccc9d8b None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:05.273287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a7621-6eb4-45d7-aba2-a8c1c9a9e688 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:05.312743 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f809a08-d886-4338-b993-e213575a0b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:05.313404 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f809a08-d886-4338-b993-e213575a0b6e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:05.313693 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f809a08-d886-4338-b993-e213575a0b6e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:05.313969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f809a08-d886-4338-b993-e213575a0b6e None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:05.314649 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f809a08-d886-4338-b993-e213575a0b6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:05.315114 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44283e6-4330-4020-ab85-12094ccc9d8b None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:05.316046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f809a08-d886-4338-b993-e213575a0b6e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:05.322779 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 484/982] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jun 27 18:34:05 2022] GET /identity/v3/services => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:34:05.351715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcad2d2-0ccf-4c32-9995-e42fa459b452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:05.352409 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad2d2-0ccf-4c32-9995-e42fa459b452 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:05.352690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad2d2-0ccf-4c32-9995-e42fa459b452 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:05.352967 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad2d2-0ccf-4c32-9995-e42fa459b452 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:05.353820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcad2d2-0ccf-4c32-9995-e42fa459b452 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:05.354132 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcad2d2-0ccf-4c32-9995-e42fa459b452 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:05.355890 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcad2d2-0ccf-4c32-9995-e42fa459b452 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:05.376270 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 499/983] 10.222.0.36 () {56 vars in 1149 bytes} [Mon Jun 27 18:34:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:05.381945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f809a08-d886-4338-b993-e213575a0b6e None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:05.428866 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:05.488738 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f809a08-d886-4338-b993-e213575a0b6e None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:05.531138 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce55d59-587c-4cea-9f01-c5cd642de097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:05.531829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce55d59-587c-4cea-9f01-c5cd642de097 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:05.532114 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce55d59-587c-4cea-9f01-c5cd642de097 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:05.532389 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce55d59-587c-4cea-9f01-c5cd642de097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:05.599858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce55d59-587c-4cea-9f01-c5cd642de097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:05.601310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce55d59-587c-4cea-9f01-c5cd642de097 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:05.642096 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:05.700735 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 485/984] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:34:05 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:34:05.706703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcad2d2-0ccf-4c32-9995-e42fa459b452 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:05.729756 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:05.808018 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcad2d2-0ccf-4c32-9995-e42fa459b452 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:05.841766 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d4ca5-1cf8-4199-81fc-4615bf5eafb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:05.842575 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d4ca5-1cf8-4199-81fc-4615bf5eafb5 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:05.842995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d4ca5-1cf8-4199-81fc-4615bf5eafb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:05.843277 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d4ca5-1cf8-4199-81fc-4615bf5eafb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:05.854136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d4ca5-1cf8-4199-81fc-4615bf5eafb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:05.855859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d4ca5-1cf8-4199-81fc-4615bf5eafb5 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:05.873300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-ff8d4ca5-1cf8-4199-81fc-4615bf5eafb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:05.873300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:05.873300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:05.873300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:05.873300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:05.873300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:05.873300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:05.873300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:05.873300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:05.873300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:05.873300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:05.873300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:05.873300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:34:05.873300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:34:05.873300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:34:05.874346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:34:05.874346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:05.874346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:05.874346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:05.874346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:05.874346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:05.874346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:05.874346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:05.874346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:05.874346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:05.874346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:05.874346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:05.874346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:05.874346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:05.874346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:05.874346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:05.874346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:05.880687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:34:05.880687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:34:05.880687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:05.880687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:05.880687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 500/985] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:05.882429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce55d59-587c-4cea-9f01-c5cd642de097 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:05.982678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce55d59-587c-4cea-9f01-c5cd642de097 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:06.016156 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c70cc-0b13-46de-aa9f-1a3f72737a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:06.016817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c70cc-0b13-46de-aa9f-1a3f72737a0d None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:06.017099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c70cc-0b13-46de-aa9f-1a3f72737a0d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:06.017372 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c70cc-0b13-46de-aa9f-1a3f72737a0d None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:06.018097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c70cc-0b13-46de-aa9f-1a3f72737a0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:06.018407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c70cc-0b13-46de-aa9f-1a3f72737a0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:06.019788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c70cc-0b13-46de-aa9f-1a3f72737a0d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:06.031834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 486/986] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:06.037588 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d4ca5-1cf8-4199-81fc-4615bf5eafb5 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:06.116490 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:06.147036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d4ca5-1cf8-4199-81fc-4615bf5eafb5 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:06.181720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed60dcc-3659-4258-88c7-9c0d7d3af45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:06.182514 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed60dcc-3659-4258-88c7-9c0d7d3af45f None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:06.182799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed60dcc-3659-4258-88c7-9c0d7d3af45f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:06.183075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed60dcc-3659-4258-88c7-9c0d7d3af45f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:06.189617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed60dcc-3659-4258-88c7-9c0d7d3af45f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:06.191052 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed60dcc-3659-4258-88c7-9c0d7d3af45f None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:06.196430 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a5c8f-13ea-40a8-a353-b489052e0430 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:06.196730 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a5c8f-13ea-40a8-a353-b489052e0430 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:06.197017 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a5c8f-13ea-40a8-a353-b489052e0430 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:06.198456 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 487/987] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:34:06.203500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61b1bd-6bf6-4b6d-bc1f-2f9e67a31b2a None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:06.203840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61b1bd-6bf6-4b6d-bc1f-2f9e67a31b2a None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:06.204125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61b1bd-6bf6-4b6d-bc1f-2f9e67a31b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:06.204877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-9ed60dcc-3659-4258-88c7-9c0d7d3af45f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:34:06.204877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:06.204877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:06.204877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:06.204877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:06.204877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:06.204877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:06.204877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:06.204877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:06.204877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:06.204877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:06.204877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:06.204877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:34:06.204877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:34:06.204877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:34:06.205750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:34:06.205750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:06.205750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:06.205750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:06.205750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:06.205750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:06.205750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:06.205750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:06.205750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:06.205750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:06.205750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:06.205750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:06.205750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:06.205750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:06.205750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:06.205750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:06.205750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:06.206672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:34:06.206672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:34:06.206672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:34:06.206672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:34:06.206672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:34:06.206672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:34:06.206672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:34:06.206672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:06.209465 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:06.211092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 501/988] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:34:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:06.211630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed60dcc-3659-4258-88c7-9c0d7d3af45f None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:06.224028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-7c61b1bd-6bf6-4b6d-bc1f-2f9e67a31b2a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:06.225565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-7c61b1bd-6bf6-4b6d-bc1f-2f9e67a31b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:06.299852 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 488/989] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:34:06.322014 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61b1bd-6bf6-4b6d-bc1f-2f9e67a31b2a None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:06.334138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed60dcc-3659-4258-88c7-9c0d7d3af45f None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:06.365583 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:06.371836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97672788-8fe0-4dac-9e6b-9bbefc50089c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:06.372500 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97672788-8fe0-4dac-9e6b-9bbefc50089c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:06.372789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97672788-8fe0-4dac-9e6b-9bbefc50089c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:06.373066 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97672788-8fe0-4dac-9e6b-9bbefc50089c None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:06.373850 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97672788-8fe0-4dac-9e6b-9bbefc50089c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:06.374994 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97672788-8fe0-4dac-9e6b-9bbefc50089c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:06.375676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97672788-8fe0-4dac-9e6b-9bbefc50089c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:06.389161 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 502/990] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:34:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:06.395864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97672788-8fe0-4dac-9e6b-9bbefc50089c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:06.430423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61b1bd-6bf6-4b6d-bc1f-2f9e67a31b2a None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:06.462985 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:06.468584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd603e2-6c93-4a3d-8c3a-9c4c4085e846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:06.469386 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd603e2-6c93-4a3d-8c3a-9c4c4085e846 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:06.469678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd603e2-6c93-4a3d-8c3a-9c4c4085e846 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:06.469959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd603e2-6c93-4a3d-8c3a-9c4c4085e846 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:06.472554 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd603e2-6c93-4a3d-8c3a-9c4c4085e846 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:06.472554 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd603e2-6c93-4a3d-8c3a-9c4c4085e846 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:06.485227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-6bd603e2-6c93-4a3d-8c3a-9c4c4085e846 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 18:34:06.485227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:06.485227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:34:06.485227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:34:06.485227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:34:06.485227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:34:06.485227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:34:06.485227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:06.485227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 18:34:06.485227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:06.485227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:34:06.485227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:06.485227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:06.485227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:06.485227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:06.485227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:06.485227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:06.486249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:06.486249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:06.486249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:06.486249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:06.486249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:06.486249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:06.486249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:34:06.486249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:34:06.486249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:34:06.486249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:34:06.486249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:06.486249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:06.486249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:06.486249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:06.486249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:06.486249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:06.487093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:06.487093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:06.487093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:06.487093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:06.487093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:06.487093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:06.487093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:06.487093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:06.487093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:06.487093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:06.487093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:34:06.487093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:06.487093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 18:34:06.487093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:06.491975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 489/991] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:34:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:34:06.493346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd603e2-6c93-4a3d-8c3a-9c4c4085e846 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:06.506388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97672788-8fe0-4dac-9e6b-9bbefc50089c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:06.549672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d6408-f003-4768-9524-beb613829cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:06.550425 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6408-f003-4768-9524-beb613829cb2 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:06.550660 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6408-f003-4768-9524-beb613829cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:06.550938 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d6408-f003-4768-9524-beb613829cb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:06.552619 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d6408-f003-4768-9524-beb613829cb2 None admin] RBAC: Adding query filter params (role.id=bd1fd5ae539d44b2be1d4ee708a949c9, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=6e6313c444eb4a788b6559eff17959f8) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:06.552941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d6408-f003-4768-9524-beb613829cb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:06.554390 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d6408-f003-4768-9524-beb613829cb2 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:06.560439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 503/992] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:34:06 2022] GET /identity/v3/role_assignments?user.id=6e6313c444eb4a788b6559eff17959f8&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=bd1fd5ae539d44b2be1d4ee708a949c9 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:06.605263 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd603e2-6c93-4a3d-8c3a-9c4c4085e846 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:06.643746 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd6e89-b027-4287-a82b-9460ef82d50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:06.644432 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd6e89-b027-4287-a82b-9460ef82d50d None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:06.644724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd6e89-b027-4287-a82b-9460ef82d50d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:06.645005 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd6e89-b027-4287-a82b-9460ef82d50d None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:06.645823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd6e89-b027-4287-a82b-9460ef82d50d None admin] RBAC: Adding query filter params (name=compute) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:06.646139 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd6e89-b027-4287-a82b-9460ef82d50d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:06.647546 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd6e89-b027-4287-a82b-9460ef82d50d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:06.653493 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 490/993] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jun 27 18:34:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:06.659230 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d6408-f003-4768-9524-beb613829cb2 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:06.721525 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:06.771237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d6408-f003-4768-9524-beb613829cb2 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:06.806974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76619582-c326-46b0-bc1c-2e2b78524849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:06.807676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76619582-c326-46b0-bc1c-2e2b78524849 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:06.807941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76619582-c326-46b0-bc1c-2e2b78524849 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:06.808220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76619582-c326-46b0-bc1c-2e2b78524849 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:06.808932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76619582-c326-46b0-bc1c-2e2b78524849 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:06.809246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76619582-c326-46b0-bc1c-2e2b78524849 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:06.810620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76619582-c326-46b0-bc1c-2e2b78524849 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:06.815812 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 504/994] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jun 27 18:34:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:06.821705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd6e89-b027-4287-a82b-9460ef82d50d None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:06.883241 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:06.925711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd6e89-b027-4287-a82b-9460ef82d50d None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:06.959494 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c0f8d-f1b8-4068-9b30-1d51fdb45b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:06.960193 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c0f8d-f1b8-4068-9b30-1d51fdb45b75 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:06.960479 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c0f8d-f1b8-4068-9b30-1d51fdb45b75 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:06.960759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c0f8d-f1b8-4068-9b30-1d51fdb45b75 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:06.961556 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c0f8d-f1b8-4068-9b30-1d51fdb45b75 None admin] RBAC: Adding query filter params (interface=public, service_id=4577f39459704510a0b8e2f700570c7a, region_id=RegionOne) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:06.961876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c0f8d-f1b8-4068-9b30-1d51fdb45b75 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:06.963249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c0f8d-f1b8-4068-9b30-1d51fdb45b75 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:06.968530 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 491/995] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Jun 27 18:34:06 2022] GET /identity/v3/endpoints?service_id=4577f39459704510a0b8e2f700570c7a&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:06.974497 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76619582-c326-46b0-bc1c-2e2b78524849 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:07.074522 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76619582-c326-46b0-bc1c-2e2b78524849 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:07.094893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:07.110069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002926e8-9459-4a24-9823-1efb84469e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:07.110742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002926e8-9459-4a24-9823-1efb84469e23 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:07.111136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002926e8-9459-4a24-9823-1efb84469e23 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:07.111377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002926e8-9459-4a24-9823-1efb84469e23 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:07.112105 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002926e8-9459-4a24-9823-1efb84469e23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:07.113492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002926e8-9459-4a24-9823-1efb84469e23 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:07.120231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 505/996] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jun 27 18:34:06 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:34:07.353794 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6711296-03f8-4697-8798-1191503afa50 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:07.354131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6711296-03f8-4697-8798-1191503afa50 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:07.354306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6711296-03f8-4697-8798-1191503afa50 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:07.356096 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 492/997] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:07.360993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6990a6-3802-45bc-bce0-c900b3b03384 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:07.361288 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6990a6-3802-45bc-bce0-c900b3b03384 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:07.361570 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6990a6-3802-45bc-bce0-c900b3b03384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:07.378653 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-1b6990a6-3802-45bc-bce0-c900b3b03384 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:07.380432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-1b6990a6-3802-45bc-bce0-c900b3b03384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:07.448333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 506/998] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:07.471285 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6711296-03f8-4697-8798-1191503afa50 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:07.582351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6711296-03f8-4697-8798-1191503afa50 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:07.607245 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:07.618807 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e230e-c73f-4493-bffe-f14bfcd3f543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:07.619867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e230e-c73f-4493-bffe-f14bfcd3f543 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:07.620326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e230e-c73f-4493-bffe-f14bfcd3f543 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:07.620777 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e230e-c73f-4493-bffe-f14bfcd3f543 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:07.621604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e230e-c73f-4493-bffe-f14bfcd3f543 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:07.625511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e230e-c73f-4493-bffe-f14bfcd3f543 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:07.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-938e230e-c73f-4493-bffe-f14bfcd3f543 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 18:34:07.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:07.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:34:07.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:34:07.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:34:07.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:34:07.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:34:07.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:07.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 18:34:07.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:07.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:34:07.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:07.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:07.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:07.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:07.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:07.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:07.636602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:07.636602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:07.636602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:07.636602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:07.636602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:07.636602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:07.636602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:34:07.636602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:34:07.636602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:34:07.636602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:34:07.636602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:07.636602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:07.636602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:07.636602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:07.636602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:07.636602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:07.637454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:07.637454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:07.637454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:07.637454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:07.637454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:07.637454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:07.637454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:07.637454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:07.637454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:07.637454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:07.637454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:34:07.637454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:07.637454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 27 18:34:07.637454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:07.639929 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 493/999] 10.222.0.36 () {56 vars in 1126 bytes} [Mon Jun 27 18:34:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:07.642666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6990a6-3802-45bc-bce0-c900b3b03384 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:07.745059 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6990a6-3802-45bc-bce0-c900b3b03384 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:07.759428 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:07.779873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0f2c5-854e-49e8-87d7-2caa7d9e9017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:07.780593 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0f2c5-854e-49e8-87d7-2caa7d9e9017 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:07.780881 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0f2c5-854e-49e8-87d7-2caa7d9e9017 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:07.781160 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0f2c5-854e-49e8-87d7-2caa7d9e9017 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:07.781867 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0f2c5-854e-49e8-87d7-2caa7d9e9017 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:07.782178 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0f2c5-854e-49e8-87d7-2caa7d9e9017 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:07.783563 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0f2c5-854e-49e8-87d7-2caa7d9e9017 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:07.793948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 507/1000] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jun 27 18:34:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:07.795196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e230e-c73f-4493-bffe-f14bfcd3f543 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:07.898206 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e230e-c73f-4493-bffe-f14bfcd3f543 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:07.930628 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd733ef-b590-4db0-8490-9e61f17d5efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:07.931276 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd733ef-b590-4db0-8490-9e61f17d5efc None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:07.931580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd733ef-b590-4db0-8490-9e61f17d5efc None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:07.931865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd733ef-b590-4db0-8490-9e61f17d5efc None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:07.932562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd733ef-b590-4db0-8490-9e61f17d5efc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:07.932868 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd733ef-b590-4db0-8490-9e61f17d5efc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:07.934218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd733ef-b590-4db0-8490-9e61f17d5efc None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:07.939133 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 494/1001] 10.222.0.36 () {56 vars in 1122 bytes} [Mon Jun 27 18:34:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:07.945121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0f2c5-854e-49e8-87d7-2caa7d9e9017 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:08.041599 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0f2c5-854e-49e8-87d7-2caa7d9e9017 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:08.075408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4bfe98-6b38-44a3-bb30-470368466461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:08.076086 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bfe98-6b38-44a3-bb30-470368466461 None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:08.076369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bfe98-6b38-44a3-bb30-470368466461 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:08.076647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4bfe98-6b38-44a3-bb30-470368466461 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:08.077387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bfe98-6b38-44a3-bb30-470368466461 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:08.078751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4bfe98-6b38-44a3-bb30-470368466461 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:08.154157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 508/1002] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jun 27 18:34:07 2022] POST /identity/v3/endpoints => generated 325 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:34:08.634552 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe678-92d5-4113-8a8a-c9b1978cc147 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:08.634876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe678-92d5-4113-8a8a-c9b1978cc147 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:08.635119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fe678-92d5-4113-8a8a-c9b1978cc147 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:08.636669 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 495/1003] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:08.641570 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315969-a0a0-4805-a1a3-63c923ec22c0 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:08.641866 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315969-a0a0-4805-a1a3-63c923ec22c0 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:08.642149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22315969-a0a0-4805-a1a3-63c923ec22c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:08.659049 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-22315969-a0a0-4805-a1a3-63c923ec22c0 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:08.660276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-22315969-a0a0-4805-a1a3-63c923ec22c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:08.690124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:08.735169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 509/1004] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:08 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:08.757019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fe678-92d5-4113-8a8a-c9b1978cc147 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:08.811749 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:08.861317 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fe678-92d5-4113-8a8a-c9b1978cc147 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:08.895852 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf75c74-7b45-448c-bba1-03fa5ebfed99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:08.896644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf75c74-7b45-448c-bba1-03fa5ebfed99 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:08.896963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf75c74-7b45-448c-bba1-03fa5ebfed99 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:08.897251 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf75c74-7b45-448c-bba1-03fa5ebfed99 None admin] PATH_INFO: `/v3/services/image` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:08.897902 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf75c74-7b45-448c-bba1-03fa5ebfed99 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:08.899264 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf75c74-7b45-448c-bba1-03fa5ebfed99 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:08.911063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-7cf75c74-7b45-448c-bba1-03fa5ebfed99 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 18:34:08.911063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:08.911063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:34:08.911063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:34:08.911063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:34:08.911063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:34:08.911063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:34:08.911063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:08.911063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 18:34:08.911063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:08.911063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:34:08.911063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:08.911063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:08.911063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:08.911063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:08.911063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:08.911063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:08.912253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:08.912253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:08.912253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:08.912253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:08.912253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:08.912253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:08.912253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:34:08.912253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:34:08.912253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:34:08.912253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:34:08.912253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:08.912253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:08.912253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:08.912253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:08.912253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:08.912253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:08.913122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:08.913122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:08.913122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:08.913122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:08.913122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:08.913122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:08.913122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:08.913122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:08.913122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:08.913122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:08.913122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:34:08.913122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:08.913122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 18:34:08.913122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:08.914406 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 496/1005] 10.222.0.36 () {56 vars in 1105 bytes} [Mon Jun 27 18:34:08 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:08.918329 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22315969-a0a0-4805-a1a3-63c923ec22c0 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:09.016946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22315969-a0a0-4805-a1a3-63c923ec22c0 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:09.050435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c793d-3d52-482c-99bf-00169267e7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:09.051170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c793d-3d52-482c-99bf-00169267e7b7 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:09.051402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c793d-3d52-482c-99bf-00169267e7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:09.051707 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c793d-3d52-482c-99bf-00169267e7b7 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:09.052412 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c793d-3d52-482c-99bf-00169267e7b7 None admin] RBAC: Adding query filter params (name=image) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:09.052722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c793d-3d52-482c-99bf-00169267e7b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:09.054086 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998c793d-3d52-482c-99bf-00169267e7b7 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:09.063587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 510/1006] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:09.064604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf75c74-7b45-448c-bba1-03fa5ebfed99 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:09.165194 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf75c74-7b45-448c-bba1-03fa5ebfed99 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:09.181077 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:09.189057 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034c116-54d1-4e7b-ba58-1ec2d9897462 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:09.189352 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034c116-54d1-4e7b-ba58-1ec2d9897462 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:09.191608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034c116-54d1-4e7b-ba58-1ec2d9897462 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:09.191608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 511/1007] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:34:09.196634 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d823802-0a19-4455-85b5-eae856201faf None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:09.196958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d823802-0a19-4455-85b5-eae856201faf None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:09.197306 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d823802-0a19-4455-85b5-eae856201faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:09.200129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec3b6f-45d1-4f35-afac-dcece23bc2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:09.200788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec3b6f-45d1-4f35-afac-dcece23bc2cd None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:09.201077 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec3b6f-45d1-4f35-afac-dcece23bc2cd None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:09.201353 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec3b6f-45d1-4f35-afac-dcece23bc2cd None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:09.202062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec3b6f-45d1-4f35-afac-dcece23bc2cd None admin] RBAC: Adding query filter params (type=image) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:09.202375 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec3b6f-45d1-4f35-afac-dcece23bc2cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:09.203776 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec3b6f-45d1-4f35-afac-dcece23bc2cd None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:09.209497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 497/1008] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:09 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:09.220102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-6d823802-0a19-4455-85b5-eae856201faf None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:09.221349 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-6d823802-0a19-4455-85b5-eae856201faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:09.248987 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:09.303298 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 512/1009] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:09 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:34:09.327159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec3b6f-45d1-4f35-afac-dcece23bc2cd None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:09.433159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec3b6f-45d1-4f35-afac-dcece23bc2cd None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:09.465867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b2137-58a4-4aa9-bcef-91db6c0699a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:09.466657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b2137-58a4-4aa9-bcef-91db6c0699a5 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:09.466946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b2137-58a4-4aa9-bcef-91db6c0699a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:09.467224 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b2137-58a4-4aa9-bcef-91db6c0699a5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:09.467909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b2137-58a4-4aa9-bcef-91db6c0699a5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:09.469276 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b2137-58a4-4aa9-bcef-91db6c0699a5 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:09.481305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-590b2137-58a4-4aa9-bcef-91db6c0699a5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 18:34:09.481305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:09.481305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:34:09.481305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:34:09.481305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:34:09.481305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:34:09.481305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:34:09.481305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:09.481305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 18:34:09.481305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:09.481305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:34:09.481305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:09.481305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:09.481305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:09.481305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:09.481305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:09.481305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:09.482361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:09.482361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:09.482361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:09.482361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:09.482361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:09.482361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:09.482361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:34:09.482361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:34:09.482361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:34:09.482361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:34:09.482361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:09.482361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:09.482361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:09.482361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:09.482361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:09.482361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:09.483219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:09.483219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:09.483219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:09.483219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:09.483219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:09.483219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:09.483219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:09.483219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:09.483219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:09.483219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:09.483219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:34:09.483219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:09.483219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 27 18:34:09.483219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:09.487358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 498/1010] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:34:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:09.489216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d823802-0a19-4455-85b5-eae856201faf None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:09.597311 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d823802-0a19-4455-85b5-eae856201faf None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:09.633135 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb14154-21e7-4bd6-87e3-f70f4ebc0321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:09.633813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb14154-21e7-4bd6-87e3-f70f4ebc0321 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:09.634082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb14154-21e7-4bd6-87e3-f70f4ebc0321 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:09.634355 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb14154-21e7-4bd6-87e3-f70f4ebc0321 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:09.635060 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb14154-21e7-4bd6-87e3-f70f4ebc0321 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:09.635368 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb14154-21e7-4bd6-87e3-f70f4ebc0321 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:09.636771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb14154-21e7-4bd6-87e3-f70f4ebc0321 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:09.646213 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 513/1011] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jun 27 18:34:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:09.647761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b2137-58a4-4aa9-bcef-91db6c0699a5 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:09.697904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:09.753628 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b2137-58a4-4aa9-bcef-91db6c0699a5 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:09.787460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6be1a-d349-4dca-9ed1-5c8150bb9290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:09.788152 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6be1a-d349-4dca-9ed1-5c8150bb9290 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:09.788441 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6be1a-d349-4dca-9ed1-5c8150bb9290 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:09.788721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6be1a-d349-4dca-9ed1-5c8150bb9290 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:09.789440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6be1a-d349-4dca-9ed1-5c8150bb9290 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:09.789756 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6be1a-d349-4dca-9ed1-5c8150bb9290 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:09.791130 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6be1a-d349-4dca-9ed1-5c8150bb9290 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:09.796208 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 499/1012] 10.222.0.36 () {56 vars in 1112 bytes} [Mon Jun 27 18:34:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:09.802574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb14154-21e7-4bd6-87e3-f70f4ebc0321 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:09.827828 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:09.938400 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb14154-21e7-4bd6-87e3-f70f4ebc0321 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:09.971833 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b177f536-7c54-4d7c-ba79-294c5082b6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:09.972497 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177f536-7c54-4d7c-ba79-294c5082b6ee None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:09.972781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177f536-7c54-4d7c-ba79-294c5082b6ee None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:09.973582 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177f536-7c54-4d7c-ba79-294c5082b6ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:09.974330 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177f536-7c54-4d7c-ba79-294c5082b6ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:09.975799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b177f536-7c54-4d7c-ba79-294c5082b6ee None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:10.067338 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 514/1013] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jun 27 18:34:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:34:10.196733 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff17f7-8302-4d8c-8dc5-a1586313563b None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:10.197261 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff17f7-8302-4d8c-8dc5-a1586313563b None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:10.197261 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cff17f7-8302-4d8c-8dc5-a1586313563b None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:10.198724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 500/1014] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:10.204005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b17fd-d643-4e3d-b150-162b4e06047c None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:10.204297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b17fd-d643-4e3d-b150-162b4e06047c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:10.204579 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65b17fd-d643-4e3d-b150-162b4e06047c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:10.221726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-d65b17fd-d643-4e3d-b150-162b4e06047c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:10.222916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-d65b17fd-d643-4e3d-b150-162b4e06047c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:10.296033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 515/1015] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:10 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:10.319902 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff17f7-8302-4d8c-8dc5-a1586313563b None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:10.425195 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cff17f7-8302-4d8c-8dc5-a1586313563b None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:10.434864 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:10.459806 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612009fe-4777-49c3-aba2-18fbd1876597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:10.460526 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612009fe-4777-49c3-aba2-18fbd1876597 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:10.460811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612009fe-4777-49c3-aba2-18fbd1876597 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:10.461086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612009fe-4777-49c3-aba2-18fbd1876597 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:10.462251 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612009fe-4777-49c3-aba2-18fbd1876597 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:10.463715 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612009fe-4777-49c3-aba2-18fbd1876597 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:10.465486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 501/1016] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:10.471009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b17fd-d643-4e3d-b150-162b4e06047c None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:10.475717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:10.577416 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65b17fd-d643-4e3d-b150-162b4e06047c None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:10.611467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03f20f-951c-4e8b-9207-8a40c8303100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:10.612150 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03f20f-951c-4e8b-9207-8a40c8303100 None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:10.612434 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03f20f-951c-4e8b-9207-8a40c8303100 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:10.612707 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03f20f-951c-4e8b-9207-8a40c8303100 None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:10.613413 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03f20f-951c-4e8b-9207-8a40c8303100 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:10.615384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03f20f-951c-4e8b-9207-8a40c8303100 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:10.697727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 516/1017] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jun 27 18:34:10 2022] POST /identity/v3/projects => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:34:11.292909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12ee01-32a0-4c0d-942d-79a2b57e6e1e None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:11.293465 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12ee01-32a0-4c0d-942d-79a2b57e6e1e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:11.293465 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12ee01-32a0-4c0d-942d-79a2b57e6e1e None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:11.295111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 502/1018] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:11.300203 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42483fc5-9e21-419c-ae50-e03aa5ee562c None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:11.300606 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42483fc5-9e21-419c-ae50-e03aa5ee562c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:11.300811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42483fc5-9e21-419c-ae50-e03aa5ee562c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:11.317809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-42483fc5-9e21-419c-ae50-e03aa5ee562c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:11.319002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-42483fc5-9e21-419c-ae50-e03aa5ee562c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:11.369976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:11.387684 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 517/1019] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:11 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:11.410937 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12ee01-32a0-4c0d-942d-79a2b57e6e1e None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:11.516166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12ee01-32a0-4c0d-942d-79a2b57e6e1e None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:11.551261 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bedf8-c5b9-40ac-974a-7b8f9bffd664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:11.551890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bedf8-c5b9-40ac-974a-7b8f9bffd664 None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:11.552181 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bedf8-c5b9-40ac-974a-7b8f9bffd664 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:11.552462 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bedf8-c5b9-40ac-974a-7b8f9bffd664 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:11.553199 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bedf8-c5b9-40ac-974a-7b8f9bffd664 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:11.554565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bedf8-c5b9-40ac-974a-7b8f9bffd664 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:11.663562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 503/1020] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jun 27 18:34:11 2022] POST /identity/v3/services => generated 242 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:34:12.200401 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d541a5-b45a-4222-a1e2-f27c77a98849 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:12.200767 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d541a5-b45a-4222-a1e2-f27c77a98849 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:12.200961 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d541a5-b45a-4222-a1e2-f27c77a98849 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:12.202479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 518/1021] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:12.207393 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad163a-3764-483d-92b0-2d4032fbb6ae None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:12.207727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad163a-3764-483d-92b0-2d4032fbb6ae None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:12.208013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad163a-3764-483d-92b0-2d4032fbb6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:12.224886 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-8cad163a-3764-483d-92b0-2d4032fbb6ae None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:12.226064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-8cad163a-3764-483d-92b0-2d4032fbb6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:12.255034 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:12.300354 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 504/1022] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:12.323490 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d541a5-b45a-4222-a1e2-f27c77a98849 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:12.428175 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d541a5-b45a-4222-a1e2-f27c77a98849 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:12.463734 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0677a-9e57-48e8-9edd-abae98b87bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:12.464466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0677a-9e57-48e8-9edd-abae98b87bd6 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:12.464746 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0677a-9e57-48e8-9edd-abae98b87bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:12.465020 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d0677a-9e57-48e8-9edd-abae98b87bd6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:12.475801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d0677a-9e57-48e8-9edd-abae98b87bd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:34:12.484214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-f0d0677a-9e57-48e8-9edd-abae98b87bd6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 18:34:12.484214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:12.484214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:12.484214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:12.484214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:12.484214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:12.484214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:12.484214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:12.484214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:12.484214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:12.484214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:12.484214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:12.484214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:34:12.484214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:34:12.484214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:34:12.484214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:34:12.485153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:34:12.485153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:34:12.485153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:34:12.485153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:34:12.485153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:12.485153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:12.485153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:12.485153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:12.485153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:12.485153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:12.485153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:12.485153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:12.485153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:12.485153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:12.485153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:12.485153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:12.486025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:12.486025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:12.486025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:12.486025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:12.486025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:34:12.486025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:34:12.486025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:34:12.486025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:34:12.486025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:34:12.486025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:34:12.486025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 18:34:12.486025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:12.487267 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 519/1023] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Jun 27 18:34:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:12.491844 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad163a-3764-483d-92b0-2d4032fbb6ae None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:12.600434 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad163a-3764-483d-92b0-2d4032fbb6ae None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:12.634818 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928876bc-0ec5-4ccb-b295-ad5e438b0a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:12.635502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928876bc-0ec5-4ccb-b295-ad5e438b0a0a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:12.635844 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928876bc-0ec5-4ccb-b295-ad5e438b0a0a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:12.636159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928876bc-0ec5-4ccb-b295-ad5e438b0a0a None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:12.636939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928876bc-0ec5-4ccb-b295-ad5e438b0a0a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:12.637273 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928876bc-0ec5-4ccb-b295-ad5e438b0a0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:12.638639 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928876bc-0ec5-4ccb-b295-ad5e438b0a0a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:12.651768 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 505/1024] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Jun 27 18:34:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:12.653031 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0677a-9e57-48e8-9edd-abae98b87bd6 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:12.702763 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:12.757187 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08462d3-2469-4525-a3e6-c08b7f98773a None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:12.757438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08462d3-2469-4525-a3e6-c08b7f98773a None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:12.757881 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08462d3-2469-4525-a3e6-c08b7f98773a None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:12.758557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d0677a-9e57-48e8-9edd-abae98b87bd6 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:12.759617 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 506/1025] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:12.765170 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a19192-02bc-47ca-94c6-8d7b931f80da None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:12.765537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a19192-02bc-47ca-94c6-8d7b931f80da None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:12.765855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a19192-02bc-47ca-94c6-8d7b931f80da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:12.784553 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-08a19192-02bc-47ca-94c6-8d7b931f80da None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:12.786239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-08a19192-02bc-47ca-94c6-8d7b931f80da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:12.796754 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532df9d-64fc-44f9-aab2-57c720dc7042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:12.797559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532df9d-64fc-44f9-aab2-57c720dc7042 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:12.797855 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532df9d-64fc-44f9-aab2-57c720dc7042 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:12.798131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532df9d-64fc-44f9-aab2-57c720dc7042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:12.806281 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:12.809976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532df9d-64fc-44f9-aab2-57c720dc7042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:12.811435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532df9d-64fc-44f9-aab2-57c720dc7042 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:12.829027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-9532df9d-64fc-44f9-aab2-57c720dc7042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:12.829027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:12.829027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:12.829027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:12.829027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:12.829027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:12.829027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:12.829027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:12.829027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:12.829027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:12.829027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:12.829027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:12.829027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:34:12.829027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:34:12.829027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:34:12.830009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:34:12.830009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:12.830009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:12.830009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:12.830009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:12.830009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:12.830009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:12.830009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:12.830009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:12.830009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:12.830009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:12.830009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:12.830009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:12.830009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:12.830009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:12.830009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:12.830009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:12.830944 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:34:12.830944 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:34:12.830944 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:12.830944 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:12.834991 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 520/1026] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:12.835759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532df9d-64fc-44f9-aab2-57c720dc7042 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:12.861804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 507/1027] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:34:12.886737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a19192-02bc-47ca-94c6-8d7b931f80da None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:12.939818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:12.943271 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532df9d-64fc-44f9-aab2-57c720dc7042 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:12.977205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3db54-6471-4880-8860-fb1d3050e07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:12.978357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3db54-6471-4880-8860-fb1d3050e07e None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:12.978667 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3db54-6471-4880-8860-fb1d3050e07e None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:12.978951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3db54-6471-4880-8860-fb1d3050e07e None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:12.979775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3db54-6471-4880-8860-fb1d3050e07e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:12.980095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3db54-6471-4880-8860-fb1d3050e07e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:12.981744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3db54-6471-4880-8860-fb1d3050e07e None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:12.992547 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a19192-02bc-47ca-94c6-8d7b931f80da None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:12.994352 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 521/1028] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:12.999604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3db54-6471-4880-8860-fb1d3050e07e None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:13.033467 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea05bc-51ac-4228-b461-bd21e631abae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:13.034219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea05bc-51ac-4228-b461-bd21e631abae None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:13.034482 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea05bc-51ac-4228-b461-bd21e631abae None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:13.034750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea05bc-51ac-4228-b461-bd21e631abae None admin] PATH_INFO: `/v3/domains/default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:13.036670 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea05bc-51ac-4228-b461-bd21e631abae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:13.037951 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ea05bc-51ac-4228-b461-bd21e631abae None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:13.043578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 508/1029] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:13.045052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea05bc-51ac-4228-b461-bd21e631abae None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:13.069296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:13.109802 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3db54-6471-4880-8860-fb1d3050e07e None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:13.147145 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea05bc-51ac-4228-b461-bd21e631abae None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:13.150867 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfad4e5-b732-40cb-99bd-10b491697293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:13.151688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfad4e5-b732-40cb-99bd-10b491697293 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:13.151975 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfad4e5-b732-40cb-99bd-10b491697293 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:13.152257 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfad4e5-b732-40cb-99bd-10b491697293 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:13.159915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfad4e5-b732-40cb-99bd-10b491697293 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:13.162159 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfad4e5-b732-40cb-99bd-10b491697293 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:13.177842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-bdfad4e5-b732-40cb-99bd-10b491697293 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:34:13.177842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:13.177842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:13.177842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:13.177842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:13.177842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:13.177842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:13.177842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:13.177842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:13.177842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:13.177842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:13.177842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:13.177842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:34:13.177842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:34:13.177842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:34:13.177842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:13.178941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:13.179969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:13.179969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:13.179969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:34:13.179969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:34:13.179969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:34:13.179969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:34:13.179969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:34:13.179969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:34:13.179969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:34:13.179969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:13.179969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 522/1030] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jun 27 18:34:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:34:13.184369 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864fc33-87d9-47c6-b52f-ee99c44d2eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:13.184574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfad4e5-b732-40cb-99bd-10b491697293 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:13.185101 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864fc33-87d9-47c6-b52f-ee99c44d2eb0 None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:13.185395 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864fc33-87d9-47c6-b52f-ee99c44d2eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:13.185675 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864fc33-87d9-47c6-b52f-ee99c44d2eb0 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:13.186435 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864fc33-87d9-47c6-b52f-ee99c44d2eb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:13.187995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864fc33-87d9-47c6-b52f-ee99c44d2eb0 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:13.204109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:13.284010 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfad4e5-b732-40cb-99bd-10b491697293 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:13.291133 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 509/1031] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:34:13 2022] POST /identity/v3/users => generated 285 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:34:13.332955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e595e3-3810-4fc9-875d-450d874557b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:13.333633 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e595e3-3810-4fc9-875d-450d874557b3 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:13.333961 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e595e3-3810-4fc9-875d-450d874557b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:13.334254 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e595e3-3810-4fc9-875d-450d874557b3 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:13.335108 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e595e3-3810-4fc9-875d-450d874557b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:13.335417 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e595e3-3810-4fc9-875d-450d874557b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:13.336950 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e595e3-3810-4fc9-875d-450d874557b3 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:13.362812 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 523/1032] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jun 27 18:34:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:13.364590 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864fc33-87d9-47c6-b52f-ee99c44d2eb0 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:13.457499 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:13.485866 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864fc33-87d9-47c6-b52f-ee99c44d2eb0 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:13.534821 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28146032-121c-43e8-91c4-5107a237ab68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:13.535961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28146032-121c-43e8-91c4-5107a237ab68 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:13.536245 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28146032-121c-43e8-91c4-5107a237ab68 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:13.536517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28146032-121c-43e8-91c4-5107a237ab68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:13.623208 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28146032-121c-43e8-91c4-5107a237ab68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:13.624739 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28146032-121c-43e8-91c4-5107a237ab68 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:13.706948 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:13.727219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c53006-7806-4007-9e50-39bdd8d30f86 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:13.727648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c53006-7806-4007-9e50-39bdd8d30f86 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:13.727871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c53006-7806-4007-9e50-39bdd8d30f86 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:13.733183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 524/1033] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:13.734785 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ef60f-584a-4098-b7ee-6998d4556f40 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:13.735081 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ef60f-584a-4098-b7ee-6998d4556f40 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:13.735359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ef60f-584a-4098-b7ee-6998d4556f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:13.736899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 510/1034] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:34:13 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:34:13.742884 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28146032-121c-43e8-91c4-5107a237ab68 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:13.755474 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-9e0ef60f-584a-4098-b7ee-6998d4556f40 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:13.756750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9e0ef60f-584a-4098-b7ee-6998d4556f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:13.841421 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 525/1035] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:13.865989 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ef60f-584a-4098-b7ee-6998d4556f40 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:13.874261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:13.878873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28146032-121c-43e8-91c4-5107a237ab68 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:13.915756 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42cab3-e6e7-40a9-b9d7-7e332ab8d92b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:13.916549 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42cab3-e6e7-40a9-b9d7-7e332ab8d92b None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:13.916833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42cab3-e6e7-40a9-b9d7-7e332ab8d92b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:13.917097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b42cab3-e6e7-40a9-b9d7-7e332ab8d92b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:13.928040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42cab3-e6e7-40a9-b9d7-7e332ab8d92b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:13.929482 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b42cab3-e6e7-40a9-b9d7-7e332ab8d92b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:13.947457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-1b42cab3-e6e7-40a9-b9d7-7e332ab8d92b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:13.947457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:13.947457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:13.947457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:13.947457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:13.947457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:13.947457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:13.947457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:13.947457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:13.947457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:13.947457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:13.947457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:13.947457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:34:13.947457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:34:13.947457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:34:13.948503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:34:13.948503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:13.948503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:13.948503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:13.948503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:13.948503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:13.948503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:13.948503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:13.948503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:13.948503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:13.948503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:13.948503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:13.948503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:13.948503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:13.948503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:13.948503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:13.948503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:13.949433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:34:13.949433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:34:13.949433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:13.949433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:13.949433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 511/1036] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:34:13.954016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42cab3-e6e7-40a9-b9d7-7e332ab8d92b None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:13.973495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ef60f-584a-4098-b7ee-6998d4556f40 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:13.985434 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:14.009293 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314c7c4-f05e-40d2-8260-ae901f3a8057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:14.010087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314c7c4-f05e-40d2-8260-ae901f3a8057 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:14.010497 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314c7c4-f05e-40d2-8260-ae901f3a8057 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:14.010789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7314c7c4-f05e-40d2-8260-ae901f3a8057 None admin] PATH_INFO: `/v3/services/image` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:14.011448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314c7c4-f05e-40d2-8260-ae901f3a8057 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:14.012860 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7314c7c4-f05e-40d2-8260-ae901f3a8057 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:14.025092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-7314c7c4-f05e-40d2-8260-ae901f3a8057 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 18:34:14.025092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:14.025092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:34:14.025092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:34:14.025092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:34:14.025092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:34:14.025092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:34:14.025092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:14.025092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 18:34:14.025092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:14.025092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:34:14.025092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:14.025092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:14.025092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:14.025092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:14.025092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:14.025092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:14.026101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:14.026101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:14.026101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:14.026101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:14.026101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:14.026101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:14.026101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:34:14.026101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:34:14.026101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:34:14.026101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:34:14.026101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:14.026101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:14.026101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:14.026101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:14.026101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:14.026101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:14.027547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:14.027547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:14.027547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:14.027547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:14.027547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:14.027547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:14.027547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:14.027547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:14.027547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:14.027547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:14.027547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:34:14.027547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:14.027547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 18:34:14.027547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:14.027547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 526/1037] 10.222.0.36 () {56 vars in 1105 bytes} [Mon Jun 27 18:34:13 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:34:14.031982 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314c7c4-f05e-40d2-8260-ae901f3a8057 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:14.064607 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b42cab3-e6e7-40a9-b9d7-7e332ab8d92b None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:14.106158 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:14.106331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055e4ed-0ced-47af-abda-92d481c14cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:14.107426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055e4ed-0ced-47af-abda-92d481c14cd6 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:14.107426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055e4ed-0ced-47af-abda-92d481c14cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:14.107426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c055e4ed-0ced-47af-abda-92d481c14cd6 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:14.108404 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055e4ed-0ced-47af-abda-92d481c14cd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:14.108515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055e4ed-0ced-47af-abda-92d481c14cd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:14.109816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c055e4ed-0ced-47af-abda-92d481c14cd6 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:14.122188 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 512/1038] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:14.127861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055e4ed-0ced-47af-abda-92d481c14cd6 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:14.138568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7314c7c4-f05e-40d2-8260-ae901f3a8057 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:14.173902 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ed511-d9fe-4cc1-a36d-a78fd95eed55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:14.174560 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ed511-d9fe-4cc1-a36d-a78fd95eed55 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:14.174842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ed511-d9fe-4cc1-a36d-a78fd95eed55 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:14.175121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ed511-d9fe-4cc1-a36d-a78fd95eed55 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:14.175903 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ed511-d9fe-4cc1-a36d-a78fd95eed55 None admin] RBAC: Adding query filter params (name=image) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:14.176712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ed511-d9fe-4cc1-a36d-a78fd95eed55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:14.178075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ed511-d9fe-4cc1-a36d-a78fd95eed55 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:14.183251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 527/1039] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:14.188651 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ed511-d9fe-4cc1-a36d-a78fd95eed55 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:14.224816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:14.234706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c055e4ed-0ced-47af-abda-92d481c14cd6 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:14.272504 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710db1d-321a-40fc-ad8c-eb0aa52c03d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:14.273689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710db1d-321a-40fc-ad8c-eb0aa52c03d7 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:14.274157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710db1d-321a-40fc-ad8c-eb0aa52c03d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:14.274616 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710db1d-321a-40fc-ad8c-eb0aa52c03d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:14.282033 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710db1d-321a-40fc-ad8c-eb0aa52c03d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:14.283853 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710db1d-321a-40fc-ad8c-eb0aa52c03d7 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:14.289977 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ed511-d9fe-4cc1-a36d-a78fd95eed55 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:14.300377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-0710db1d-321a-40fc-ad8c-eb0aa52c03d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:34:14.300377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:14.300377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:14.300377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:14.300377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:14.300377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:14.300377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:14.300377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:14.300377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:14.300377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:14.300377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:14.300377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:14.300377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:34:14.300377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:34:14.300377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:34:14.301472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:34:14.301472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:14.301472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:14.301472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:14.301472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:14.301472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:14.301472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:14.301472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:14.301472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:14.301472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:14.301472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:14.301472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:14.301472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:14.301472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:14.301472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:14.301472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:14.301472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:14.302696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:34:14.302696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:34:14.302696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:34:14.302696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:34:14.302696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:34:14.302696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:34:14.302696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:34:14.302696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:14.309348 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 513/1040] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:34:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:14.310311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710db1d-321a-40fc-ad8c-eb0aa52c03d7 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:14.323819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac777f-ae46-4e7b-993a-8f34a5921187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:14.324476 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac777f-ae46-4e7b-993a-8f34a5921187 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:14.324757 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac777f-ae46-4e7b-993a-8f34a5921187 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:14.325036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac777f-ae46-4e7b-993a-8f34a5921187 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:14.325728 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac777f-ae46-4e7b-993a-8f34a5921187 None admin] RBAC: Adding query filter params (type=image) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:14.326035 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac777f-ae46-4e7b-993a-8f34a5921187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:14.327393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac777f-ae46-4e7b-993a-8f34a5921187 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:14.328603 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:14.333293 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 528/1041] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:14.339746 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac777f-ae46-4e7b-993a-8f34a5921187 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:14.421818 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710db1d-321a-40fc-ad8c-eb0aa52c03d7 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:14.441241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac777f-ae46-4e7b-993a-8f34a5921187 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:14.458773 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90195dfb-fef1-49aa-b5e8-eb446ec05799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:14.459423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90195dfb-fef1-49aa-b5e8-eb446ec05799 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:14.459728 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90195dfb-fef1-49aa-b5e8-eb446ec05799 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:14.460008 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90195dfb-fef1-49aa-b5e8-eb446ec05799 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:14.460904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90195dfb-fef1-49aa-b5e8-eb446ec05799 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:14.461358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90195dfb-fef1-49aa-b5e8-eb446ec05799 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:14.462793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90195dfb-fef1-49aa-b5e8-eb446ec05799 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:14.475002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09273f-7580-4229-b90f-a83cc05149f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:14.475637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 514/1042] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:34:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:14.475747 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09273f-7580-4229-b90f-a83cc05149f6 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:14.475968 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09273f-7580-4229-b90f-a83cc05149f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:14.476249 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09273f-7580-4229-b90f-a83cc05149f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:14.477112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09273f-7580-4229-b90f-a83cc05149f6 None admin] RBAC: Adding query filter params (interface=public, service_id=ee5f0ecb426f49458b4228594b9e14c5, region_id=RegionOne) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:14.477439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09273f-7580-4229-b90f-a83cc05149f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:14.478808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09273f-7580-4229-b90f-a83cc05149f6 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:14.481639 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90195dfb-fef1-49aa-b5e8-eb446ec05799 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:14.484418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 529/1043] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Jun 27 18:34:14 2022] GET /identity/v3/endpoints?service_id=ee5f0ecb426f49458b4228594b9e14c5&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:14.489935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09273f-7580-4229-b90f-a83cc05149f6 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:14.498078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:14.566815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:14.595837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90195dfb-fef1-49aa-b5e8-eb446ec05799 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:14.609265 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09273f-7580-4229-b90f-a83cc05149f6 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:14.632238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa2743-abfe-479d-b3ae-a87cb6b73a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:14.632894 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa2743-abfe-479d-b3ae-a87cb6b73a7a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:14.633214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa2743-abfe-479d-b3ae-a87cb6b73a7a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:14.633465 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa2743-abfe-479d-b3ae-a87cb6b73a7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:14.634295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa2743-abfe-479d-b3ae-a87cb6b73a7a None admin] RBAC: Adding query filter params (role.id=bd1fd5ae539d44b2be1d4ee708a949c9, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=da1746d29f9e4e8b8626ad4b11931cbd) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:14.634617 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa2743-abfe-479d-b3ae-a87cb6b73a7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:14.636083 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa2743-abfe-479d-b3ae-a87cb6b73a7a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:14.641839 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 515/1044] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:34:14 2022] GET /identity/v3/role_assignments?user.id=da1746d29f9e4e8b8626ad4b11931cbd&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=bd1fd5ae539d44b2be1d4ee708a949c9 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:14.653744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd04cfa-333b-4367-82c8-cc3e5a56f956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:14.654507 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd04cfa-333b-4367-82c8-cc3e5a56f956 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:14.654860 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd04cfa-333b-4367-82c8-cc3e5a56f956 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:14.655205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd04cfa-333b-4367-82c8-cc3e5a56f956 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:14.656025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd04cfa-333b-4367-82c8-cc3e5a56f956 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:14.657533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd04cfa-333b-4367-82c8-cc3e5a56f956 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:14.665915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 530/1045] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jun 27 18:34:14 2022] GET /identity/v3/services => generated 1957 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:34:15.474608 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994e83f-005c-4c5c-8687-2d9c82626a4a None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:15.475130 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994e83f-005c-4c5c-8687-2d9c82626a4a None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:15.475210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2994e83f-005c-4c5c-8687-2d9c82626a4a None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:15.476803 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 516/1046] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:15.482088 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb54e2f-e4c1-4091-9dab-b3b1f2eb7113 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:15.482506 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb54e2f-e4c1-4091-9dab-b3b1f2eb7113 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:15.482668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb54e2f-e4c1-4091-9dab-b3b1f2eb7113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:15.499155 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-5cb54e2f-e4c1-4091-9dab-b3b1f2eb7113 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:15.500497 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-5cb54e2f-e4c1-4091-9dab-b3b1f2eb7113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:15.575568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 531/1047] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:15.597173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994e83f-005c-4c5c-8687-2d9c82626a4a None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:15.676190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:15.701374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2994e83f-005c-4c5c-8687-2d9c82626a4a None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:15.737248 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b7944-4c41-49d2-8784-2f5ff031e44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:15.737965 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7944-4c41-49d2-8784-2f5ff031e44f None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:15.738282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7944-4c41-49d2-8784-2f5ff031e44f None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:15.738566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b7944-4c41-49d2-8784-2f5ff031e44f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:15.750154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b7944-4c41-49d2-8784-2f5ff031e44f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:34:15.758721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-8c8b7944-4c41-49d2-8784-2f5ff031e44f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:34:15.758721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:15.758721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:15.758721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:15.758721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:15.758721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:15.758721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:15.758721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:15.758721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:15.758721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:15.758721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:15.758721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:15.758721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:34:15.758721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:34:15.758721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:34:15.758721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:34:15.759755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:34:15.759755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:34:15.759755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:34:15.759755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:34:15.759755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:15.759755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:15.759755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:15.759755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:15.759755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:15.759755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:15.759755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:15.759755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:15.759755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:15.759755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:15.759755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:15.759755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:15.760650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:15.760650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:15.760650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:15.760650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:15.760650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:34:15.760650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:34:15.760650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:34:15.760650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:34:15.760650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:34:15.760650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:34:15.760650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:34:15.760650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:15.763896 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 517/1048] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:34:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:15.765974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb54e2f-e4c1-4091-9dab-b3b1f2eb7113 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:15.825733 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:15.869713 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb54e2f-e4c1-4091-9dab-b3b1f2eb7113 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:15.903471 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46fc14-721c-45af-910e-da3ee6f70301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:15.904169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46fc14-721c-45af-910e-da3ee6f70301 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:15.904458 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46fc14-721c-45af-910e-da3ee6f70301 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:15.904737 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46fc14-721c-45af-910e-da3ee6f70301 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:15.905492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46fc14-721c-45af-910e-da3ee6f70301 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:15.905805 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46fc14-721c-45af-910e-da3ee6f70301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:15.907183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b46fc14-721c-45af-910e-da3ee6f70301 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:15.915954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 532/1049] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:34:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:15.921441 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b7944-4c41-49d2-8784-2f5ff031e44f None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:16.021154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b7944-4c41-49d2-8784-2f5ff031e44f None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:16.053998 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34381884-338b-408a-845b-d649a0a4e73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:16.054860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34381884-338b-408a-845b-d649a0a4e73e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:16.055147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34381884-338b-408a-845b-d649a0a4e73e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:16.055425 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34381884-338b-408a-845b-d649a0a4e73e None admin] PATH_INFO: `/v3/users/b1c89a9da6a241acbf5e4d8a0d26641d` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:16.057363 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:16.069432 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34381884-338b-408a-845b-d649a0a4e73e None admin] RBAC: Authorizing `identity:get_user(user_id=b1c89a9da6a241acbf5e4d8a0d26641d)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:16.070884 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34381884-338b-408a-845b-d649a0a4e73e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:16.072791 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 518/1050] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:34:15 2022] GET /identity/v3/users/b1c89a9da6a241acbf5e4d8a0d26641d => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:16.078236 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46fc14-721c-45af-910e-da3ee6f70301 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:16.181954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46fc14-721c-45af-910e-da3ee6f70301 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:16.198861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:16.216283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29411d3a-f7c2-404e-ac17-0ecf6a2dd59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:16.216937 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29411d3a-f7c2-404e-ac17-0ecf6a2dd59f None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:16.217222 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29411d3a-f7c2-404e-ac17-0ecf6a2dd59f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:16.217499 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29411d3a-f7c2-404e-ac17-0ecf6a2dd59f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:16.286120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29411d3a-f7c2-404e-ac17-0ecf6a2dd59f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:16.287497 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29411d3a-f7c2-404e-ac17-0ecf6a2dd59f None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:16.391024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 533/1051] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:34:16 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:34:16.392450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34381884-338b-408a-845b-d649a0a4e73e None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:16.495601 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34381884-338b-408a-845b-d649a0a4e73e None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:16.538268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a389268-ee1e-4511-9e73-a6489240a82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:16.539076 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389268-ee1e-4511-9e73-a6489240a82b None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:16.539365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389268-ee1e-4511-9e73-a6489240a82b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:16.539679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a389268-ee1e-4511-9e73-a6489240a82b None admin] PATH_INFO: `/v3/projects/b650e3ec2ee34ade9faf1f8e7b6ffd8c` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:16.540878 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a389268-ee1e-4511-9e73-a6489240a82b None admin] RBAC: Authorizing `identity:get_project(project_id=b650e3ec2ee34ade9faf1f8e7b6ffd8c)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:16.542319 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a389268-ee1e-4511-9e73-a6489240a82b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:16.548985 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 519/1052] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:34:16 2022] GET /identity/v3/projects/b650e3ec2ee34ade9faf1f8e7b6ffd8c => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:16.550503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29411d3a-f7c2-404e-ac17-0ecf6a2dd59f None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:16.570594 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:16.651261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29411d3a-f7c2-404e-ac17-0ecf6a2dd59f None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:16.682751 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944c65a-4a97-4c3b-a89c-d6acdb00301b None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:16.683056 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944c65a-4a97-4c3b-a89c-d6acdb00301b None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:16.683320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3944c65a-4a97-4c3b-a89c-d6acdb00301b None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:16.684867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 520/1053] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:16.686398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fa44c-fc93-4f29-bbcc-39d6ce0428c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:16.687033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa44c-fc93-4f29-bbcc-39d6ce0428c3 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:16.687318 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa44c-fc93-4f29-bbcc-39d6ce0428c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:16.687668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa44c-fc93-4f29-bbcc-39d6ce0428c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:16.688577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fa44c-fc93-4f29-bbcc-39d6ce0428c3 None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=b650e3ec2ee34ade9faf1f8e7b6ffd8c, user.id=b1c89a9da6a241acbf5e4d8a0d26641d) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:16.688854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fa44c-fc93-4f29-bbcc-39d6ce0428c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:16.689706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19273c5d-eb6a-4a08-ada0-a0e27123971d None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:16.689996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19273c5d-eb6a-4a08-ada0-a0e27123971d None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:16.690272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19273c5d-eb6a-4a08-ada0-a0e27123971d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:16.690367 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9fa44c-fc93-4f29-bbcc-39d6ce0428c3 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:16.703623 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 534/1054] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:34:16 2022] GET /identity/v3/role_assignments?user.id=b1c89a9da6a241acbf5e4d8a0d26641d&scope.project.id=b650e3ec2ee34ade9faf1f8e7b6ffd8c&role.id=b156409c977248e1b23c26e589b1e04f => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:16.711173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-19273c5d-eb6a-4a08-ada0-a0e27123971d None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:16.712455 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-19273c5d-eb6a-4a08-ada0-a0e27123971d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:16.731683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aec6ba-f3a8-4f01-bda3-6a9abf61215c None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:16.731969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aec6ba-f3a8-4f01-bda3-6a9abf61215c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:16.732295 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aec6ba-f3a8-4f01-bda3-6a9abf61215c None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:16.733682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 535/1055] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:34:16.740084 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2424e4-14b8-4968-8f5c-9223c6cdc1ad None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:16.740380 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2424e4-14b8-4968-8f5c-9223c6cdc1ad None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:16.740656 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2424e4-14b8-4968-8f5c-9223c6cdc1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:16.757970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-bf2424e4-14b8-4968-8f5c-9223c6cdc1ad None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:16.759210 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-bf2424e4-14b8-4968-8f5c-9223c6cdc1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:16.779399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:16.793014 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 521/1056] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:34:16.817614 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19273c5d-eb6a-4a08-ada0-a0e27123971d None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:16.838596 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 536/1057] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:34:16.862263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2424e4-14b8-4968-8f5c-9223c6cdc1ad None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:16.878032 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:16.932146 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19273c5d-eb6a-4a08-ada0-a0e27123971d None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:16.968608 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514de339-4be4-402d-a4a8-8c85b8644a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:16.969418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514de339-4be4-402d-a4a8-8c85b8644a38 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:16.969703 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514de339-4be4-402d-a4a8-8c85b8644a38 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:16.969978 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514de339-4be4-402d-a4a8-8c85b8644a38 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:16.973652 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2424e4-14b8-4968-8f5c-9223c6cdc1ad None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:16.982638 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514de339-4be4-402d-a4a8-8c85b8644a38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:34:16.993651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-514de339-4be4-402d-a4a8-8c85b8644a38 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 18:34:16.993651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:16.993651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:16.993651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:16.993651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:16.993651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:16.993651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:16.993651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:16.993651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:16.993651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:16.993651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:16.993651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:16.993651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:34:16.993651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:34:16.993651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:34:16.993651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:34:16.994630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:34:16.994630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:34:16.994630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:34:16.994630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:34:16.994630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:16.994630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:16.994630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:16.994630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:16.994630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:16.994630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:16.994630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:16.994630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:16.994630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:16.994630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:16.994630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:16.994630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:16.995497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:16.995497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:16.995497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:16.995497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:16.995497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:34:16.995497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:34:16.995497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:34:16.995497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:34:16.995497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:34:16.995497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:34:16.995497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 18:34:16.995497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:16.996654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 522/1058] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Jun 27 18:34:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:34:17.003576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514de339-4be4-402d-a4a8-8c85b8644a38 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:17.009379 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2c42e-de22-46ae-9d95-d74694cd6285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:17.010175 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2c42e-de22-46ae-9d95-d74694cd6285 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:17.010459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2c42e-de22-46ae-9d95-d74694cd6285 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:17.010734 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead2c42e-de22-46ae-9d95-d74694cd6285 None admin] PATH_INFO: `/v3/services/image` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:17.011391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2c42e-de22-46ae-9d95-d74694cd6285 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:17.012866 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead2c42e-de22-46ae-9d95-d74694cd6285 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:17.024900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-ead2c42e-de22-46ae-9d95-d74694cd6285 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 18:34:17.024900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:17.024900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:34:17.024900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:34:17.024900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:34:17.024900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:34:17.024900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:34:17.024900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:17.024900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 18:34:17.024900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:17.024900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:34:17.024900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:17.024900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:17.024900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:17.024900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:17.024900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:17.024900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:17.025908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:17.025908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:17.025908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:17.025908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:17.025908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:17.025908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:17.025908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:34:17.025908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:34:17.025908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:34:17.025908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:34:17.025908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:17.025908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:17.025908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:17.025908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:17.025908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:17.025908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:17.026792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:17.026792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:17.026792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:17.026792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:17.026792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:17.026792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:17.026792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:17.026792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:17.026792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:17.026792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:17.026792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:34:17.026792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:34:17.026792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 27 18:34:17.026792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:17.031136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 537/1059] 10.222.0.36 () {56 vars in 1105 bytes} [Mon Jun 27 18:34:16 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:34:17.032130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2c42e-de22-46ae-9d95-d74694cd6285 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:17.065209 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:17.116947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:17.117877 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514de339-4be4-402d-a4a8-8c85b8644a38 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:17.140928 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead2c42e-de22-46ae-9d95-d74694cd6285 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:17.154220 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5ebb0-8ff7-4895-b951-e04af2216164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:17.154887 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5ebb0-8ff7-4895-b951-e04af2216164 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:17.155173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5ebb0-8ff7-4895-b951-e04af2216164 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:17.155453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5ebb0-8ff7-4895-b951-e04af2216164 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:17.156251 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5ebb0-8ff7-4895-b951-e04af2216164 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:17.156565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5ebb0-8ff7-4895-b951-e04af2216164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:17.157937 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5ebb0-8ff7-4895-b951-e04af2216164 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:17.167081 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 523/1060] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Jun 27 18:34:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:17.172996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5ebb0-8ff7-4895-b951-e04af2216164 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:17.180956 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81844a-68fe-4979-9327-eff8f98a4caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:17.181630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81844a-68fe-4979-9327-eff8f98a4caf None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:17.181927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81844a-68fe-4979-9327-eff8f98a4caf None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:17.182211 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81844a-68fe-4979-9327-eff8f98a4caf None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:17.182924 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81844a-68fe-4979-9327-eff8f98a4caf None admin] RBAC: Adding query filter params (name=image) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:17.183236 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81844a-68fe-4979-9327-eff8f98a4caf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:17.184647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81844a-68fe-4979-9327-eff8f98a4caf None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:17.189630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 538/1061] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:17.195179 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81844a-68fe-4979-9327-eff8f98a4caf None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:17.282148 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5ebb0-8ff7-4895-b951-e04af2216164 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:17.295184 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:17.302544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81844a-68fe-4979-9327-eff8f98a4caf None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:17.321414 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d1029-b6f7-4153-81c4-ba98dc171136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:17.322139 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d1029-b6f7-4153-81c4-ba98dc171136 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:17.322424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d1029-b6f7-4153-81c4-ba98dc171136 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:17.322698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d1029-b6f7-4153-81c4-ba98dc171136 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:17.333652 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d1029-b6f7-4153-81c4-ba98dc171136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:17.335101 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d1029-b6f7-4153-81c4-ba98dc171136 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:17.340388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eeeacc-3b0a-40f5-8767-2f65367d0635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:17.341410 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeeacc-3b0a-40f5-8767-2f65367d0635 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:17.341699 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeeacc-3b0a-40f5-8767-2f65367d0635 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:17.341977 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eeeacc-3b0a-40f5-8767-2f65367d0635 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:17.342687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eeeacc-3b0a-40f5-8767-2f65367d0635 None admin] RBAC: Adding query filter params (type=image) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:17.343119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eeeacc-3b0a-40f5-8767-2f65367d0635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:17.344516 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eeeacc-3b0a-40f5-8767-2f65367d0635 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:17.354577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 539/1062] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:17.354724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-943d1029-b6f7-4153-81c4-ba98dc171136 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:17.354724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:17.354724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:17.354724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:17.354724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:17.354724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:17.354724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:17.354724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:17.354724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:17.354724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:17.354724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:17.354724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:17.354724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:34:17.354724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:34:17.354724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:34:17.356088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:34:17.356088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:17.356088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:17.356088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:17.356088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:17.356088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:17.356088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:17.356088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:17.356088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:17.356088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:17.356088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:17.356088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:17.356088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:17.356088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:17.356088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:17.356088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:17.356088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:17.357220 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:34:17.357220 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:34:17.357220 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:17.357220 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:17.357220 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 524/1063] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:17.358999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eeeacc-3b0a-40f5-8767-2f65367d0635 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:17.360384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d1029-b6f7-4153-81c4-ba98dc171136 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:17.362681 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:17.465692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eeeacc-3b0a-40f5-8767-2f65367d0635 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:17.468245 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d1029-b6f7-4153-81c4-ba98dc171136 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:17.501722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9326dd-9030-4093-a507-12767f4276e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:17.502375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9326dd-9030-4093-a507-12767f4276e8 None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:17.502661 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9326dd-9030-4093-a507-12767f4276e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:17.502942 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9326dd-9030-4093-a507-12767f4276e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:17.503750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9326dd-9030-4093-a507-12767f4276e8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:17.504507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc2fbc-ba22-4767-90ff-0d1b8082fd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:17.505125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9326dd-9030-4093-a507-12767f4276e8 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:17.505830 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc2fbc-ba22-4767-90ff-0d1b8082fd4e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:17.506264 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc2fbc-ba22-4767-90ff-0d1b8082fd4e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:17.506699 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc2fbc-ba22-4767-90ff-0d1b8082fd4e None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:17.507591 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc2fbc-ba22-4767-90ff-0d1b8082fd4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:17.508048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc2fbc-ba22-4767-90ff-0d1b8082fd4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:17.509565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc2fbc-ba22-4767-90ff-0d1b8082fd4e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:17.531394 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 525/1064] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:17.535451 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc2fbc-ba22-4767-90ff-0d1b8082fd4e None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:17.560553 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:17.576183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 540/1065] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jun 27 18:34:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:34:17.648849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc2fbc-ba22-4767-90ff-0d1b8082fd4e None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:17.691871 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bb4ab-080b-4931-8578-a17bc65ec748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:17.692685 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bb4ab-080b-4931-8578-a17bc65ec748 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:17.692967 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bb4ab-080b-4931-8578-a17bc65ec748 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:17.693241 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bb4ab-080b-4931-8578-a17bc65ec748 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:17.701338 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bb4ab-080b-4931-8578-a17bc65ec748 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:17.702711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bb4ab-080b-4931-8578-a17bc65ec748 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:17.718785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-af7bb4ab-080b-4931-8578-a17bc65ec748 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:34:17.718785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:17.718785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:17.718785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:17.718785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:17.718785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:17.718785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:17.718785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:17.718785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:17.718785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:17.718785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:17.718785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:17.718785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:34:17.718785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:34:17.718785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:34:17.718785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:17.719876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:17.726410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:17.726410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:17.726410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:34:17.726410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:34:17.726410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:34:17.726410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:34:17.726410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:34:17.726410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:34:17.726410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:34:17.726410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:17.726410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 526/1066] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jun 27 18:34:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:34:17.728484 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9326dd-9030-4093-a507-12767f4276e8 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:17.801698 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:17.845550 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9326dd-9030-4093-a507-12767f4276e8 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:17.880882 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a90ff4-4d13-44d2-bf90-3820440149d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:17.881568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a90ff4-4d13-44d2-bf90-3820440149d6 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:17.881862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a90ff4-4d13-44d2-bf90-3820440149d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:17.882142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a90ff4-4d13-44d2-bf90-3820440149d6 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:17.882982 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a90ff4-4d13-44d2-bf90-3820440149d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:17.883298 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a90ff4-4d13-44d2-bf90-3820440149d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:17.884783 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a90ff4-4d13-44d2-bf90-3820440149d6 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:17.907105 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 541/1067] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jun 27 18:34:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:17.908330 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bb4ab-080b-4931-8578-a17bc65ec748 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:17.991010 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:18.009901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bb4ab-080b-4931-8578-a17bc65ec748 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:18.044668 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e252c3a-6808-48bb-b6c9-9347ff91a1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:18.045458 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e252c3a-6808-48bb-b6c9-9347ff91a1a5 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:18.045744 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e252c3a-6808-48bb-b6c9-9347ff91a1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:18.046020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e252c3a-6808-48bb-b6c9-9347ff91a1a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:18.056938 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e252c3a-6808-48bb-b6c9-9347ff91a1a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:18.058385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e252c3a-6808-48bb-b6c9-9347ff91a1a5 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:18.077570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-6e252c3a-6808-48bb-b6c9-9347ff91a1a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:18.077570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:18.077570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:18.077570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:18.077570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:18.077570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:18.077570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:18.077570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:18.077570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:18.077570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:18.077570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:18.077570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:18.077570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:34:18.077570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:34:18.077570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:34:18.078505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:34:18.078505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:18.078505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:18.078505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:18.078505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:18.078505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:18.078505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:18.078505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:18.078505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:18.078505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:18.078505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:18.078505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:18.078505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:18.078505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:18.078505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:18.078505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:18.078505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:18.079408 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:34:18.079408 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:34:18.079408 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:18.079408 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:18.083458 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 527/1068] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:18.084473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a90ff4-4d13-44d2-bf90-3820440149d6 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:18.184844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a90ff4-4d13-44d2-bf90-3820440149d6 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:18.202470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:18.219225 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fca59-bc52-4f9c-a1ea-c96a9ec6646a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:18.219927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fca59-bc52-4f9c-a1ea-c96a9ec6646a None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:18.220216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fca59-bc52-4f9c-a1ea-c96a9ec6646a None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:18.220487 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fca59-bc52-4f9c-a1ea-c96a9ec6646a None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:18.221208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fca59-bc52-4f9c-a1ea-c96a9ec6646a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:18.221516 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fca59-bc52-4f9c-a1ea-c96a9ec6646a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:18.223416 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fca59-bc52-4f9c-a1ea-c96a9ec6646a None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:18.235651 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 542/1069] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:34:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:18.241536 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e252c3a-6808-48bb-b6c9-9347ff91a1a5 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:18.341902 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e252c3a-6808-48bb-b6c9-9347ff91a1a5 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:18.372072 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:18.377594 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59dfc1-834e-440c-9b28-944a5f857426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:18.378392 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59dfc1-834e-440c-9b28-944a5f857426 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:18.378705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59dfc1-834e-440c-9b28-944a5f857426 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:18.378982 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b59dfc1-834e-440c-9b28-944a5f857426 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:18.385799 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59dfc1-834e-440c-9b28-944a5f857426 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:18.387240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b59dfc1-834e-440c-9b28-944a5f857426 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:18.402196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-7b59dfc1-834e-440c-9b28-944a5f857426 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:34:18.402196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:18.402196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:18.402196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:18.402196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:18.402196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:18.402196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:18.402196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:18.402196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:18.402196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:18.402196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:18.402196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:18.402196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:34:18.402196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:34:18.402196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:34:18.403123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:34:18.403123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:18.403123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:18.403123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:18.403123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:18.403123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:18.403123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:18.403123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:18.403123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:18.403123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:18.403123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:18.403123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:18.403123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:18.403123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:18.403123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:18.403123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:18.403123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:18.404144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:34:18.404144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:34:18.404144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:34:18.404144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:34:18.404144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:34:18.404144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:34:18.404144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:34:18.404144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:18.407614 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 528/1070] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:34:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:18.409439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fca59-bc52-4f9c-a1ea-c96a9ec6646a None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:18.510071 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fca59-bc52-4f9c-a1ea-c96a9ec6646a None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:18.550950 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a6125-b52d-4d58-b8ad-2d90e5e70129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:18.551639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a6125-b52d-4d58-b8ad-2d90e5e70129 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:18.551926 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a6125-b52d-4d58-b8ad-2d90e5e70129 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:18.552201 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a6125-b52d-4d58-b8ad-2d90e5e70129 None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:18.552980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a6125-b52d-4d58-b8ad-2d90e5e70129 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:18.553291 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a6125-b52d-4d58-b8ad-2d90e5e70129 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:18.554710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a6125-b52d-4d58-b8ad-2d90e5e70129 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:18.566908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 543/1071] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:34:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:18.572633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59dfc1-834e-440c-9b28-944a5f857426 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:18.677424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b59dfc1-834e-440c-9b28-944a5f857426 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:18.711754 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cc3bd-4369-40cc-a697-1e422edd1f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:18.712671 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cc3bd-4369-40cc-a697-1e422edd1f7d None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:18.712956 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cc3bd-4369-40cc-a697-1e422edd1f7d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:18.713237 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284cc3bd-4369-40cc-a697-1e422edd1f7d None admin] PATH_INFO: `/v3/projects/94dba2006b6747f8badff33745bde432/users/da1746d29f9e4e8b8626ad4b11931cbd/roles/bd1fd5ae539d44b2be1d4ee708a949c9` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:18.715553 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cc3bd-4369-40cc-a697-1e422edd1f7d None admin] RBAC: Authorizing `identity:create_grant(project_id=94dba2006b6747f8badff33745bde432, user_id=da1746d29f9e4e8b8626ad4b11931cbd, role_id=bd1fd5ae539d44b2be1d4ee708a949c9)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:18.717024 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284cc3bd-4369-40cc-a697-1e422edd1f7d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:18.728880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fcab0-2593-4ad6-a9b3-b5e7129fa052 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:18.729403 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fcab0-2593-4ad6-a9b3-b5e7129fa052 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:18.729495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fcab0-2593-4ad6-a9b3-b5e7129fa052 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:18.731055 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 544/1072] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:34:18.735907 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c22954-1d16-42f2-91db-14d0bde7bc99 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:18.736188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c22954-1d16-42f2-91db-14d0bde7bc99 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:18.736465 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c22954-1d16-42f2-91db-14d0bde7bc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:18.753268 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-e3c22954-1d16-42f2-91db-14d0bde7bc99 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:18.754532 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e3c22954-1d16-42f2-91db-14d0bde7bc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:18.781467 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 529/1073] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:34:18 2022] PUT /identity/v3/projects/94dba2006b6747f8badff33745bde432/users/da1746d29f9e4e8b8626ad4b11931cbd/roles/bd1fd5ae539d44b2be1d4ee708a949c9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:34:18.786354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:18.830398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 545/1074] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:34:18.854657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cc3bd-4369-40cc-a697-1e422edd1f7d None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:18.912896 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:18.964540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284cc3bd-4369-40cc-a697-1e422edd1f7d None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:19.000946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560791e-5309-4c08-b6aa-eebbc4d4d438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:19.001735 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560791e-5309-4c08-b6aa-eebbc4d4d438 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:19.002016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560791e-5309-4c08-b6aa-eebbc4d4d438 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:19.002289 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560791e-5309-4c08-b6aa-eebbc4d4d438 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:19.012661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560791e-5309-4c08-b6aa-eebbc4d4d438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:34:19.020750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-0560791e-5309-4c08-b6aa-eebbc4d4d438 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:34:19.020750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:19.020750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:19.020750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:19.020750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:19.020750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:19.020750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:19.020750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:19.020750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:19.020750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:19.020750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:19.020750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:19.020750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:34:19.020750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:34:19.020750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:34:19.020750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:34:19.021707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:34:19.021707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:34:19.021707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:34:19.021707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:34:19.021707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:19.021707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:19.021707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:19.021707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:19.021707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:19.021707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:19.021707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:19.021707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:19.021707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:19.021707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:19.021707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:19.021707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:19.022575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:19.022575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:19.022575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:19.022575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:19.022575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:34:19.022575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:34:19.022575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:34:19.022575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:34:19.022575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:34:19.022575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:34:19.022575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:34:19.022575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:19.022575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 530/1075] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:34:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:19.028107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c22954-1d16-42f2-91db-14d0bde7bc99 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:19.128106 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c22954-1d16-42f2-91db-14d0bde7bc99 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:19.162285 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788c31a-86be-4edd-8a58-727efebea533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:19.162951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788c31a-86be-4edd-8a58-727efebea533 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:19.163233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788c31a-86be-4edd-8a58-727efebea533 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:19.163508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788c31a-86be-4edd-8a58-727efebea533 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:19.164275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788c31a-86be-4edd-8a58-727efebea533 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:19.164583 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788c31a-86be-4edd-8a58-727efebea533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:19.165946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788c31a-86be-4edd-8a58-727efebea533 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:19.174249 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 546/1076] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:34:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:19.179781 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560791e-5309-4c08-b6aa-eebbc4d4d438 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:19.283995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560791e-5309-4c08-b6aa-eebbc4d4d438 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:19.297331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:19.318754 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133136e3-6c4b-4c28-b71c-5e8916ddcf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:19.319803 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133136e3-6c4b-4c28-b71c-5e8916ddcf03 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:19.320196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133136e3-6c4b-4c28-b71c-5e8916ddcf03 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:19.320628 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133136e3-6c4b-4c28-b71c-5e8916ddcf03 None admin] PATH_INFO: `/v3/users/b1c89a9da6a241acbf5e4d8a0d26641d` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:19.321981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133136e3-6c4b-4c28-b71c-5e8916ddcf03 None admin] RBAC: Authorizing `identity:get_user(user_id=b1c89a9da6a241acbf5e4d8a0d26641d)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:19.323510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133136e3-6c4b-4c28-b71c-5e8916ddcf03 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:19.325435 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 531/1077] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:34:19 2022] GET /identity/v3/users/b1c89a9da6a241acbf5e4d8a0d26641d => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:19.331011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788c31a-86be-4edd-8a58-727efebea533 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:19.365027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:19.435048 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788c31a-86be-4edd-8a58-727efebea533 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:19.468668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c0722-e724-42cd-8577-1382033a5099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:19.469694 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c0722-e724-42cd-8577-1382033a5099 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:19.470078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c0722-e724-42cd-8577-1382033a5099 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:19.470450 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c0722-e724-42cd-8577-1382033a5099 None admin] PATH_INFO: `/v3/projects/b650e3ec2ee34ade9faf1f8e7b6ffd8c` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:19.471769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c0722-e724-42cd-8577-1382033a5099 None admin] RBAC: Authorizing `identity:get_project(project_id=b650e3ec2ee34ade9faf1f8e7b6ffd8c)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:19.473342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c0722-e724-42cd-8577-1382033a5099 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:19.480046 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 547/1078] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:34:19 2022] GET /identity/v3/projects/b650e3ec2ee34ade9faf1f8e7b6ffd8c => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:19.481392 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133136e3-6c4b-4c28-b71c-5e8916ddcf03 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:19.587513 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133136e3-6c4b-4c28-b71c-5e8916ddcf03 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:19.620186 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce38437-1bb4-4aeb-9fdb-499d4562b7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:19.621065 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce38437-1bb4-4aeb-9fdb-499d4562b7af None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:19.621346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce38437-1bb4-4aeb-9fdb-499d4562b7af None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:19.621620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce38437-1bb4-4aeb-9fdb-499d4562b7af None admin] PATH_INFO: `/v3/projects/b650e3ec2ee34ade9faf1f8e7b6ffd8c/users/b1c89a9da6a241acbf5e4d8a0d26641d/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:19.623563 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce38437-1bb4-4aeb-9fdb-499d4562b7af None admin] RBAC: Authorizing `identity:create_grant(project_id=b650e3ec2ee34ade9faf1f8e7b6ffd8c, user_id=b1c89a9da6a241acbf5e4d8a0d26641d, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:19.624993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce38437-1bb4-4aeb-9fdb-499d4562b7af None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:19.651732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc3355-78ea-4dc0-af7b-fffe31758aea None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:19.652018 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc3355-78ea-4dc0-af7b-fffe31758aea None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:19.652297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc3355-78ea-4dc0-af7b-fffe31758aea None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:19.653755 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 548/1079] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:34:19.658607 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d06de6-b0ab-459f-95a0-539b97fb3f09 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:19.658892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d06de6-b0ab-459f-95a0-539b97fb3f09 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:19.659188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d06de6-b0ab-459f-95a0-539b97fb3f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:19.675577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-09d06de6-b0ab-459f-95a0-539b97fb3f09 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:19.676753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-09d06de6-b0ab-459f-95a0-539b97fb3f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:19.712428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 532/1080] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:34:19 2022] PUT /identity/v3/projects/b650e3ec2ee34ade9faf1f8e7b6ffd8c/users/b1c89a9da6a241acbf5e4d8a0d26641d/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:34:19.759614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 549/1081] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:34:19.780803 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce38437-1bb4-4aeb-9fdb-499d4562b7af None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:19.826413 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:19.897475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce38437-1bb4-4aeb-9fdb-499d4562b7af None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:19.932441 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabeb05f-1b9b-4e56-a247-d5a2c0c45177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:19.933092 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabeb05f-1b9b-4e56-a247-d5a2c0c45177 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:19.933381 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabeb05f-1b9b-4e56-a247-d5a2c0c45177 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:19.933663 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabeb05f-1b9b-4e56-a247-d5a2c0c45177 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:20.001241 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabeb05f-1b9b-4e56-a247-d5a2c0c45177 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:20.002620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabeb05f-1b9b-4e56-a247-d5a2c0c45177 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:20.043321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:20.102358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 533/1082] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:34:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:34:20.108404 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d06de6-b0ab-459f-95a0-539b97fb3f09 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:20.136432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:20.208686 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d06de6-b0ab-459f-95a0-539b97fb3f09 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:20.241676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448b372-33a1-46a1-acfb-92531df5448c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:20.242471 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448b372-33a1-46a1-acfb-92531df5448c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:20.242749 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448b372-33a1-46a1-acfb-92531df5448c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:20.243018 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448b372-33a1-46a1-acfb-92531df5448c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:20.253133 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448b372-33a1-46a1-acfb-92531df5448c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:20.255048 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448b372-33a1-46a1-acfb-92531df5448c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:20.272723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-6448b372-33a1-46a1-acfb-92531df5448c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:20.272723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:20.272723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:20.272723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:20.272723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:20.272723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:20.272723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:20.272723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:20.272723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:20.272723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:20.272723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:20.272723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:20.272723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:34:20.272723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:34:20.272723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:34:20.273636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:34:20.273636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:20.273636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:20.273636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:20.273636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:20.273636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:20.273636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:20.273636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:20.273636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:20.273636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:20.273636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:20.273636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:20.273636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:20.273636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:20.273636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:20.273636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:20.273636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:20.274555 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:34:20.274555 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:34:20.274555 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:20.274555 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:20.278749 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 550/1083] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:20.280124 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabeb05f-1b9b-4e56-a247-d5a2c0c45177 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:20.377737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabeb05f-1b9b-4e56-a247-d5a2c0c45177 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:20.412630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9da4f-059b-4680-88f3-7247301fb66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:20.413389 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9da4f-059b-4680-88f3-7247301fb66b None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:20.413671 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9da4f-059b-4680-88f3-7247301fb66b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:20.413946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9da4f-059b-4680-88f3-7247301fb66b None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:20.414665 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9da4f-059b-4680-88f3-7247301fb66b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:20.414971 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9da4f-059b-4680-88f3-7247301fb66b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:20.416362 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9da4f-059b-4680-88f3-7247301fb66b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:20.424735 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:20.428727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 534/1084] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:20.833608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c00045-8777-4181-97c0-24f1f36d1827 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:20.834142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c00045-8777-4181-97c0-24f1f36d1827 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:20.834231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c00045-8777-4181-97c0-24f1f36d1827 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:20.835561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 551/1085] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:20.840693 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f79f35-96f7-4c9b-81a2-0458722dbe7e None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:20.842438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f79f35-96f7-4c9b-81a2-0458722dbe7e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:20.842438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f79f35-96f7-4c9b-81a2-0458722dbe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:20.861214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-13f79f35-96f7-4c9b-81a2-0458722dbe7e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:20.863104 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-13f79f35-96f7-4c9b-81a2-0458722dbe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:20.928449 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 535/1086] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:20.952115 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c00045-8777-4181-97c0-24f1f36d1827 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:21.031358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:21.049941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c00045-8777-4181-97c0-24f1f36d1827 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:21.083099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502740c-1243-4db8-911c-deea8bac9026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:21.083973 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502740c-1243-4db8-911c-deea8bac9026 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:21.084202 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502740c-1243-4db8-911c-deea8bac9026 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:21.084474 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502740c-1243-4db8-911c-deea8bac9026 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:21.094429 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502740c-1243-4db8-911c-deea8bac9026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:34:21.102654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-2502740c-1243-4db8-911c-deea8bac9026 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 18:34:21.102654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:21.102654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:21.102654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:21.102654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:21.102654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:21.102654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:21.102654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:21.102654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:21.102654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:21.102654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:21.102654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:21.102654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:34:21.102654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:34:21.102654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:34:21.102654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:34:21.103631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:34:21.103631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:34:21.103631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:34:21.103631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:34:21.103631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:21.103631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:21.103631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:21.103631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:21.103631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:21.103631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:21.103631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:21.103631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:21.103631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:21.103631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:21.103631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:21.103631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:21.104493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:21.104493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:21.104493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:21.104493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:21.104493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:34:21.104493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:34:21.104493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:34:21.104493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:34:21.104493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:34:21.104493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:34:21.104493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 27 18:34:21.104493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:21.104493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 552/1087] 10.222.0.36 () {56 vars in 1120 bytes} [Mon Jun 27 18:34:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:21.110147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f79f35-96f7-4c9b-81a2-0458722dbe7e None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:21.204562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f79f35-96f7-4c9b-81a2-0458722dbe7e None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:21.232414 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:21.238517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38530112-ff68-405d-be00-c32cb85a7fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:21.239170 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38530112-ff68-405d-be00-c32cb85a7fd2 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:21.239453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38530112-ff68-405d-be00-c32cb85a7fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:21.239767 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38530112-ff68-405d-be00-c32cb85a7fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:21.240518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38530112-ff68-405d-be00-c32cb85a7fd2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:21.240826 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38530112-ff68-405d-be00-c32cb85a7fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:21.242188 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38530112-ff68-405d-be00-c32cb85a7fd2 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:21.250074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 536/1088] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Jun 27 18:34:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:21.256362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502740c-1243-4db8-911c-deea8bac9026 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:21.352118 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502740c-1243-4db8-911c-deea8bac9026 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:21.384979 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88d844-5e8d-44df-be33-92b7a5d3e287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:21.385787 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88d844-5e8d-44df-be33-92b7a5d3e287 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:21.386072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88d844-5e8d-44df-be33-92b7a5d3e287 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:21.386348 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88d844-5e8d-44df-be33-92b7a5d3e287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:21.395041 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:21.397211 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88d844-5e8d-44df-be33-92b7a5d3e287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:21.398650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88d844-5e8d-44df-be33-92b7a5d3e287 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:21.415549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-5e88d844-5e8d-44df-be33-92b7a5d3e287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:21.415549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:21.415549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:21.415549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:21.415549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:21.415549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:21.415549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:21.415549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:21.415549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:21.415549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:21.415549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:21.415549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:21.415549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:34:21.415549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:34:21.415549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:34:21.416464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:34:21.416464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:21.416464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:21.416464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:21.416464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:21.416464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:21.416464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:21.416464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:21.416464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:21.416464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:21.416464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:21.416464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:21.416464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:21.416464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:21.416464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:21.416464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:21.416464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:21.417392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:34:21.417392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:34:21.417392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:21.417392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:21.419819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 553/1089] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:21.422518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38530112-ff68-405d-be00-c32cb85a7fd2 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:21.520905 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38530112-ff68-405d-be00-c32cb85a7fd2 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:21.553876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5da79-102a-481f-9d7e-faee4e77b80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:21.554542 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5da79-102a-481f-9d7e-faee4e77b80c None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:21.554830 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5da79-102a-481f-9d7e-faee4e77b80c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:21.555110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5da79-102a-481f-9d7e-faee4e77b80c None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:21.555867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5da79-102a-481f-9d7e-faee4e77b80c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:21.556184 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5da79-102a-481f-9d7e-faee4e77b80c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:21.557551 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5da79-102a-481f-9d7e-faee4e77b80c None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:21.569785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 537/1090] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:21.575501 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88d844-5e8d-44df-be33-92b7a5d3e287 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:21.673087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88d844-5e8d-44df-be33-92b7a5d3e287 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:21.705543 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd59e03-0b70-49d0-ab6d-2c4456447595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:21.706338 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd59e03-0b70-49d0-ab6d-2c4456447595 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:21.706676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd59e03-0b70-49d0-ab6d-2c4456447595 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:21.706955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd59e03-0b70-49d0-ab6d-2c4456447595 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:21.714481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd59e03-0b70-49d0-ab6d-2c4456447595 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:21.715963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd59e03-0b70-49d0-ab6d-2c4456447595 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:21.730568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-ccd59e03-0b70-49d0-ab6d-2c4456447595 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:34:21.730568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:21.730568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:21.730568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:21.730568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:21.730568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:21.730568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:21.730568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:21.730568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:21.730568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:21.730568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:21.730568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:21.730568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:34:21.730568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:34:21.730568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:34:21.730568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:21.731718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:21.732885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:21.732885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:21.732885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:34:21.732885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:34:21.732885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:34:21.732885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:34:21.732885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:34:21.732885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:34:21.732885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 27 18:34:21.732885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:21.738646 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 554/1091] 10.222.0.36 () {56 vars in 1093 bytes} [Mon Jun 27 18:34:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:21.738767 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5da79-102a-481f-9d7e-faee4e77b80c None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:21.751767 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec771692-669b-41cd-86d7-dd5ca0d1a3d3 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:21.752060 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec771692-669b-41cd-86d7-dd5ca0d1a3d3 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:21.752346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec771692-669b-41cd-86d7-dd5ca0d1a3d3 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:21.753763 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 555/1092] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:34:21.758875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478fbaa-bf81-44d8-b7d0-7a754cda52bf None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:21.759163 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478fbaa-bf81-44d8-b7d0-7a754cda52bf None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:21.759444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478fbaa-bf81-44d8-b7d0-7a754cda52bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:21.775728 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-b478fbaa-bf81-44d8-b7d0-7a754cda52bf None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:21.776920 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b478fbaa-bf81-44d8-b7d0-7a754cda52bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:21.791014 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:21.830473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:21.838130 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5da79-102a-481f-9d7e-faee4e77b80c None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:21.850413 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 556/1093] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:21.872168 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbdce3-3971-4da3-9e27-caf6e44a4492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:21.872835 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbdce3-3971-4da3-9e27-caf6e44a4492 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:21.873119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbdce3-3971-4da3-9e27-caf6e44a4492 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:21.873395 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfbdce3-3971-4da3-9e27-caf6e44a4492 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:21.874237 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbdce3-3971-4da3-9e27-caf6e44a4492 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:21.874551 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbdce3-3971-4da3-9e27-caf6e44a4492 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:21.874731 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478fbaa-bf81-44d8-b7d0-7a754cda52bf None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:21.876031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfbdce3-3971-4da3-9e27-caf6e44a4492 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:21.894137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 538/1094] 10.222.0.36 () {56 vars in 1133 bytes} [Mon Jun 27 18:34:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:21.899815 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbdce3-3971-4da3-9e27-caf6e44a4492 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:21.980587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478fbaa-bf81-44d8-b7d0-7a754cda52bf None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:21.996680 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfbdce3-3971-4da3-9e27-caf6e44a4492 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:22.007337 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:22.013988 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d20fa6-497d-4bd3-aca0-99b48f318bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:22.014871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d20fa6-497d-4bd3-aca0-99b48f318bbb None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:22.015157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d20fa6-497d-4bd3-aca0-99b48f318bbb None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:22.018521 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d20fa6-497d-4bd3-aca0-99b48f318bbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:22.025984 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d20fa6-497d-4bd3-aca0-99b48f318bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:34:22.030335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269c9e4-57a2-433f-8ffc-d84023f55f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:22.030969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269c9e4-57a2-433f-8ffc-d84023f55f13 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:22.031255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269c9e4-57a2-433f-8ffc-d84023f55f13 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:22.031552 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269c9e4-57a2-433f-8ffc-d84023f55f13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:22.033697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-c9d20fa6-497d-4bd3-aca0-99b48f318bbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:34:22.033697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:22.033697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:22.033697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:22.033697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:22.033697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:22.033697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:22.033697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:22.033697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:22.033697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:22.033697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:22.033697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:22.033697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:34:22.033697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:34:22.033697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:34:22.033697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:34:22.035381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:34:22.035381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:34:22.035381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:34:22.035381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:34:22.035381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:22.035381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:22.035381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:22.035381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:22.035381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:22.035381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:22.035381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:22.035381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:22.035381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:22.035381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:22.035381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:22.035381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:22.036475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:22.036475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:22.036475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:22.036475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:22.036475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:34:22.036475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:34:22.036475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:34:22.036475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:34:22.036475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:34:22.036475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:34:22.036475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:34:22.036475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:22.036475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 557/1095] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:34:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:34:22.041353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d20fa6-497d-4bd3-aca0-99b48f318bbb None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:22.082161 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:22.102103 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269c9e4-57a2-433f-8ffc-d84023f55f13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:22.103584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269c9e4-57a2-433f-8ffc-d84023f55f13 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:22.138988 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d20fa6-497d-4bd3-aca0-99b48f318bbb None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:22.172353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de7b35-959e-45c1-81ea-b7ef49a3ed0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:22.173017 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de7b35-959e-45c1-81ea-b7ef49a3ed0f None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:22.173308 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de7b35-959e-45c1-81ea-b7ef49a3ed0f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:22.173589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de7b35-959e-45c1-81ea-b7ef49a3ed0f None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:22.174338 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de7b35-959e-45c1-81ea-b7ef49a3ed0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:22.174652 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de7b35-959e-45c1-81ea-b7ef49a3ed0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:22.176064 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de7b35-959e-45c1-81ea-b7ef49a3ed0f None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:22.184850 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 558/1096] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:34:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:22.190438 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de7b35-959e-45c1-81ea-b7ef49a3ed0f None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:22.205102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 539/1097] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:34:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 27 18:34:22.206055 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269c9e4-57a2-433f-8ffc-d84023f55f13 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:22.217052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:22.289325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de7b35-959e-45c1-81ea-b7ef49a3ed0f None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:22.291510 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:22.303762 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269c9e4-57a2-433f-8ffc-d84023f55f13 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:22.322798 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e3aa2-f60a-41c9-ae1c-76f620efc45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:22.323701 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3aa2-f60a-41c9-ae1c-76f620efc45c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:22.323985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3aa2-f60a-41c9-ae1c-76f620efc45c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:22.324262 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e3aa2-f60a-41c9-ae1c-76f620efc45c None admin] PATH_INFO: `/v3/users/b1c89a9da6a241acbf5e4d8a0d26641d` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:22.325475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e3aa2-f60a-41c9-ae1c-76f620efc45c None admin] RBAC: Authorizing `identity:get_user(user_id=b1c89a9da6a241acbf5e4d8a0d26641d)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:22.326914 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e3aa2-f60a-41c9-ae1c-76f620efc45c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:22.328588 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 559/1098] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:34:22 2022] GET /identity/v3/users/b1c89a9da6a241acbf5e4d8a0d26641d => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:22.334617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e3aa2-f60a-41c9-ae1c-76f620efc45c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:22.337711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b4ccc-00f2-439f-8919-8ff74462b13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:22.338502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b4ccc-00f2-439f-8919-8ff74462b13e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:22.338791 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b4ccc-00f2-439f-8919-8ff74462b13e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:22.339075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b4ccc-00f2-439f-8919-8ff74462b13e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:22.349568 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b4ccc-00f2-439f-8919-8ff74462b13e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:22.351010 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b4ccc-00f2-439f-8919-8ff74462b13e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:22.368315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-f77b4ccc-00f2-439f-8919-8ff74462b13e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:22.368315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:22.368315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:22.368315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:22.368315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:22.368315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:22.368315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:22.368315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:22.368315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:22.368315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:22.368315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:22.368315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:22.368315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:34:22.368315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:34:22.368315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:34:22.369384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:34:22.369384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:22.369384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:22.369384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:22.369384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:22.369384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:22.369384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:22.369384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:22.369384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:22.369384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:22.369384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:22.369384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:22.369384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:22.369384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:22.369384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:22.369384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:22.369384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:22.370593 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:34:22.370593 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:34:22.370593 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:34:22.370593 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:22.370593 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 540/1099] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:34:22.375051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b4ccc-00f2-439f-8919-8ff74462b13e None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:22.435030 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:22.435447 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e3aa2-f60a-41c9-ae1c-76f620efc45c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:22.469388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f6a97-34db-42be-b835-a08424d24999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:22.470040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f6a97-34db-42be-b835-a08424d24999 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:22.470361 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f6a97-34db-42be-b835-a08424d24999 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:22.470642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f6a97-34db-42be-b835-a08424d24999 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:22.474762 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b4ccc-00f2-439f-8919-8ff74462b13e None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:22.508756 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f86ea9-9a27-495d-87de-79af0718c9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:22.509416 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f86ea9-9a27-495d-87de-79af0718c9b7 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:22.509710 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f86ea9-9a27-495d-87de-79af0718c9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:22.509994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f86ea9-9a27-495d-87de-79af0718c9b7 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:22.510729 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f86ea9-9a27-495d-87de-79af0718c9b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:22.511045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f86ea9-9a27-495d-87de-79af0718c9b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:22.512471 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f86ea9-9a27-495d-87de-79af0718c9b7 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:22.513737 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:22.525586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 541/1100] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:34:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:22.531176 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f86ea9-9a27-495d-87de-79af0718c9b7 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:22.541976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f6a97-34db-42be-b835-a08424d24999 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:22.543367 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f6a97-34db-42be-b835-a08424d24999 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:22.629726 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f86ea9-9a27-495d-87de-79af0718c9b7 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:22.639686 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 560/1101] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:34:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 27 18:34:22.645540 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f6a97-34db-42be-b835-a08424d24999 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:22.651057 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:22.662730 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3556b9-5372-4179-83a9-36224b7fe220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:22.663638 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3556b9-5372-4179-83a9-36224b7fe220 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:22.664018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3556b9-5372-4179-83a9-36224b7fe220 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:22.664307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3556b9-5372-4179-83a9-36224b7fe220 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:22.670818 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3556b9-5372-4179-83a9-36224b7fe220 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:22.672278 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3556b9-5372-4179-83a9-36224b7fe220 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:22.686727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-dc3556b9-5372-4179-83a9-36224b7fe220 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:34:22.686727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:22.686727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:22.686727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:22.686727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:22.686727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:22.686727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:22.686727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:22.686727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:22.686727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:22.686727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:22.686727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:22.686727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:34:22.686727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:34:22.686727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:34:22.687862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:34:22.687862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:22.687862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:22.687862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:22.687862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:22.687862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:22.687862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:22.687862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:22.687862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:22.687862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:22.687862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:22.687862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:22.687862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:22.687862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:22.687862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:22.687862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:22.687862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:22.689153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:34:22.689153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:34:22.689153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:34:22.689153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:34:22.689153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:34:22.689153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:34:22.689153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:34:22.689153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:22.689153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 542/1102] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:34:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:34:22.693572 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3556b9-5372-4179-83a9-36224b7fe220 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:22.716461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:22.746671 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f6a97-34db-42be-b835-a08424d24999 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:22.780376 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40948c1-cbe6-4a85-9d0d-46bed130db3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:22.781225 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40948c1-cbe6-4a85-9d0d-46bed130db3b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:22.781504 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40948c1-cbe6-4a85-9d0d-46bed130db3b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:22.781775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40948c1-cbe6-4a85-9d0d-46bed130db3b None admin] PATH_INFO: `/v3/projects/b650e3ec2ee34ade9faf1f8e7b6ffd8c` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:22.782932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40948c1-cbe6-4a85-9d0d-46bed130db3b None admin] RBAC: Authorizing `identity:get_project(project_id=b650e3ec2ee34ade9faf1f8e7b6ffd8c)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:22.784384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40948c1-cbe6-4a85-9d0d-46bed130db3b None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:22.786679 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 561/1103] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:34:22 2022] GET /identity/v3/projects/b650e3ec2ee34ade9faf1f8e7b6ffd8c => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:22.792702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40948c1-cbe6-4a85-9d0d-46bed130db3b None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:22.794400 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3556b9-5372-4179-83a9-36224b7fe220 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:22.829305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63691052-ff63-45b6-abe1-f7ed59043dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:22.830107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63691052-ff63-45b6-abe1-f7ed59043dc3 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:22.830394 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63691052-ff63-45b6-abe1-f7ed59043dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:22.830685 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63691052-ff63-45b6-abe1-f7ed59043dc3 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:22.832072 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63691052-ff63-45b6-abe1-f7ed59043dc3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:22.832390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63691052-ff63-45b6-abe1-f7ed59043dc3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:22.833877 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63691052-ff63-45b6-abe1-f7ed59043dc3 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:22.845443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 543/1104] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:34:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:22.852087 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63691052-ff63-45b6-abe1-f7ed59043dc3 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:22.889725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40948c1-cbe6-4a85-9d0d-46bed130db3b None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:22.893857 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:22.924503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a822ee5-0f6e-463c-b1f4-824e2b1bc4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:22.925194 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a822ee5-0f6e-463c-b1f4-824e2b1bc4e2 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:22.925485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a822ee5-0f6e-463c-b1f4-824e2b1bc4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:22.925766 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a822ee5-0f6e-463c-b1f4-824e2b1bc4e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:22.926589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a822ee5-0f6e-463c-b1f4-824e2b1bc4e2 None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=b650e3ec2ee34ade9faf1f8e7b6ffd8c, user.id=b1c89a9da6a241acbf5e4d8a0d26641d) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:22.926908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a822ee5-0f6e-463c-b1f4-824e2b1bc4e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:22.928431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a822ee5-0f6e-463c-b1f4-824e2b1bc4e2 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:22.934243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 562/1105] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:34:22 2022] GET /identity/v3/role_assignments?user.id=b1c89a9da6a241acbf5e4d8a0d26641d&scope.project.id=b650e3ec2ee34ade9faf1f8e7b6ffd8c&role.id=b156409c977248e1b23c26e589b1e04f => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:22.950241 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63691052-ff63-45b6-abe1-f7ed59043dc3 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:22.987096 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8cd27-83d7-4fc2-9449-bfee64926508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:22.987827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8cd27-83d7-4fc2-9449-bfee64926508 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:22.988110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8cd27-83d7-4fc2-9449-bfee64926508 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:22.988383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8cd27-83d7-4fc2-9449-bfee64926508 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:22.989235 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8cd27-83d7-4fc2-9449-bfee64926508 None admin] RBAC: Adding query filter params (role.id=bd1fd5ae539d44b2be1d4ee708a949c9, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=da1746d29f9e4e8b8626ad4b11931cbd) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:22.989549 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8cd27-83d7-4fc2-9449-bfee64926508 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:22.991019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da8cd27-83d7-4fc2-9449-bfee64926508 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:22.997687 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 544/1106] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:34:22 2022] GET /identity/v3/role_assignments?user.id=da1746d29f9e4e8b8626ad4b11931cbd&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=bd1fd5ae539d44b2be1d4ee708a949c9 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:24.975144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f46faa-715d-4fc0-9b9b-42a405d5a3f0 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:24.975725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f46faa-715d-4fc0-9b9b-42a405d5a3f0 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:24.975725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f46faa-715d-4fc0-9b9b-42a405d5a3f0 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:24.977078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 563/1107] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:24.982551 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17820d5c-e5a8-49c5-ba47-68ab0acf589a None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:24.982923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17820d5c-e5a8-49c5-ba47-68ab0acf589a None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:24.983206 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17820d5c-e5a8-49c5-ba47-68ab0acf589a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:25.000026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-17820d5c-e5a8-49c5-ba47-68ab0acf589a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:25.001213 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-17820d5c-e5a8-49c5-ba47-68ab0acf589a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:25.066956 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 545/1108] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:25.091319 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f46faa-715d-4fc0-9b9b-42a405d5a3f0 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:25.095075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:25.189069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f46faa-715d-4fc0-9b9b-42a405d5a3f0 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:25.221373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8884a-e7ad-4c27-81b2-07f0d98cb73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:25.222171 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8884a-e7ad-4c27-81b2-07f0d98cb73a None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:25.222455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8884a-e7ad-4c27-81b2-07f0d98cb73a None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:25.222733 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8884a-e7ad-4c27-81b2-07f0d98cb73a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:25.223923 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8884a-e7ad-4c27-81b2-07f0d98cb73a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:25.225397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8884a-e7ad-4c27-81b2-07f0d98cb73a None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:25.226927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 564/1109] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:25.232847 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17820d5c-e5a8-49c5-ba47-68ab0acf589a None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:25.266702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:25.328656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17820d5c-e5a8-49c5-ba47-68ab0acf589a None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:25.360704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b319fed0-2b96-48a4-aca8-68d38e237e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:25.361355 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319fed0-2b96-48a4-aca8-68d38e237e21 None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:25.361641 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319fed0-2b96-48a4-aca8-68d38e237e21 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:25.361921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319fed0-2b96-48a4-aca8-68d38e237e21 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:25.363110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319fed0-2b96-48a4-aca8-68d38e237e21 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:25.364563 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b319fed0-2b96-48a4-aca8-68d38e237e21 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:25.437485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 546/1110] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:34:25 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:34:27.480578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d82fa-a5a6-42e7-b5c3-8c8b80571c0a None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:27.481111 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d82fa-a5a6-42e7-b5c3-8c8b80571c0a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:27.481111 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d82fa-a5a6-42e7-b5c3-8c8b80571c0a None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:27.482481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 565/1111] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:27.488206 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aade4-af5f-4e4d-9c04-8ad46347aa14 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:27.488629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aade4-af5f-4e4d-9c04-8ad46347aa14 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:27.488768 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985aade4-af5f-4e4d-9c04-8ad46347aa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:27.505625 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-985aade4-af5f-4e4d-9c04-8ad46347aa14 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:27.506816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-985aade4-af5f-4e4d-9c04-8ad46347aa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:27.571460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 547/1112] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:27.594864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d82fa-a5a6-42e7-b5c3-8c8b80571c0a None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:27.663628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:27.692430 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d82fa-a5a6-42e7-b5c3-8c8b80571c0a None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:27.725258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88b109-f285-4fd1-9002-e3f45f73f517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:27.726102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88b109-f285-4fd1-9002-e3f45f73f517 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:27.726388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88b109-f285-4fd1-9002-e3f45f73f517 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:27.726668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88b109-f285-4fd1-9002-e3f45f73f517 None admin] PATH_INFO: `/v3/roles/422c41a081a44a4e8b04f4d9ce6e8930` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:27.728169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88b109-f285-4fd1-9002-e3f45f73f517 None admin] RBAC: Authorizing `identity:get_role(role_id=422c41a081a44a4e8b04f4d9ce6e8930)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:27.729546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88b109-f285-4fd1-9002-e3f45f73f517 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:27.731220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 566/1113] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:34:27 2022] GET /identity/v3/roles/422c41a081a44a4e8b04f4d9ce6e8930 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:27.736785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aade4-af5f-4e4d-9c04-8ad46347aa14 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:27.759871 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:27.831587 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985aade4-af5f-4e4d-9c04-8ad46347aa14 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:27.865457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c0918-78d9-48fd-8122-27eb05b4e06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:27.866315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c0918-78d9-48fd-8122-27eb05b4e06f None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:27.866602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c0918-78d9-48fd-8122-27eb05b4e06f None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:27.866880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6c0918-78d9-48fd-8122-27eb05b4e06f None admin] PATH_INFO: `/v3/users/fffba62065c44fb5a5c10762b0d795e6` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:27.879543 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c0918-78d9-48fd-8122-27eb05b4e06f None admin] RBAC: Authorizing `identity:get_user(user_id=fffba62065c44fb5a5c10762b0d795e6)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:27.880996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6c0918-78d9-48fd-8122-27eb05b4e06f None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:27.882630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 548/1114] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:34:27 2022] GET /identity/v3/users/fffba62065c44fb5a5c10762b0d795e6 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:27.888331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88b109-f285-4fd1-9002-e3f45f73f517 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:27.986462 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88b109-f285-4fd1-9002-e3f45f73f517 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:28.018844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d217f2-1336-4dfe-872e-93f986594af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:28.019508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d217f2-1336-4dfe-872e-93f986594af3 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:28.020331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d217f2-1336-4dfe-872e-93f986594af3 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:28.020613 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d217f2-1336-4dfe-872e-93f986594af3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:28.030611 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:28.086169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d217f2-1336-4dfe-872e-93f986594af3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:28.087644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d217f2-1336-4dfe-872e-93f986594af3 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:28.181727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 567/1115] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:34:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:34:28.187661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c0918-78d9-48fd-8122-27eb05b4e06f None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:28.265307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:28.283349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6c0918-78d9-48fd-8122-27eb05b4e06f None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:28.316396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e67b3d-7224-491a-9ce9-97b549c8e45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:28.317239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e67b3d-7224-491a-9ce9-97b549c8e45a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:28.317521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e67b3d-7224-491a-9ce9-97b549c8e45a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:28.317796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e67b3d-7224-491a-9ce9-97b549c8e45a None admin] PATH_INFO: `/v3/projects/b650e3ec2ee34ade9faf1f8e7b6ffd8c` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:28.318957 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e67b3d-7224-491a-9ce9-97b549c8e45a None admin] RBAC: Authorizing `identity:get_project(project_id=b650e3ec2ee34ade9faf1f8e7b6ffd8c)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:28.320406 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e67b3d-7224-491a-9ce9-97b549c8e45a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:28.322079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 549/1116] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:34:28 2022] GET /identity/v3/projects/b650e3ec2ee34ade9faf1f8e7b6ffd8c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:28.327949 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d217f2-1336-4dfe-872e-93f986594af3 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:28.367971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:28.423477 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d217f2-1336-4dfe-872e-93f986594af3 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:28.455878 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d075a7-d89f-46ec-99a8-64601352e166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:28.456513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d075a7-d89f-46ec-99a8-64601352e166 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:28.456793 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d075a7-d89f-46ec-99a8-64601352e166 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:28.457067 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d075a7-d89f-46ec-99a8-64601352e166 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:28.458432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d075a7-d89f-46ec-99a8-64601352e166 None admin] RBAC: Adding query filter params (role.id=422c41a081a44a4e8b04f4d9ce6e8930, scope.project.id=b650e3ec2ee34ade9faf1f8e7b6ffd8c, user.id=fffba62065c44fb5a5c10762b0d795e6) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:28.458768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d075a7-d89f-46ec-99a8-64601352e166 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:28.460217 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d075a7-d89f-46ec-99a8-64601352e166 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:28.465539 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 568/1117] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:34:28 2022] GET /identity/v3/role_assignments?user.id=fffba62065c44fb5a5c10762b0d795e6&scope.project.id=b650e3ec2ee34ade9faf1f8e7b6ffd8c&role.id=422c41a081a44a4e8b04f4d9ce6e8930 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:30.460642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428f2a3-b81d-4c88-9abb-fe0cd133a8a5 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:30.461230 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428f2a3-b81d-4c88-9abb-fe0cd133a8a5 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:30.461230 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428f2a3-b81d-4c88-9abb-fe0cd133a8a5 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:30.462563 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 550/1118] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:30.467641 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aaf1a-cf5d-4e73-9551-aa0324ab8da6 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:30.468094 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aaf1a-cf5d-4e73-9551-aa0324ab8da6 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:30.468199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19aaf1a-cf5d-4e73-9551-aa0324ab8da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:30.484761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-a19aaf1a-cf5d-4e73-9551-aa0324ab8da6 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:30.485929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a19aaf1a-cf5d-4e73-9551-aa0324ab8da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:30.549975 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 569/1119] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:30.573013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428f2a3-b81d-4c88-9abb-fe0cd133a8a5 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:30.674539 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428f2a3-b81d-4c88-9abb-fe0cd133a8a5 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:30.709454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc95d5-1b06-43b6-a79b-50ca57f1ff62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:30.710290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc95d5-1b06-43b6-a79b-50ca57f1ff62 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:30.710574 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc95d5-1b06-43b6-a79b-50ca57f1ff62 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:30.710902 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc95d5-1b06-43b6-a79b-50ca57f1ff62 None admin] PATH_INFO: `/v3/roles/422c41a081a44a4e8b04f4d9ce6e8930` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:30.712326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc95d5-1b06-43b6-a79b-50ca57f1ff62 None admin] RBAC: Authorizing `identity:get_role(role_id=422c41a081a44a4e8b04f4d9ce6e8930)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:30.713687 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc95d5-1b06-43b6-a79b-50ca57f1ff62 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:30.715038 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 551/1120] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:34:30 2022] GET /identity/v3/roles/422c41a081a44a4e8b04f4d9ce6e8930 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:30.720633 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aaf1a-cf5d-4e73-9551-aa0324ab8da6 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:30.753957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:30.815974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19aaf1a-cf5d-4e73-9551-aa0324ab8da6 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:30.847435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743ef75-b884-4942-ada2-3ba88ae7aad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:30.848819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743ef75-b884-4942-ada2-3ba88ae7aad7 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:30.849098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743ef75-b884-4942-ada2-3ba88ae7aad7 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:30.849369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743ef75-b884-4942-ada2-3ba88ae7aad7 None admin] PATH_INFO: `/v3/users/fffba62065c44fb5a5c10762b0d795e6` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:30.850535 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743ef75-b884-4942-ada2-3ba88ae7aad7 None admin] RBAC: Authorizing `identity:get_user(user_id=fffba62065c44fb5a5c10762b0d795e6)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:30.851993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743ef75-b884-4942-ada2-3ba88ae7aad7 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:30.853581 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 570/1121] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:34:30 2022] GET /identity/v3/users/fffba62065c44fb5a5c10762b0d795e6 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:30.859642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc95d5-1b06-43b6-a79b-50ca57f1ff62 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:30.877589 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:30.956392 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc95d5-1b06-43b6-a79b-50ca57f1ff62 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:30.992564 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6987a-2efd-4a74-af36-a0ae4896ee99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:30.993353 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6987a-2efd-4a74-af36-a0ae4896ee99 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:30.993638 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6987a-2efd-4a74-af36-a0ae4896ee99 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:30.993918 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6987a-2efd-4a74-af36-a0ae4896ee99 None admin] PATH_INFO: `/v3/projects/b650e3ec2ee34ade9faf1f8e7b6ffd8c` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:30.995079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6987a-2efd-4a74-af36-a0ae4896ee99 None admin] RBAC: Authorizing `identity:get_project(project_id=b650e3ec2ee34ade9faf1f8e7b6ffd8c)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:30.996537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6987a-2efd-4a74-af36-a0ae4896ee99 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:30.998226 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 552/1122] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:34:30 2022] GET /identity/v3/projects/b650e3ec2ee34ade9faf1f8e7b6ffd8c => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:31.004063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743ef75-b884-4942-ada2-3ba88ae7aad7 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:31.100636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743ef75-b884-4942-ada2-3ba88ae7aad7 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:31.102125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:31.133744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70cce7-e24a-44c8-89fd-b1b17c560047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:31.134628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70cce7-e24a-44c8-89fd-b1b17c560047 None admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:31.134915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70cce7-e24a-44c8-89fd-b1b17c560047 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:31.135193 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70cce7-e24a-44c8-89fd-b1b17c560047 None admin] PATH_INFO: `/v3/projects/b650e3ec2ee34ade9faf1f8e7b6ffd8c/users/fffba62065c44fb5a5c10762b0d795e6/roles/422c41a081a44a4e8b04f4d9ce6e8930` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:31.137429 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70cce7-e24a-44c8-89fd-b1b17c560047 None admin] RBAC: Authorizing `identity:create_grant(project_id=b650e3ec2ee34ade9faf1f8e7b6ffd8c, user_id=fffba62065c44fb5a5c10762b0d795e6, role_id=422c41a081a44a4e8b04f4d9ce6e8930)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:31.138864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70cce7-e24a-44c8-89fd-b1b17c560047 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:31.196802 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 571/1123] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:34:31 2022] PUT /identity/v3/projects/b650e3ec2ee34ade9faf1f8e7b6ffd8c/users/fffba62065c44fb5a5c10762b0d795e6/roles/422c41a081a44a4e8b04f4d9ce6e8930 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:34:33.190765 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23defaf8-b824-431e-bb86-d1a62b37b075 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:33.191837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23defaf8-b824-431e-bb86-d1a62b37b075 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:33.191949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23defaf8-b824-431e-bb86-d1a62b37b075 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:33.193251 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 553/1124] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:33.198390 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8b29d-2375-4d96-a68a-1f441125a3a1 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:33.198808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8b29d-2375-4d96-a68a-1f441125a3a1 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:33.198949 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b8b29d-2375-4d96-a68a-1f441125a3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:33.215417 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-13b8b29d-2375-4d96-a68a-1f441125a3a1 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:33.216629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-13b8b29d-2375-4d96-a68a-1f441125a3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:33.280941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 572/1125] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:33.304511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23defaf8-b824-431e-bb86-d1a62b37b075 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:33.388315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:33.404035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23defaf8-b824-431e-bb86-d1a62b37b075 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:33.436118 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8bc0b-9dcd-4d79-bc7f-4501fa89939e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:33.436962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8bc0b-9dcd-4d79-bc7f-4501fa89939e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:33.437250 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8bc0b-9dcd-4d79-bc7f-4501fa89939e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:33.437530 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8bc0b-9dcd-4d79-bc7f-4501fa89939e None admin] PATH_INFO: `/v3/roles/422c41a081a44a4e8b04f4d9ce6e8930` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:33.439010 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8bc0b-9dcd-4d79-bc7f-4501fa89939e None admin] RBAC: Authorizing `identity:get_role(role_id=422c41a081a44a4e8b04f4d9ce6e8930)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:33.440405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8bc0b-9dcd-4d79-bc7f-4501fa89939e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:33.442429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 554/1126] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:34:33 2022] GET /identity/v3/roles/422c41a081a44a4e8b04f4d9ce6e8930 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:33.448056 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8b29d-2375-4d96-a68a-1f441125a3a1 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:33.535141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:33.543456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b8b29d-2375-4d96-a68a-1f441125a3a1 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:33.577813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa789f6-e51a-445c-865f-38274f736c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:33.578675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa789f6-e51a-445c-865f-38274f736c18 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:33.578960 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa789f6-e51a-445c-865f-38274f736c18 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:33.579236 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa789f6-e51a-445c-865f-38274f736c18 None admin] PATH_INFO: `/v3/users/fffba62065c44fb5a5c10762b0d795e6` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:33.580457 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa789f6-e51a-445c-865f-38274f736c18 None admin] RBAC: Authorizing `identity:get_user(user_id=fffba62065c44fb5a5c10762b0d795e6)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:33.581887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa789f6-e51a-445c-865f-38274f736c18 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:33.583521 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 573/1127] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:34:33 2022] GET /identity/v3/users/fffba62065c44fb5a5c10762b0d795e6 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:33.589204 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8bc0b-9dcd-4d79-bc7f-4501fa89939e None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:33.686273 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8bc0b-9dcd-4d79-bc7f-4501fa89939e None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:33.718643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924989e1-c831-42d2-8167-64f5b795d05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:33.719221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924989e1-c831-42d2-8167-64f5b795d05a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:33.719506 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924989e1-c831-42d2-8167-64f5b795d05a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:33.719816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924989e1-c831-42d2-8167-64f5b795d05a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:33.741115 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:33.786120 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924989e1-c831-42d2-8167-64f5b795d05a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:33.787579 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924989e1-c831-42d2-8167-64f5b795d05a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:33.881858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 555/1128] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:34:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:34:33.887626 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa789f6-e51a-445c-865f-38274f736c18 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:33.983504 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa789f6-e51a-445c-865f-38274f736c18 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:34.015481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561756c6-9259-41cd-bf4f-5bdcb2a44684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:34.016368 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561756c6-9259-41cd-bf4f-5bdcb2a44684 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:34.016650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561756c6-9259-41cd-bf4f-5bdcb2a44684 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:34.016923 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561756c6-9259-41cd-bf4f-5bdcb2a44684 None admin] PATH_INFO: `/v3/projects/b650e3ec2ee34ade9faf1f8e7b6ffd8c` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:34.018087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561756c6-9259-41cd-bf4f-5bdcb2a44684 None admin] RBAC: Authorizing `identity:get_project(project_id=b650e3ec2ee34ade9faf1f8e7b6ffd8c)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:34.020050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561756c6-9259-41cd-bf4f-5bdcb2a44684 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:34.021711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 574/1129] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:34:33 2022] GET /identity/v3/projects/b650e3ec2ee34ade9faf1f8e7b6ffd8c => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:34.027688 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924989e1-c831-42d2-8167-64f5b795d05a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:34.077536 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:34.123011 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924989e1-c831-42d2-8167-64f5b795d05a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:34.155585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a489e35-adc5-49f6-8854-101e17da073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:34.156218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a489e35-adc5-49f6-8854-101e17da073b None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:34.156497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a489e35-adc5-49f6-8854-101e17da073b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:34.156770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a489e35-adc5-49f6-8854-101e17da073b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:34.157588 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a489e35-adc5-49f6-8854-101e17da073b None admin] RBAC: Adding query filter params (role.id=422c41a081a44a4e8b04f4d9ce6e8930, scope.project.id=b650e3ec2ee34ade9faf1f8e7b6ffd8c, user.id=fffba62065c44fb5a5c10762b0d795e6) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:34.157897 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a489e35-adc5-49f6-8854-101e17da073b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:34.159302 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a489e35-adc5-49f6-8854-101e17da073b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:34.165507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 556/1130] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:34:34 2022] GET /identity/v3/role_assignments?user.id=fffba62065c44fb5a5c10762b0d795e6&scope.project.id=b650e3ec2ee34ade9faf1f8e7b6ffd8c&role.id=422c41a081a44a4e8b04f4d9ce6e8930 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:36.168402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10bb74-c6b7-49b2-b3b4-836e44a1601d None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:36.168957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10bb74-c6b7-49b2-b3b4-836e44a1601d None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:36.168957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10bb74-c6b7-49b2-b3b4-836e44a1601d None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:36.170308 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 575/1131] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:36.175379 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2c342-776a-4df7-ab5e-09c1e2d481bb None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:36.175785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2c342-776a-4df7-ab5e-09c1e2d481bb None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:36.175965 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2c342-776a-4df7-ab5e-09c1e2d481bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:36.192667 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-47f2c342-776a-4df7-ab5e-09c1e2d481bb None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:36.193835 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-47f2c342-776a-4df7-ab5e-09c1e2d481bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:36.257946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 557/1132] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:36.280396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10bb74-c6b7-49b2-b3b4-836e44a1601d None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:36.308219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:36.378401 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10bb74-c6b7-49b2-b3b4-836e44a1601d None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:36.410946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b530554-1f47-4bc5-a0c8-596e901c7d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:36.411749 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b530554-1f47-4bc5-a0c8-596e901c7d54 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:36.412040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b530554-1f47-4bc5-a0c8-596e901c7d54 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:36.412316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b530554-1f47-4bc5-a0c8-596e901c7d54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:36.413488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b530554-1f47-4bc5-a0c8-596e901c7d54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:36.414916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b530554-1f47-4bc5-a0c8-596e901c7d54 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:36.416538 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 576/1133] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:36.422170 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2c342-776a-4df7-ab5e-09c1e2d481bb None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:36.466651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:36.520229 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2c342-776a-4df7-ab5e-09c1e2d481bb None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:36.552670 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e0680-8c76-4f01-8a62-da55c9dea096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:36.553313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e0680-8c76-4f01-8a62-da55c9dea096 None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:36.553595 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e0680-8c76-4f01-8a62-da55c9dea096 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:36.553870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e0680-8c76-4f01-8a62-da55c9dea096 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:36.554563 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e0680-8c76-4f01-8a62-da55c9dea096 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:36.556019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2e0680-8c76-4f01-8a62-da55c9dea096 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:36.637531 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 558/1134] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jun 27 18:34:36 2022] POST /identity/v3/projects => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:34:38.685483 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8869994-e860-40c1-86c7-1b2efda0f5cd None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:38.686028 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8869994-e860-40c1-86c7-1b2efda0f5cd None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:38.686028 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8869994-e860-40c1-86c7-1b2efda0f5cd None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:38.687407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 577/1135] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:38.692960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b27d21-0918-4bc2-a6ba-8e9631c3bb0c None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:38.693375 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b27d21-0918-4bc2-a6ba-8e9631c3bb0c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:38.693515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b27d21-0918-4bc2-a6ba-8e9631c3bb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:38.709800 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-d9b27d21-0918-4bc2-a6ba-8e9631c3bb0c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:38.710977 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d9b27d21-0918-4bc2-a6ba-8e9631c3bb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:38.774960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 559/1136] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:34:38.799032 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8869994-e860-40c1-86c7-1b2efda0f5cd None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:38.890209 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:38.896525 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8869994-e860-40c1-86c7-1b2efda0f5cd None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:38.929425 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f769f-91d6-4ee7-a334-f083a5321782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:38.930198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f769f-91d6-4ee7-a334-f083a5321782 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:38.930479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f769f-91d6-4ee7-a334-f083a5321782 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:38.930753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f769f-91d6-4ee7-a334-f083a5321782 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:38.931937 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f769f-91d6-4ee7-a334-f083a5321782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:38.933361 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f769f-91d6-4ee7-a334-f083a5321782 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:38.934942 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 578/1137] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:34:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:38.940613 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b27d21-0918-4bc2-a6ba-8e9631c3bb0c None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:38.968271 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:39.038530 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b27d21-0918-4bc2-a6ba-8e9631c3bb0c None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:39.071415 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a87a75-9525-4d49-a9f6-cdc5011763e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:39.072113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a87a75-9525-4d49-a9f6-cdc5011763e1 None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:39.072402 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a87a75-9525-4d49-a9f6-cdc5011763e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:39.072683 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a87a75-9525-4d49-a9f6-cdc5011763e1 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:39.073403 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a87a75-9525-4d49-a9f6-cdc5011763e1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:39.074835 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a87a75-9525-4d49-a9f6-cdc5011763e1 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:39.168149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 560/1138] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:34:38 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:34:41.201961 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229df480-a12c-4555-85c6-503b21a98a1f None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:41.202522 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229df480-a12c-4555-85c6-503b21a98a1f None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:41.202522 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229df480-a12c-4555-85c6-503b21a98a1f None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:41.203898 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 579/1139] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:41.209487 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5850629-a261-4b5c-98f4-2b382290aabd None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:41.209860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5850629-a261-4b5c-98f4-2b382290aabd None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:41.210062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5850629-a261-4b5c-98f4-2b382290aabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:41.226286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-b5850629-a261-4b5c-98f4-2b382290aabd None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:41.227473 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b5850629-a261-4b5c-98f4-2b382290aabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:41.293085 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 561/1140] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:41.316335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229df480-a12c-4555-85c6-503b21a98a1f None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:41.413769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229df480-a12c-4555-85c6-503b21a98a1f None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:41.445844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d719350-7705-4982-babb-a1e2326fd50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:41.446610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d719350-7705-4982-babb-a1e2326fd50c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:41.446892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d719350-7705-4982-babb-a1e2326fd50c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:41.447166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d719350-7705-4982-babb-a1e2326fd50c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:41.457464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d719350-7705-4982-babb-a1e2326fd50c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:34:41.464981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-0d719350-7705-4982-babb-a1e2326fd50c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:34:41.464981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:41.464981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:41.464981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:41.464981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:41.464981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:41.464981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:41.464981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:41.464981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:41.464981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:41.464981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:41.464981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:41.464981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:34:41.464981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:34:41.464981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:34:41.464981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:34:41.466141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:34:41.466141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:34:41.466141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:34:41.466141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:34:41.466141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:41.466141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:41.466141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:41.466141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:41.466141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:41.466141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:41.466141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:41.466141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:41.466141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:41.466141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:41.466141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:41.466141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:41.467405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:41.467405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:41.467405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:41.467405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:41.467405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:34:41.467405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:34:41.467405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:34:41.467405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:34:41.467405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:34:41.467405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:34:41.467405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:34:41.467405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:41.467405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 580/1141] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:34:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:41.471785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5850629-a261-4b5c-98f4-2b382290aabd None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:41.486359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:41.569321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5850629-a261-4b5c-98f4-2b382290aabd None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:41.601466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad085eba-7494-437d-a3b7-338640f6efb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:41.602123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad085eba-7494-437d-a3b7-338640f6efb2 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:41.602405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad085eba-7494-437d-a3b7-338640f6efb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:41.602679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad085eba-7494-437d-a3b7-338640f6efb2 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:41.603424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad085eba-7494-437d-a3b7-338640f6efb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:41.603760 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad085eba-7494-437d-a3b7-338640f6efb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:41.605372 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad085eba-7494-437d-a3b7-338640f6efb2 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:41.613630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 562/1142] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:34:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:34:41.619315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d719350-7705-4982-babb-a1e2326fd50c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:41.645224 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:41.717062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d719350-7705-4982-babb-a1e2326fd50c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:41.749542 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3bcb0-ed5e-4950-85fe-24dfecaafcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:41.750398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3bcb0-ed5e-4950-85fe-24dfecaafcd7 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:41.750682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3bcb0-ed5e-4950-85fe-24dfecaafcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:41.750960 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3bcb0-ed5e-4950-85fe-24dfecaafcd7 None admin] PATH_INFO: `/v3/users/567d589b222542fcbeba34e359065909` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:41.763683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3bcb0-ed5e-4950-85fe-24dfecaafcd7 None admin] RBAC: Authorizing `identity:get_user(user_id=567d589b222542fcbeba34e359065909)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:41.765117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3bcb0-ed5e-4950-85fe-24dfecaafcd7 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:41.766734 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 581/1143] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:34:41 2022] GET /identity/v3/users/567d589b222542fcbeba34e359065909 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:41.772876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad085eba-7494-437d-a3b7-338640f6efb2 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:41.849174 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:41.871461 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad085eba-7494-437d-a3b7-338640f6efb2 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:41.905703 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7ee69-e52c-4089-8801-93d0eb84cb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:41.906333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ee69-e52c-4089-8801-93d0eb84cb9e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:41.906624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ee69-e52c-4089-8801-93d0eb84cb9e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:41.906902 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7ee69-e52c-4089-8801-93d0eb84cb9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:41.972993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7ee69-e52c-4089-8801-93d0eb84cb9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:41.974375 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7ee69-e52c-4089-8801-93d0eb84cb9e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:42.048260 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:42.071216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 563/1144] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:34:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:34:42.077053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3bcb0-ed5e-4950-85fe-24dfecaafcd7 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:42.155857 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:42.172702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3bcb0-ed5e-4950-85fe-24dfecaafcd7 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:42.205187 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f3f94f-6147-4fd8-b5dc-94f9782b0b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:42.206006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3f94f-6147-4fd8-b5dc-94f9782b0b07 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:42.206890 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3f94f-6147-4fd8-b5dc-94f9782b0b07 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:42.207430 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f3f94f-6147-4fd8-b5dc-94f9782b0b07 None admin] PATH_INFO: `/v3/projects/0ecc750c5f634539a8867d22d27e9969` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:42.208623 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3f94f-6147-4fd8-b5dc-94f9782b0b07 None admin] RBAC: Authorizing `identity:get_project(project_id=0ecc750c5f634539a8867d22d27e9969)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:42.210037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f3f94f-6147-4fd8-b5dc-94f9782b0b07 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:42.211727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 582/1145] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:34:42 2022] GET /identity/v3/projects/0ecc750c5f634539a8867d22d27e9969 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:42.217662 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7ee69-e52c-4089-8801-93d0eb84cb9e None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:42.313456 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7ee69-e52c-4089-8801-93d0eb84cb9e None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:42.345744 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1ef103-8897-4ec6-99fa-d3af4e5babab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:42.346377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ef103-8897-4ec6-99fa-d3af4e5babab None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:42.346662 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ef103-8897-4ec6-99fa-d3af4e5babab None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:42.347522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1ef103-8897-4ec6-99fa-d3af4e5babab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:42.348374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ef103-8897-4ec6-99fa-d3af4e5babab None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=0ecc750c5f634539a8867d22d27e9969, user.id=567d589b222542fcbeba34e359065909) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:42.348689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ef103-8897-4ec6-99fa-d3af4e5babab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:42.350106 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1ef103-8897-4ec6-99fa-d3af4e5babab None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:42.355623 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 564/1146] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:34:42 2022] GET /identity/v3/role_assignments?user.id=567d589b222542fcbeba34e359065909&scope.project.id=0ecc750c5f634539a8867d22d27e9969&role.id=b156409c977248e1b23c26e589b1e04f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:44.320360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958396b-5487-4b9a-ab9f-9f2416415f17 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:44.320898 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958396b-5487-4b9a-ab9f-9f2416415f17 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:44.321031 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958396b-5487-4b9a-ab9f-9f2416415f17 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:44.322391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 583/1147] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:44.327583 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fd6dd-3c63-4025-bd07-ed4c0956af02 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:44.328031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fd6dd-3c63-4025-bd07-ed4c0956af02 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:44.328148 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7fd6dd-3c63-4025-bd07-ed4c0956af02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:44.347407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-4f7fd6dd-3c63-4025-bd07-ed4c0956af02 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:44.348628 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-4f7fd6dd-3c63-4025-bd07-ed4c0956af02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:44.381538 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:44.412216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 565/1148] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:44.434259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958396b-5487-4b9a-ab9f-9f2416415f17 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:44.532191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958396b-5487-4b9a-ab9f-9f2416415f17 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:44.564502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d49c1-51ef-45f7-af4c-1a04dc90ad94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:44.565277 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d49c1-51ef-45f7-af4c-1a04dc90ad94 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:44.566099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d49c1-51ef-45f7-af4c-1a04dc90ad94 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:44.566372 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d49c1-51ef-45f7-af4c-1a04dc90ad94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:44.576042 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d49c1-51ef-45f7-af4c-1a04dc90ad94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:34:44.583614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-f45d49c1-51ef-45f7-af4c-1a04dc90ad94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:34:44.583614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:44.583614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:44.583614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:44.583614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:44.583614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:44.583614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:44.583614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:44.583614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:44.583614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:44.583614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:44.583614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:44.583614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:34:44.583614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:34:44.583614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:34:44.583614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:34:44.584777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:34:44.584777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:34:44.584777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:34:44.584777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:34:44.584777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:44.584777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:44.584777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:44.584777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:44.584777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:44.584777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:44.584777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:44.584777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:44.584777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:44.584777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:44.584777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:44.584777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:44.586001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:44.586001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:44.586001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:44.586001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:44.586001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:34:44.586001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:34:44.586001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:34:44.586001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:34:44.586001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:34:44.586001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:34:44.586001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:34:44.586001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:44.586001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 584/1149] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:34:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:44.590919 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fd6dd-3c63-4025-bd07-ed4c0956af02 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:44.687739 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7fd6dd-3c63-4025-bd07-ed4c0956af02 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:44.720517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f6a4d-bf6c-4ec5-b4d9-01c0dc2995c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:44.721163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f6a4d-bf6c-4ec5-b4d9-01c0dc2995c0 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:44.721445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f6a4d-bf6c-4ec5-b4d9-01c0dc2995c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:44.721744 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f6a4d-bf6c-4ec5-b4d9-01c0dc2995c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:44.722481 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f6a4d-bf6c-4ec5-b4d9-01c0dc2995c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:44.722785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f6a4d-bf6c-4ec5-b4d9-01c0dc2995c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:44.724206 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f6a4d-bf6c-4ec5-b4d9-01c0dc2995c0 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:44.732377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 566/1150] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:34:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:44.738144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d49c1-51ef-45f7-af4c-1a04dc90ad94 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:44.750465 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:44.838146 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d49c1-51ef-45f7-af4c-1a04dc90ad94 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:44.870678 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9b9e4-5de8-4c0d-a9df-12120db1be55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:44.871549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b9e4-5de8-4c0d-a9df-12120db1be55 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:44.871835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b9e4-5de8-4c0d-a9df-12120db1be55 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:44.872107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b9e4-5de8-4c0d-a9df-12120db1be55 None admin] PATH_INFO: `/v3/users/567d589b222542fcbeba34e359065909` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:44.873270 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9b9e4-5de8-4c0d-a9df-12120db1be55 None admin] RBAC: Authorizing `identity:get_user(user_id=567d589b222542fcbeba34e359065909)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:44.874695 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9b9e4-5de8-4c0d-a9df-12120db1be55 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:44.876329 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 585/1151] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:34:44 2022] GET /identity/v3/users/567d589b222542fcbeba34e359065909 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:44.882004 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f6a4d-bf6c-4ec5-b4d9-01c0dc2995c0 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:44.912895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:44.977854 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f6a4d-bf6c-4ec5-b4d9-01c0dc2995c0 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:45.009916 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37dba08-a455-40e4-8839-6e15dab34b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:45.010762 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dba08-a455-40e4-8839-6e15dab34b78 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:45.011046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dba08-a455-40e4-8839-6e15dab34b78 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:45.011328 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37dba08-a455-40e4-8839-6e15dab34b78 None admin] PATH_INFO: `/v3/projects/0ecc750c5f634539a8867d22d27e9969` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:45.012522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dba08-a455-40e4-8839-6e15dab34b78 None admin] RBAC: Authorizing `identity:get_project(project_id=0ecc750c5f634539a8867d22d27e9969)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:45.013948 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37dba08-a455-40e4-8839-6e15dab34b78 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:45.015646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 567/1152] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:34:44 2022] GET /identity/v3/projects/0ecc750c5f634539a8867d22d27e9969 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:45.021321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9b9e4-5de8-4c0d-a9df-12120db1be55 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:45.095510 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:45.116575 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9b9e4-5de8-4c0d-a9df-12120db1be55 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:45.148261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca2e2f-54e5-4e02-9639-c50b73c77670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:45.149136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca2e2f-54e5-4e02-9639-c50b73c77670 None admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:45.149425 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca2e2f-54e5-4e02-9639-c50b73c77670 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:45.149703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca2e2f-54e5-4e02-9639-c50b73c77670 None admin] PATH_INFO: `/v3/projects/0ecc750c5f634539a8867d22d27e9969/users/567d589b222542fcbeba34e359065909/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:45.151681 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca2e2f-54e5-4e02-9639-c50b73c77670 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ecc750c5f634539a8867d22d27e9969, user_id=567d589b222542fcbeba34e359065909, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:45.153104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca2e2f-54e5-4e02-9639-c50b73c77670 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:45.230350 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 586/1153] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:34:45 2022] PUT /identity/v3/projects/0ecc750c5f634539a8867d22d27e9969/users/567d589b222542fcbeba34e359065909/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:34:47.201347 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6116fd-e814-4f02-9ab9-cfe06ac2a860 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:47.201879 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6116fd-e814-4f02-9ab9-cfe06ac2a860 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:47.201879 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6116fd-e814-4f02-9ab9-cfe06ac2a860 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:47.203279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 568/1154] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:47.209093 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e089e4f-ed6c-428b-80e1-dec61721683c None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:47.209535 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e089e4f-ed6c-428b-80e1-dec61721683c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:47.209656 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e089e4f-ed6c-428b-80e1-dec61721683c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:47.225899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-6e089e4f-ed6c-428b-80e1-dec61721683c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:47.227064 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-6e089e4f-ed6c-428b-80e1-dec61721683c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:47.290546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 587/1155] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:47.313710 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6116fd-e814-4f02-9ab9-cfe06ac2a860 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:47.409917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:47.413653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6116fd-e814-4f02-9ab9-cfe06ac2a860 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:47.446370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90794903-16f2-439c-96cc-53b655831ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:47.447143 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90794903-16f2-439c-96cc-53b655831ba7 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:47.447433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90794903-16f2-439c-96cc-53b655831ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:47.447744 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90794903-16f2-439c-96cc-53b655831ba7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:47.458799 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90794903-16f2-439c-96cc-53b655831ba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:34:47.466446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-90794903-16f2-439c-96cc-53b655831ba7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:34:47.466446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:47.466446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:47.466446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:47.466446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:47.466446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:47.466446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:47.466446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:47.466446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:47.466446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:47.466446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:47.466446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:47.466446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:34:47.466446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:34:47.466446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:34:47.466446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:34:47.467586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:34:47.467586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:34:47.467586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:34:47.467586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:34:47.467586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:47.467586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:47.467586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:47.467586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:47.467586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:47.467586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:47.467586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:47.467586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:47.467586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:47.467586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:47.467586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:47.467586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:47.468788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:47.468788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:47.468788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:47.468788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:47.468788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:34:47.468788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:34:47.468788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:34:47.468788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:34:47.468788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:34:47.468788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:34:47.468788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:34:47.468788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:34:47.468788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 569/1156] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:34:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:47.473439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e089e4f-ed6c-428b-80e1-dec61721683c None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:47.537782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:47.570606 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e089e4f-ed6c-428b-80e1-dec61721683c None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:47.603113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a2f27-25fc-4d9f-9783-d581d4614f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:47.603808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a2f27-25fc-4d9f-9783-d581d4614f9c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:47.604095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a2f27-25fc-4d9f-9783-d581d4614f9c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:47.604373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85a2f27-25fc-4d9f-9783-d581d4614f9c None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:47.605371 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a2f27-25fc-4d9f-9783-d581d4614f9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:47.605683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a2f27-25fc-4d9f-9783-d581d4614f9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:47.607129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85a2f27-25fc-4d9f-9783-d581d4614f9c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:47.615667 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 588/1157] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:34:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:47.621357 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90794903-16f2-439c-96cc-53b655831ba7 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:47.716631 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90794903-16f2-439c-96cc-53b655831ba7 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:47.748496 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca103ea-5028-4206-94f3-34861c524e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:47.749348 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca103ea-5028-4206-94f3-34861c524e97 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:47.749630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca103ea-5028-4206-94f3-34861c524e97 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:47.749905 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca103ea-5028-4206-94f3-34861c524e97 None admin] PATH_INFO: `/v3/users/567d589b222542fcbeba34e359065909` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:47.751069 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca103ea-5028-4206-94f3-34861c524e97 None admin] RBAC: Authorizing `identity:get_user(user_id=567d589b222542fcbeba34e359065909)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:47.752508 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca103ea-5028-4206-94f3-34861c524e97 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:47.754651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 570/1158] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:34:47 2022] GET /identity/v3/users/567d589b222542fcbeba34e359065909 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:47.760269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a2f27-25fc-4d9f-9783-d581d4614f9c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:47.857269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85a2f27-25fc-4d9f-9783-d581d4614f9c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:47.884641 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:47.890079 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181d4ce-d409-43d1-a9bb-51b86dbc0e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:47.890714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181d4ce-d409-43d1-a9bb-51b86dbc0e4a None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:47.890999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181d4ce-d409-43d1-a9bb-51b86dbc0e4a None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:47.891278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181d4ce-d409-43d1-a9bb-51b86dbc0e4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:47.956675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181d4ce-d409-43d1-a9bb-51b86dbc0e4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:47.958119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181d4ce-d409-43d1-a9bb-51b86dbc0e4a None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:48.052495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 589/1159] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:34:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:34:48.058223 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca103ea-5028-4206-94f3-34861c524e97 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:48.085388 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:48.152959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca103ea-5028-4206-94f3-34861c524e97 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:48.185270 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f45de1-93fe-4060-9afe-b2af97e79402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:48.186110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f45de1-93fe-4060-9afe-b2af97e79402 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:48.186388 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f45de1-93fe-4060-9afe-b2af97e79402 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:48.186661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f45de1-93fe-4060-9afe-b2af97e79402 None admin] PATH_INFO: `/v3/projects/0ecc750c5f634539a8867d22d27e9969` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:48.187845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f45de1-93fe-4060-9afe-b2af97e79402 None admin] RBAC: Authorizing `identity:get_project(project_id=0ecc750c5f634539a8867d22d27e9969)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:48.189269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f45de1-93fe-4060-9afe-b2af97e79402 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:48.190963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 571/1160] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:34:48 2022] GET /identity/v3/projects/0ecc750c5f634539a8867d22d27e9969 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:48.196895 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181d4ce-d409-43d1-a9bb-51b86dbc0e4a None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:48.226465 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:48.293105 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181d4ce-d409-43d1-a9bb-51b86dbc0e4a None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:48.324861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c755bda-792c-4607-b22e-fb3ff412ae29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:48.325494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c755bda-792c-4607-b22e-fb3ff412ae29 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:48.325777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c755bda-792c-4607-b22e-fb3ff412ae29 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:48.326051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c755bda-792c-4607-b22e-fb3ff412ae29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:48.326861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c755bda-792c-4607-b22e-fb3ff412ae29 None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=0ecc750c5f634539a8867d22d27e9969, user.id=567d589b222542fcbeba34e359065909) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:48.327175 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c755bda-792c-4607-b22e-fb3ff412ae29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:48.328617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c755bda-792c-4607-b22e-fb3ff412ae29 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:48.334761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 590/1161] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:34:48 2022] GET /identity/v3/role_assignments?user.id=567d589b222542fcbeba34e359065909&scope.project.id=0ecc750c5f634539a8867d22d27e9969&role.id=b156409c977248e1b23c26e589b1e04f => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:50.358931 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b86c0a-7f02-48ca-ad18-8d803ffefc81 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:50.359491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b86c0a-7f02-48ca-ad18-8d803ffefc81 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:50.359491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b86c0a-7f02-48ca-ad18-8d803ffefc81 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:50.360881 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 572/1162] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:50.366646 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85231ed4-e2d1-4fb9-9897-94279965a0f5 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:50.367059 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85231ed4-e2d1-4fb9-9897-94279965a0f5 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:50.367248 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85231ed4-e2d1-4fb9-9897-94279965a0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:50.383323 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-85231ed4-e2d1-4fb9-9897-94279965a0f5 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:50.384532 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-85231ed4-e2d1-4fb9-9897-94279965a0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:50.448289 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 591/1163] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:50.470970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b86c0a-7f02-48ca-ad18-8d803ffefc81 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:50.564291 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:50.571094 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b86c0a-7f02-48ca-ad18-8d803ffefc81 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:50.602252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed18814-220d-443f-a3a0-f2c7958b0f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:50.602877 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed18814-220d-443f-a3a0-f2c7958b0f1d None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:50.603157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed18814-220d-443f-a3a0-f2c7958b0f1d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:50.603429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed18814-220d-443f-a3a0-f2c7958b0f1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:50.667042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed18814-220d-443f-a3a0-f2c7958b0f1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:50.668440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed18814-220d-443f-a3a0-f2c7958b0f1d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:50.757149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:50.763167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 573/1164] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:34:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:34:50.771238 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85231ed4-e2d1-4fb9-9897-94279965a0f5 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:50.793250 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:50.865618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85231ed4-e2d1-4fb9-9897-94279965a0f5 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:50.897511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04b371-eab1-46dc-819c-3cfa9a73c4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:50.898295 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04b371-eab1-46dc-819c-3cfa9a73c4f4 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:50.898579 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04b371-eab1-46dc-819c-3cfa9a73c4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:50.898856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04b371-eab1-46dc-819c-3cfa9a73c4f4 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:50.905366 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04b371-eab1-46dc-819c-3cfa9a73c4f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:50.906795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04b371-eab1-46dc-819c-3cfa9a73c4f4 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:50.921216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-2e04b371-eab1-46dc-819c-3cfa9a73c4f4 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 27 18:34:50.921216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:50.921216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 27 18:34:50.921216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 27 18:34:50.921216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:34:50.921216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:34:50.921216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:34:50.921216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:34:50.921216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 27 18:34:50.921216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:50.921216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:34:50.921216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:50.921216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:34:50.921216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:34:50.921216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:34:50.921216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:34:50.921216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:34:50.922432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:34:50.922432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:34:50.922432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:34:50.922432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:34:50.922432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:34:50.922432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:34:50.922432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:34:50.922432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:34:50.922432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:34:50.922432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:34:50.922432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:34:50.922432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:34:50.922432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:34:50.922432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:34:50.922432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:34:50.922432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:34:50.923482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:34:50.923482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:34:50.923482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:34:50.923482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:34:50.923482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:34:50.923482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:34:50.923482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:34:50.923482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:34:50.923482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:34:50.923482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:34:50.923482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 27 18:34:50.923482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:34:50.923482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 27 18:34:50.923482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:34:50.923482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 592/1165] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jun 27 18:34:50 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:34:50.928700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed18814-220d-443f-a3a0-f2c7958b0f1d None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:51.024043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed18814-220d-443f-a3a0-f2c7958b0f1d None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:51.056659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72993d7-7ece-4e31-9e57-ed8a70da16bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:51.057307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72993d7-7ece-4e31-9e57-ed8a70da16bd None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:51.057594 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72993d7-7ece-4e31-9e57-ed8a70da16bd None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:51.057872 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72993d7-7ece-4e31-9e57-ed8a70da16bd None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:51.058591 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72993d7-7ece-4e31-9e57-ed8a70da16bd None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:34:51.058900 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72993d7-7ece-4e31-9e57-ed8a70da16bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:51.060294 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72993d7-7ece-4e31-9e57-ed8a70da16bd None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:51.067781 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 574/1166] 10.222.0.36 () {56 vars in 1115 bytes} [Mon Jun 27 18:34:50 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:53.051497 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd23d3-cca1-45a1-8105-50b05e87d860 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:53.052052 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd23d3-cca1-45a1-8105-50b05e87d860 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:53.052163 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd23d3-cca1-45a1-8105-50b05e87d860 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:53.053432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 593/1167] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:53.058593 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65865945-8ab3-415b-a6dc-6b69fc08f7d9 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:53.059030 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65865945-8ab3-415b-a6dc-6b69fc08f7d9 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:53.059130 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65865945-8ab3-415b-a6dc-6b69fc08f7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:53.075843 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-65865945-8ab3-415b-a6dc-6b69fc08f7d9 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:53.077012 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-65865945-8ab3-415b-a6dc-6b69fc08f7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:53.130282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:53.140691 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 575/1168] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:53.164557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd23d3-cca1-45a1-8105-50b05e87d860 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:53.249590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:53.265957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd23d3-cca1-45a1-8105-50b05e87d860 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:53.299627 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d1886-9cd3-4152-a72b-0f2128b27a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:53.300856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d1886-9cd3-4152-a72b-0f2128b27a3d None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:53.301144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d1886-9cd3-4152-a72b-0f2128b27a3d None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:53.301423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d1886-9cd3-4152-a72b-0f2128b27a3d None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:53.302211 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d1886-9cd3-4152-a72b-0f2128b27a3d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:53.303562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d1886-9cd3-4152-a72b-0f2128b27a3d None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:53.379472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 594/1169] 10.222.0.36 () {60 vars in 1138 bytes} [Mon Jun 27 18:34:53 2022] POST /identity/v3/domains => generated 267 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:34:55.407189 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f607f7-3736-419d-93c3-b822e468302e None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:55.407746 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f607f7-3736-419d-93c3-b822e468302e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:55.407853 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f607f7-3736-419d-93c3-b822e468302e None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:55.409198 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 576/1170] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:55.414467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550f9a9-dc53-4b34-84f8-996567ff1c72 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:55.414849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550f9a9-dc53-4b34-84f8-996567ff1c72 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:55.415022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550f9a9-dc53-4b34-84f8-996567ff1c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:55.431250 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-5550f9a9-dc53-4b34-84f8-996567ff1c72 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:55.432455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-5550f9a9-dc53-4b34-84f8-996567ff1c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:55.496177 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 595/1171] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:55.519799 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f607f7-3736-419d-93c3-b822e468302e None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:55.618385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f607f7-3736-419d-93c3-b822e468302e None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:55.651822 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b15f4e3-f7a2-4585-a4c8-48fb20ae7d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:55.652676 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15f4e3-f7a2-4585-a4c8-48fb20ae7d00 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:55.652968 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15f4e3-f7a2-4585-a4c8-48fb20ae7d00 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:55.653249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b15f4e3-f7a2-4585-a4c8-48fb20ae7d00 None admin] PATH_INFO: `/v3/domains/c832098f7a15453fb09491f355dc8f6d` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:55.663712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15f4e3-f7a2-4585-a4c8-48fb20ae7d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c832098f7a15453fb09491f355dc8f6d)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:55.665111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b15f4e3-f7a2-4585-a4c8-48fb20ae7d00 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:55.666756 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 577/1172] 10.222.0.36 () {56 vars in 1183 bytes} [Mon Jun 27 18:34:55 2022] GET /identity/v3/domains/c832098f7a15453fb09491f355dc8f6d => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:55.672506 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550f9a9-dc53-4b34-84f8-996567ff1c72 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:55.744022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:55.768043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5550f9a9-dc53-4b34-84f8-996567ff1c72 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:55.801946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542368c-bfc7-41e7-95fb-5e114befa1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:55.802596 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542368c-bfc7-41e7-95fb-5e114befa1ba None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:55.802877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542368c-bfc7-41e7-95fb-5e114befa1ba None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:55.803152 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542368c-bfc7-41e7-95fb-5e114befa1ba None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:55.803877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542368c-bfc7-41e7-95fb-5e114befa1ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:55.805300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542368c-bfc7-41e7-95fb-5e114befa1ba None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:55.865811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 596/1173] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jun 27 18:34:55 2022] POST /identity/v3/projects => generated 361 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:34:57.882336 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242b0da-7cc2-4f38-9f30-93d8673ca22c None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:57.882857 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242b0da-7cc2-4f38-9f30-93d8673ca22c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:57.882857 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b242b0da-7cc2-4f38-9f30-93d8673ca22c None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:57.884273 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 578/1174] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:34:57.889355 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0a6c7-449b-453b-a54e-2e86869b0885 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:57.889767 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0a6c7-449b-453b-a54e-2e86869b0885 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:57.889918 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0a6c7-449b-453b-a54e-2e86869b0885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:57.906759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-12e0a6c7-449b-453b-a54e-2e86869b0885 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:34:57.907985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-12e0a6c7-449b-453b-a54e-2e86869b0885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:34:57.972138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 597/1175] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:34:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:34:57.996910 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242b0da-7cc2-4f38-9f30-93d8673ca22c None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:58.045493 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:58.095456 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b242b0da-7cc2-4f38-9f30-93d8673ca22c None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:58.128163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3abc4-57d3-4b3a-8aee-3b96b1aebe84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:58.129007 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3abc4-57d3-4b3a-8aee-3b96b1aebe84 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:58.129289 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3abc4-57d3-4b3a-8aee-3b96b1aebe84 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:58.129562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3abc4-57d3-4b3a-8aee-3b96b1aebe84 None admin] PATH_INFO: `/v3/domains/c832098f7a15453fb09491f355dc8f6d` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:58.130734 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3abc4-57d3-4b3a-8aee-3b96b1aebe84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c832098f7a15453fb09491f355dc8f6d)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:58.132200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3abc4-57d3-4b3a-8aee-3b96b1aebe84 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:58.133829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 579/1176] 10.222.0.36 () {56 vars in 1183 bytes} [Mon Jun 27 18:34:57 2022] GET /identity/v3/domains/c832098f7a15453fb09491f355dc8f6d => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:34:58.139370 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0a6c7-449b-453b-a54e-2e86869b0885 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:34:58.193660 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:34:58.235617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0a6c7-449b-453b-a54e-2e86869b0885 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:34:58.269514 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e188b8c-9518-4edf-a66f-119090664e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:34:58.270176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e188b8c-9518-4edf-a66f-119090664e9f None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:34:58.270466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e188b8c-9518-4edf-a66f-119090664e9f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:34:58.270748 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e188b8c-9518-4edf-a66f-119090664e9f None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:34:58.271463 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e188b8c-9518-4edf-a66f-119090664e9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:34:58.272926 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e188b8c-9518-4edf-a66f-119090664e9f None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:34:58.368142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 598/1177] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:34:58 2022] POST /identity/v3/users => generated 311 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:35:00.407753 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415680e-8502-428b-a7be-4c7bb622791d None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:00.408342 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415680e-8502-428b-a7be-4c7bb622791d None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:00.408342 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415680e-8502-428b-a7be-4c7bb622791d None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:00.409671 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 580/1178] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:35:00.419333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d188d-cf1d-4884-99a0-df13d560b295 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:00.419804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d188d-cf1d-4884-99a0-df13d560b295 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:00.419929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d188d-cf1d-4884-99a0-df13d560b295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:00.436730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-e98d188d-cf1d-4884-99a0-df13d560b295 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:35:00.437915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e98d188d-cf1d-4884-99a0-df13d560b295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:35:00.502152 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 599/1179] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:35:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:35:00.525429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415680e-8502-428b-a7be-4c7bb622791d None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:35:00.623919 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415680e-8502-428b-a7be-4c7bb622791d None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:35:00.640109 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:35:00.655879 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422724d-3f95-4665-9730-b8d2cff362c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:35:00.656656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422724d-3f95-4665-9730-b8d2cff362c1 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:00.656941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422724d-3f95-4665-9730-b8d2cff362c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:00.657253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422724d-3f95-4665-9730-b8d2cff362c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:00.667989 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422724d-3f95-4665-9730-b8d2cff362c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:35:00.676476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-f422724d-3f95-4665-9730-b8d2cff362c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:35:00.676476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:35:00.676476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:35:00.676476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:35:00.676476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:35:00.676476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:35:00.676476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:35:00.676476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:35:00.676476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:35:00.676476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:35:00.676476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:35:00.676476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:35:00.676476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:35:00.676476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:35:00.676476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:35:00.676476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:35:00.677472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:35:00.677472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:35:00.677472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:35:00.677472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:35:00.677472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:35:00.677472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:35:00.677472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:35:00.677472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:35:00.677472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:35:00.677472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:35:00.677472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:35:00.677472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:35:00.677472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:35:00.677472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:35:00.677472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:35:00.677472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:35:00.678390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:35:00.678390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:35:00.678390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:35:00.678390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:35:00.678390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:35:00.678390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:35:00.678390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:35:00.678390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:35:00.678390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:35:00.678390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:35:00.678390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:35:00.678390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:35:00.679346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 581/1180] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:35:00.683555 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d188d-cf1d-4884-99a0-df13d560b295 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:35:00.725303 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:35:00.778727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d188d-cf1d-4884-99a0-df13d560b295 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:35:00.812199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe64a3-a0fb-4600-bb5f-15d913454a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:35:00.812853 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe64a3-a0fb-4600-bb5f-15d913454a67 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:00.813137 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe64a3-a0fb-4600-bb5f-15d913454a67 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:00.813420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe64a3-a0fb-4600-bb5f-15d913454a67 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:00.814161 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe64a3-a0fb-4600-bb5f-15d913454a67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:35:00.814470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe64a3-a0fb-4600-bb5f-15d913454a67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:35:00.815890 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe64a3-a0fb-4600-bb5f-15d913454a67 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:35:00.823839 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 600/1181] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:35:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:35:00.829485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422724d-3f95-4665-9730-b8d2cff362c1 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:35:00.926133 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422724d-3f95-4665-9730-b8d2cff362c1 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:35:00.958761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b365635-a663-4089-a34f-3b9f7a9e8468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:35:00.959632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b365635-a663-4089-a34f-3b9f7a9e8468 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:00.959919 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b365635-a663-4089-a34f-3b9f7a9e8468 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:00.960196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b365635-a663-4089-a34f-3b9f7a9e8468 None admin] PATH_INFO: `/v3/users/2822d29c238e4944bc1c6ea74d057905` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:00.973293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b365635-a663-4089-a34f-3b9f7a9e8468 None admin] RBAC: Authorizing `identity:get_user(user_id=2822d29c238e4944bc1c6ea74d057905)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:35:00.974729 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b365635-a663-4089-a34f-3b9f7a9e8468 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:35:00.976384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 582/1182] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:35:00 2022] GET /identity/v3/users/2822d29c238e4944bc1c6ea74d057905 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:35:00.982308 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe64a3-a0fb-4600-bb5f-15d913454a67 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:35:01.076184 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe64a3-a0fb-4600-bb5f-15d913454a67 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:35:01.078411 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:35:01.108611 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dedbb-6985-41b0-b40f-930d60bd35d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:35:01.109239 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dedbb-6985-41b0-b40f-930d60bd35d3 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:01.109546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dedbb-6985-41b0-b40f-930d60bd35d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:01.109822 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dedbb-6985-41b0-b40f-930d60bd35d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:01.173404 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dedbb-6985-41b0-b40f-930d60bd35d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:35:01.174871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dedbb-6985-41b0-b40f-930d60bd35d3 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:35:01.267229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 601/1183] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:35:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:35:01.273327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b365635-a663-4089-a34f-3b9f7a9e8468 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:35:01.306903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:35:01.368368 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b365635-a663-4089-a34f-3b9f7a9e8468 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:35:01.400972 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2281c4a1-8940-4c39-9444-eadd9a06f5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:35:01.401809 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281c4a1-8940-4c39-9444-eadd9a06f5c5 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:01.402092 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281c4a1-8940-4c39-9444-eadd9a06f5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:01.402367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2281c4a1-8940-4c39-9444-eadd9a06f5c5 None admin] PATH_INFO: `/v3/projects/0b1619ebc143451aba99f9a54821d181` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:01.403518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281c4a1-8940-4c39-9444-eadd9a06f5c5 None admin] RBAC: Authorizing `identity:get_project(project_id=0b1619ebc143451aba99f9a54821d181)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:35:01.404951 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2281c4a1-8940-4c39-9444-eadd9a06f5c5 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:35:01.406622 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 583/1184] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:35:01 2022] GET /identity/v3/projects/0b1619ebc143451aba99f9a54821d181 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:35:01.412609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dedbb-6985-41b0-b40f-930d60bd35d3 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:35:01.415663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:35:01.512427 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dedbb-6985-41b0-b40f-930d60bd35d3 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:35:01.545435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfe006-cc05-461a-98de-4524fc973af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:35:01.546078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfe006-cc05-461a-98de-4524fc973af6 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:01.546358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfe006-cc05-461a-98de-4524fc973af6 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:01.546635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfe006-cc05-461a-98de-4524fc973af6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:01.547448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfe006-cc05-461a-98de-4524fc973af6 None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=0b1619ebc143451aba99f9a54821d181, user.id=2822d29c238e4944bc1c6ea74d057905) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:35:01.547798 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfe006-cc05-461a-98de-4524fc973af6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:35:01.549252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfe006-cc05-461a-98de-4524fc973af6 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:35:01.554523 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 602/1185] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:35:01 2022] GET /identity/v3/role_assignments?user.id=2822d29c238e4944bc1c6ea74d057905&scope.project.id=0b1619ebc143451aba99f9a54821d181&role.id=b156409c977248e1b23c26e589b1e04f => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:35:03.551557 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb518-1dab-4260-a209-f07c640cd80f None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:03.552013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb518-1dab-4260-a209-f07c640cd80f None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:03.552135 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb518-1dab-4260-a209-f07c640cd80f None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:03.553508 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 584/1186] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:35:03.558623 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecb6cf-2346-481e-bf46-b3ac3149f2b9 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:03.559058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecb6cf-2346-481e-bf46-b3ac3149f2b9 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:03.559182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbecb6cf-2346-481e-bf46-b3ac3149f2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:03.576799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-fbecb6cf-2346-481e-bf46-b3ac3149f2b9 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:35:03.577973 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-fbecb6cf-2346-481e-bf46-b3ac3149f2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:35:03.637631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:35:03.643521 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 603/1187] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:35:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:35:03.665474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bb518-1dab-4260-a209-f07c640cd80f None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:35:03.762715 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bb518-1dab-4260-a209-f07c640cd80f None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:35:03.764968 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:35:03.796007 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0567be-cc09-4df0-94bb-14a9213ed219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:35:03.796721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0567be-cc09-4df0-94bb-14a9213ed219 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:03.797004 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0567be-cc09-4df0-94bb-14a9213ed219 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:03.797279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0567be-cc09-4df0-94bb-14a9213ed219 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:03.807075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0567be-cc09-4df0-94bb-14a9213ed219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:35:03.815136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-ea0567be-cc09-4df0-94bb-14a9213ed219 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:35:03.815136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:35:03.815136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:35:03.815136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:35:03.815136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:35:03.815136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:35:03.815136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:35:03.815136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:35:03.815136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:35:03.815136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:35:03.815136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:35:03.815136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:35:03.815136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:35:03.815136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:35:03.815136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:35:03.815136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:35:03.816239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:35:03.816239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:35:03.816239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:35:03.816239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:35:03.816239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:35:03.816239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:35:03.816239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:35:03.816239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:35:03.816239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:35:03.816239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:35:03.816239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:35:03.816239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:35:03.816239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:35:03.816239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:35:03.816239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:35:03.816239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:35:03.817119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:35:03.817119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:35:03.817119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:35:03.817119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:35:03.817119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:35:03.817119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:35:03.817119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:35:03.817119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:35:03.817119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:35:03.817119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:35:03.817119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:35:03.817119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:35:03.817119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 585/1188] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:35:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:35:03.822431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecb6cf-2346-481e-bf46-b3ac3149f2b9 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:35:03.917986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbecb6cf-2346-481e-bf46-b3ac3149f2b9 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:35:03.951340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d975f-57e6-4668-b4dd-1f879d0fb5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:35:03.952021 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d975f-57e6-4668-b4dd-1f879d0fb5da None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:03.952306 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d975f-57e6-4668-b4dd-1f879d0fb5da None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:03.952581 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28d975f-57e6-4668-b4dd-1f879d0fb5da None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:03.953321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d975f-57e6-4668-b4dd-1f879d0fb5da None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:35:03.953625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d975f-57e6-4668-b4dd-1f879d0fb5da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:35:03.954991 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28d975f-57e6-4668-b4dd-1f879d0fb5da None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:35:03.963493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 604/1189] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:35:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:35:03.968937 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0567be-cc09-4df0-94bb-14a9213ed219 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:35:04.065138 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0567be-cc09-4df0-94bb-14a9213ed219 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:35:04.096415 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8292b20-01ed-4915-a223-fbbcf42cb146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:35:04.097254 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8292b20-01ed-4915-a223-fbbcf42cb146 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:04.097536 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8292b20-01ed-4915-a223-fbbcf42cb146 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:04.097809 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8292b20-01ed-4915-a223-fbbcf42cb146 None admin] PATH_INFO: `/v3/users/2822d29c238e4944bc1c6ea74d057905` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:04.098968 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8292b20-01ed-4915-a223-fbbcf42cb146 None admin] RBAC: Authorizing `identity:get_user(user_id=2822d29c238e4944bc1c6ea74d057905)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:35:04.100403 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8292b20-01ed-4915-a223-fbbcf42cb146 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:35:04.101986 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 586/1190] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:35:03 2022] GET /identity/v3/users/2822d29c238e4944bc1c6ea74d057905 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:35:04.107778 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d975f-57e6-4668-b4dd-1f879d0fb5da None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:35:04.164229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:35:04.203808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28d975f-57e6-4668-b4dd-1f879d0fb5da None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:35:04.236124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade5236-d4fa-4a7e-9806-e7bb9db73dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:35:04.237462 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade5236-d4fa-4a7e-9806-e7bb9db73dce None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:04.237744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade5236-d4fa-4a7e-9806-e7bb9db73dce None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:04.238015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade5236-d4fa-4a7e-9806-e7bb9db73dce None admin] PATH_INFO: `/v3/projects/0b1619ebc143451aba99f9a54821d181` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:04.239180 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade5236-d4fa-4a7e-9806-e7bb9db73dce None admin] RBAC: Authorizing `identity:get_project(project_id=0b1619ebc143451aba99f9a54821d181)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:35:04.240636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade5236-d4fa-4a7e-9806-e7bb9db73dce None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:35:04.242288 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 605/1191] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:35:04 2022] GET /identity/v3/projects/0b1619ebc143451aba99f9a54821d181 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:35:04.247951 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8292b20-01ed-4915-a223-fbbcf42cb146 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:35:04.278724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:35:04.343971 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8292b20-01ed-4915-a223-fbbcf42cb146 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:35:04.375295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32465c2c-f730-43e0-9447-c7961f703b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:35:04.376187 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32465c2c-f730-43e0-9447-c7961f703b8c None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:04.376467 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32465c2c-f730-43e0-9447-c7961f703b8c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:04.376739 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32465c2c-f730-43e0-9447-c7961f703b8c None admin] PATH_INFO: `/v3/projects/0b1619ebc143451aba99f9a54821d181/users/2822d29c238e4944bc1c6ea74d057905/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:04.379160 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32465c2c-f730-43e0-9447-c7961f703b8c None admin] RBAC: Authorizing `identity:create_grant(project_id=0b1619ebc143451aba99f9a54821d181, user_id=2822d29c238e4944bc1c6ea74d057905, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:35:04.380602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32465c2c-f730-43e0-9447-c7961f703b8c None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:35:04.458320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 587/1192] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:35:04 2022] PUT /identity/v3/projects/0b1619ebc143451aba99f9a54821d181/users/2822d29c238e4944bc1c6ea74d057905/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:35:06.421694 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bfadc-da14-4610-aedd-f2ceb52d5e38 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:06.422229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bfadc-da14-4610-aedd-f2ceb52d5e38 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:06.422229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3bfadc-da14-4610-aedd-f2ceb52d5e38 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:06.423629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 606/1193] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:35:06.429268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca2836-a5db-43c7-93a1-b3554238b4e9 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:06.429666 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca2836-a5db-43c7-93a1-b3554238b4e9 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:06.429817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca2836-a5db-43c7-93a1-b3554238b4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:06.446482 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-70ca2836-a5db-43c7-93a1-b3554238b4e9 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:35:06.447696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-70ca2836-a5db-43c7-93a1-b3554238b4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:35:06.511766 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 588/1194] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:35:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:35:06.534875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bfadc-da14-4610-aedd-f2ceb52d5e38 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:35:06.634090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3bfadc-da14-4610-aedd-f2ceb52d5e38 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:35:06.661421 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:35:06.670374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fa62c-3b0c-4ae9-8b9f-fde4dd0d2472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:35:06.677470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa62c-3b0c-4ae9-8b9f-fde4dd0d2472 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:06.677470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa62c-3b0c-4ae9-8b9f-fde4dd0d2472 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:06.677470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fa62c-3b0c-4ae9-8b9f-fde4dd0d2472 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:06.685436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fa62c-3b0c-4ae9-8b9f-fde4dd0d2472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:35:06.693051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-646fa62c-3b0c-4ae9-8b9f-fde4dd0d2472 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:35:06.693051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:35:06.693051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:35:06.693051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:35:06.693051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:35:06.693051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:35:06.693051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:35:06.693051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:35:06.693051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:35:06.693051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:35:06.693051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:35:06.693051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:35:06.693051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:35:06.693051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:35:06.693051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:35:06.693051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:35:06.694149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:35:06.694149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:35:06.694149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:35:06.694149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:35:06.694149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:35:06.694149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:35:06.694149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:35:06.694149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:35:06.694149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:35:06.694149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:35:06.694149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:35:06.694149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:35:06.694149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:35:06.694149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:35:06.694149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:35:06.694149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:35:06.695381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:35:06.695381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:35:06.695381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:35:06.695381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:35:06.695381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:35:06.695381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:35:06.695381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:35:06.695381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:35:06.695381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:35:06.695381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:35:06.695381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:35:06.695381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:35:06.695381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 607/1195] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:35:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:35:06.700170 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca2836-a5db-43c7-93a1-b3554238b4e9 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:35:06.723352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:35:06.794544 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca2836-a5db-43c7-93a1-b3554238b4e9 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:35:06.827443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe51a57-657c-4157-ab76-ec539d077415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:35:06.828128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe51a57-657c-4157-ab76-ec539d077415 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:06.828415 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe51a57-657c-4157-ab76-ec539d077415 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:06.828692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe51a57-657c-4157-ab76-ec539d077415 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:06.829435 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe51a57-657c-4157-ab76-ec539d077415 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:35:06.829741 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe51a57-657c-4157-ab76-ec539d077415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:35:06.831117 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe51a57-657c-4157-ab76-ec539d077415 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:35:06.838951 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 589/1196] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:35:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:35:06.844645 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fa62c-3b0c-4ae9-8b9f-fde4dd0d2472 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:35:06.941343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fa62c-3b0c-4ae9-8b9f-fde4dd0d2472 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:35:06.973994 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f46b6d-d8f3-47c5-b88d-18961ef41354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:35:06.974866 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f46b6d-d8f3-47c5-b88d-18961ef41354 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:06.975149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f46b6d-d8f3-47c5-b88d-18961ef41354 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:06.975426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f46b6d-d8f3-47c5-b88d-18961ef41354 None admin] PATH_INFO: `/v3/users/2822d29c238e4944bc1c6ea74d057905` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:06.976626 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f46b6d-d8f3-47c5-b88d-18961ef41354 None admin] RBAC: Authorizing `identity:get_user(user_id=2822d29c238e4944bc1c6ea74d057905)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:35:06.978054 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f46b6d-d8f3-47c5-b88d-18961ef41354 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:35:06.979942 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 608/1197] 10.222.0.36 () {56 vars in 1177 bytes} [Mon Jun 27 18:35:06 2022] GET /identity/v3/users/2822d29c238e4944bc1c6ea74d057905 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:35:06.985397 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe51a57-657c-4157-ab76-ec539d077415 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:35:07.065805 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:35:07.081272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe51a57-657c-4157-ab76-ec539d077415 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:35:07.113607 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5f8fa-a9b3-40ab-8544-48c7e3cb4a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:35:07.114233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5f8fa-a9b3-40ab-8544-48c7e3cb4a79 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:07.114520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5f8fa-a9b3-40ab-8544-48c7e3cb4a79 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:07.114798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5f8fa-a9b3-40ab-8544-48c7e3cb4a79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:07.179169 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5f8fa-a9b3-40ab-8544-48c7e3cb4a79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:35:07.180628 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5f8fa-a9b3-40ab-8544-48c7e3cb4a79 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:35:07.257865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:35:07.273794 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 590/1198] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:35:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:35:07.279502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f46b6d-d8f3-47c5-b88d-18961ef41354 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:35:07.333656 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:35:07.374407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f46b6d-d8f3-47c5-b88d-18961ef41354 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:35:07.407091 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a11ac-3aa1-4636-ba7e-463f1db9a7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:35:07.407951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a11ac-3aa1-4636-ba7e-463f1db9a7c2 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:07.408318 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a11ac-3aa1-4636-ba7e-463f1db9a7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:07.408590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a11ac-3aa1-4636-ba7e-463f1db9a7c2 None admin] PATH_INFO: `/v3/projects/0b1619ebc143451aba99f9a54821d181` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:07.409749 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a11ac-3aa1-4636-ba7e-463f1db9a7c2 None admin] RBAC: Authorizing `identity:get_project(project_id=0b1619ebc143451aba99f9a54821d181)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:35:07.411158 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a11ac-3aa1-4636-ba7e-463f1db9a7c2 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:35:07.412837 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 609/1199] 10.222.0.36 () {56 vars in 1186 bytes} [Mon Jun 27 18:35:07 2022] GET /identity/v3/projects/0b1619ebc143451aba99f9a54821d181 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:35:07.418609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5f8fa-a9b3-40ab-8544-48c7e3cb4a79 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:35:07.528502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5f8fa-a9b3-40ab-8544-48c7e3cb4a79 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:35:07.560121 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ca796-4d75-4fd7-baa2-54dceae96788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:35:07.560767 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ca796-4d75-4fd7-baa2-54dceae96788 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:35:07.561052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ca796-4d75-4fd7-baa2-54dceae96788 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:35:07.561331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ca796-4d75-4fd7-baa2-54dceae96788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:35:07.562156 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ca796-4d75-4fd7-baa2-54dceae96788 None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=0b1619ebc143451aba99f9a54821d181, user.id=2822d29c238e4944bc1c6ea74d057905) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:35:07.562471 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ca796-4d75-4fd7-baa2-54dceae96788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:35:07.563917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ca796-4d75-4fd7-baa2-54dceae96788 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:35:07.570040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 591/1200] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:35:07 2022] GET /identity/v3/role_assignments?user.id=2822d29c238e4944bc1c6ea74d057905&scope.project.id=0b1619ebc143451aba99f9a54821d181&role.id=b156409c977248e1b23c26e589b1e04f => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:35:17.403107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=38 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:35:17.567911 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=76 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:17.788228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b208e1-6d0a-4eea-bcf6-1fa969866680 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:17.788824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b208e1-6d0a-4eea-bcf6-1fa969866680 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:17.788824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b208e1-6d0a-4eea-bcf6-1fa969866680 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:17.790096 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 610/1201] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:36:17.795762 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f15551-3f72-4cf2-ac26-1cb8349ad722 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:17.796191 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f15551-3f72-4cf2-ac26-1cb8349ad722 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:17.796288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f15551-3f72-4cf2-ac26-1cb8349ad722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:17.812951 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-e2f15551-3f72-4cf2-ac26-1cb8349ad722 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:36:17.814637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e2f15551-3f72-4cf2-ac26-1cb8349ad722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:36:17.880651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 592/1202] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:36:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:36:17.905590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b208e1-6d0a-4eea-bcf6-1fa969866680 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:18.005012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b208e1-6d0a-4eea-bcf6-1fa969866680 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:18.037863 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03325dcb-143e-44ea-854b-1543a84ab0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:18.038696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03325dcb-143e-44ea-854b-1543a84ab0c0 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:18.038936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03325dcb-143e-44ea-854b-1543a84ab0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:18.039213 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03325dcb-143e-44ea-854b-1543a84ab0c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:18.049141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03325dcb-143e-44ea-854b-1543a84ab0c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:18.050572 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03325dcb-143e-44ea-854b-1543a84ab0c0 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:18.069119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-03325dcb-143e-44ea-854b-1543a84ab0c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:18.069119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:18.069119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:18.069119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:18.069119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:18.069119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:18.069119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:18.069119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:18.069119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:18.069119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:18.069119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:18.069119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:18.069119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:36:18.069119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:36:18.069119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:36:18.070241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:36:18.070241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:18.070241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:18.070241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:18.070241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:18.070241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:18.070241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:18.070241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:18.070241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:18.070241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:18.070241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:18.070241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:18.070241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:18.070241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:18.070241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:18.070241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:18.070241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:18.071438 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:36:18.071438 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:36:18.071438 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:18.071438 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:36:18.071438 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 611/1203] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:18.076485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f15551-3f72-4cf2-ac26-1cb8349ad722 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:18.171624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f15551-3f72-4cf2-ac26-1cb8349ad722 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:18.199689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:18.205376 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed42d845-1a5b-4dfe-878c-7b086e6700f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:18.206036 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42d845-1a5b-4dfe-878c-7b086e6700f5 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:18.206321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42d845-1a5b-4dfe-878c-7b086e6700f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:18.206598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed42d845-1a5b-4dfe-878c-7b086e6700f5 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:18.207316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42d845-1a5b-4dfe-878c-7b086e6700f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:18.207656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42d845-1a5b-4dfe-878c-7b086e6700f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:18.209021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed42d845-1a5b-4dfe-878c-7b086e6700f5 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:18.219837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 593/1204] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:18.225462 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03325dcb-143e-44ea-854b-1543a84ab0c0 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:18.277172 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:18.322609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03325dcb-143e-44ea-854b-1543a84ab0c0 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:18.355633 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6598313-9908-4de5-9000-aefdf95fb1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:18.356343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6598313-9908-4de5-9000-aefdf95fb1e2 None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:18.356611 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6598313-9908-4de5-9000-aefdf95fb1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:18.356884 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6598313-9908-4de5-9000-aefdf95fb1e2 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:18.357641 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6598313-9908-4de5-9000-aefdf95fb1e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:18.359035 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6598313-9908-4de5-9000-aefdf95fb1e2 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:18.459749 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 612/1205] 10.222.0.36 () {60 vars in 1132 bytes} [Mon Jun 27 18:36:18 2022] POST /identity/v3/users => generated 251 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:36:20.500481 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf96363-6ca0-4261-8f65-5be3bab9b12c None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:20.501011 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf96363-6ca0-4261-8f65-5be3bab9b12c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:20.501124 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf96363-6ca0-4261-8f65-5be3bab9b12c None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:20.502489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 594/1206] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:36:20.507742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dc499-118f-4097-9fe6-fc077ca9ba0d None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:20.508152 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dc499-118f-4097-9fe6-fc077ca9ba0d None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:20.508346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6dc499-118f-4097-9fe6-fc077ca9ba0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:20.525560 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-6a6dc499-118f-4097-9fe6-fc077ca9ba0d None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:36:20.526755 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-6a6dc499-118f-4097-9fe6-fc077ca9ba0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:36:20.592758 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 613/1207] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:36:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:36:20.617346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf96363-6ca0-4261-8f65-5be3bab9b12c None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:20.719122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf96363-6ca0-4261-8f65-5be3bab9b12c None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:20.752955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46847eec-5531-4bd1-8082-b69e2ae9ac41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:20.753684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46847eec-5531-4bd1-8082-b69e2ae9ac41 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:20.753971 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46847eec-5531-4bd1-8082-b69e2ae9ac41 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:20.754253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46847eec-5531-4bd1-8082-b69e2ae9ac41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:20.764979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46847eec-5531-4bd1-8082-b69e2ae9ac41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:36:20.773460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-46847eec-5531-4bd1-8082-b69e2ae9ac41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:36:20.773460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:20.773460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:20.773460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:20.773460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:20.773460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:20.773460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:20.773460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:20.773460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:20.773460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:20.773460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:20.773460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:20.773460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:36:20.773460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:36:20.773460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:36:20.773460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:36:20.774521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:36:20.774521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:36:20.774521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:36:20.774521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:36:20.774521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:20.774521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:20.774521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:20.774521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:20.774521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:20.774521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:20.774521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:20.774521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:20.774521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:20.774521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:20.774521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:20.774521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:20.775518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:20.775518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:20.775518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:20.775518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:20.775518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:36:20.775518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:36:20.775518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:36:20.775518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:36:20.775518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:36:20.775518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:36:20.775518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:36:20.775518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:20.775518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 595/1208] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:36:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:20.780682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6dc499-118f-4097-9fe6-fc077ca9ba0d None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:20.819771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:20.877044 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6dc499-118f-4097-9fe6-fc077ca9ba0d None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:20.910446 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdd9e6-de55-4a2f-9e26-2e2a0a62e75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:20.911106 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdd9e6-de55-4a2f-9e26-2e2a0a62e75c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:20.911391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdd9e6-de55-4a2f-9e26-2e2a0a62e75c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:20.911706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdd9e6-de55-4a2f-9e26-2e2a0a62e75c None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:20.912455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdd9e6-de55-4a2f-9e26-2e2a0a62e75c None admin] RBAC: Adding query filter params (name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:20.912776 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdd9e6-de55-4a2f-9e26-2e2a0a62e75c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:20.914129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debdd9e6-de55-4a2f-9e26-2e2a0a62e75c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:20.922220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 614/1209] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:36:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:20.927460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46847eec-5531-4bd1-8082-b69e2ae9ac41 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:20.976097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:21.023522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46847eec-5531-4bd1-8082-b69e2ae9ac41 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:21.056347 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a08cec-65ac-43fa-8ec7-05cbc7d40cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:21.057131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a08cec-65ac-43fa-8ec7-05cbc7d40cff None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:21.057420 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a08cec-65ac-43fa-8ec7-05cbc7d40cff None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:21.057696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a08cec-65ac-43fa-8ec7-05cbc7d40cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:21.067970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a08cec-65ac-43fa-8ec7-05cbc7d40cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:21.069499 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a08cec-65ac-43fa-8ec7-05cbc7d40cff None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:21.087137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-f3a08cec-65ac-43fa-8ec7-05cbc7d40cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:21.087137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:21.087137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:21.087137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:21.087137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:21.087137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:21.087137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:21.087137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:21.087137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:21.087137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:21.087137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:21.087137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:21.087137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:36:21.087137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:36:21.087137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:36:21.088259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:36:21.088259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:21.088259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:21.088259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:21.088259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:21.088259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:21.088259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:21.088259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:21.088259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:21.088259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:21.088259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:21.088259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:21.088259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:21.088259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:21.088259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:21.088259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:21.088259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:21.089383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:36:21.089383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:36:21.089383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:21.089383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:21.089383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 596/1210] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:21.094062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdd9e6-de55-4a2f-9e26-2e2a0a62e75c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:21.190616 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:21.193439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdd9e6-de55-4a2f-9e26-2e2a0a62e75c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:21.224919 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95758c-afe9-45a3-9954-1f171493fa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:21.225564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95758c-afe9-45a3-9954-1f171493fa6c None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:21.225846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95758c-afe9-45a3-9954-1f171493fa6c None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:21.226123 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95758c-afe9-45a3-9954-1f171493fa6c None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:21.227088 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95758c-afe9-45a3-9954-1f171493fa6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:21.227396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95758c-afe9-45a3-9954-1f171493fa6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:21.228793 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95758c-afe9-45a3-9954-1f171493fa6c None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:21.240934 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 615/1211] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:21.246603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a08cec-65ac-43fa-8ec7-05cbc7d40cff None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:21.344960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a08cec-65ac-43fa-8ec7-05cbc7d40cff None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:21.346463 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:21.378426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63dd91-8bdd-4ed8-ae57-dbe8003af421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:21.379215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63dd91-8bdd-4ed8-ae57-dbe8003af421 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:21.379555 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63dd91-8bdd-4ed8-ae57-dbe8003af421 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:21.379828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63dd91-8bdd-4ed8-ae57-dbe8003af421 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:21.386515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63dd91-8bdd-4ed8-ae57-dbe8003af421 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:21.388021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca63dd91-8bdd-4ed8-ae57-dbe8003af421 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:21.402272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-ca63dd91-8bdd-4ed8-ae57-dbe8003af421 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 18:36:21.402272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:21.402272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:21.402272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:21.402272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:21.402272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:21.402272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:21.402272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:21.402272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:21.402272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:21.402272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:21.402272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:21.402272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:36:21.402272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:36:21.402272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:36:21.402272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:21.403399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:21.404507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:21.404507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:21.404507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:36:21.404507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:36:21.404507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:36:21.404507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:36:21.404507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:36:21.404507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:36:21.404507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 18:36:21.404507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:21.404507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 597/1212] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:21.409215 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95758c-afe9-45a3-9954-1f171493fa6c None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:21.507550 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95758c-afe9-45a3-9954-1f171493fa6c None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:21.542273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb84657-f36d-4fad-b23c-94be0220e0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:21.542895 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb84657-f36d-4fad-b23c-94be0220e0a3 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:21.543175 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb84657-f36d-4fad-b23c-94be0220e0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:21.543450 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb84657-f36d-4fad-b23c-94be0220e0a3 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:21.544306 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb84657-f36d-4fad-b23c-94be0220e0a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:21.548144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb84657-f36d-4fad-b23c-94be0220e0a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:21.548144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb84657-f36d-4fad-b23c-94be0220e0a3 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:21.563915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 616/1213] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Jun 27 18:36:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:21.569618 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63dd91-8bdd-4ed8-ae57-dbe8003af421 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:21.665961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63dd91-8bdd-4ed8-ae57-dbe8003af421 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:21.698882 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78996833-c890-4ca5-a54f-9c3b3e3b3e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:21.701193 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996833-c890-4ca5-a54f-9c3b3e3b3e3b None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:21.701193 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996833-c890-4ca5-a54f-9c3b3e3b3e3b None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:21.701193 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78996833-c890-4ca5-a54f-9c3b3e3b3e3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:21.732221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:21.773101 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78996833-c890-4ca5-a54f-9c3b3e3b3e3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:21.774564 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78996833-c890-4ca5-a54f-9c3b3e3b3e3b None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:21.872554 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 598/1214] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:36:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:36:21.878305 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb84657-f36d-4fad-b23c-94be0220e0a3 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:21.897379 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:21.976462 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb84657-f36d-4fad-b23c-94be0220e0a3 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:22.010442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785368c-3499-4540-b137-132ac78c8c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:22.011228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785368c-3499-4540-b137-132ac78c8c3f None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:22.011509 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785368c-3499-4540-b137-132ac78c8c3f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:22.011817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785368c-3499-4540-b137-132ac78c8c3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:22.022161 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785368c-3499-4540-b137-132ac78c8c3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:22.023624 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f785368c-3499-4540-b137-132ac78c8c3f None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:22.041545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-f785368c-3499-4540-b137-132ac78c8c3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:22.041545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:22.041545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:22.041545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:22.041545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:22.041545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:22.041545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:22.041545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:22.041545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:22.041545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:22.041545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:22.041545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:22.041545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:36:22.041545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:36:22.041545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:36:22.042601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:36:22.042601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:22.042601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:22.042601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:22.042601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:22.042601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:22.042601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:22.042601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:22.042601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:22.042601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:22.042601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:22.042601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:22.042601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:22.042601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:22.042601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:22.042601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:22.042601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:22.043724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:36:22.043724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:36:22.043724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:22.043724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:36:22.043724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 617/1215] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:22.048555 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78996833-c890-4ca5-a54f-9c3b3e3b3e3b None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:22.108545 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:22.144795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78996833-c890-4ca5-a54f-9c3b3e3b3e3b None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:22.177857 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74222b-8a1e-4fba-bde6-3173dc93fa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:22.178510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74222b-8a1e-4fba-bde6-3173dc93fa54 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:22.178795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74222b-8a1e-4fba-bde6-3173dc93fa54 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:22.179071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74222b-8a1e-4fba-bde6-3173dc93fa54 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:22.179830 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74222b-8a1e-4fba-bde6-3173dc93fa54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:22.180144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74222b-8a1e-4fba-bde6-3173dc93fa54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:22.181512 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74222b-8a1e-4fba-bde6-3173dc93fa54 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:22.192942 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 599/1216] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:22.198731 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785368c-3499-4540-b137-132ac78c8c3f None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:22.267901 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:22.297219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f785368c-3499-4540-b137-132ac78c8c3f None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:22.330564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e42947-5eee-48f0-9b7a-339a35b3a309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:22.331342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e42947-5eee-48f0-9b7a-339a35b3a309 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:22.331656 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e42947-5eee-48f0-9b7a-339a35b3a309 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:22.331936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e42947-5eee-48f0-9b7a-339a35b3a309 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:22.338379 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e42947-5eee-48f0-9b7a-339a35b3a309 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:22.339843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e42947-5eee-48f0-9b7a-339a35b3a309 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:22.353604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-47e42947-5eee-48f0-9b7a-339a35b3a309 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:36:22.353604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:22.353604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:22.353604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:22.353604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:22.353604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:22.353604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:22.353604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:22.353604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:22.353604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:22.353604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:22.353604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:22.353604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:36:22.353604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:36:22.353604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:36:22.354703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:36:22.354703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:22.354703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:22.354703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:22.354703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:22.354703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:22.354703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:22.354703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:22.354703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:22.354703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:22.354703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:22.354703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:22.354703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:22.354703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:22.354703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:22.354703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:22.354703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:22.355804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:36:22.355804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:36:22.355804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:36:22.355804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:36:22.355804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:36:22.355804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:36:22.355804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:36:22.355804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:36:22.355804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 618/1217] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:36:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:22.360796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74222b-8a1e-4fba-bde6-3173dc93fa54 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:22.459274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74222b-8a1e-4fba-bde6-3173dc93fa54 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:22.480886 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:22.491827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e3dc8-bbae-4917-a86c-a219672b0f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:22.492514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e3dc8-bbae-4917-a86c-a219672b0f17 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:22.492797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e3dc8-bbae-4917-a86c-a219672b0f17 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:22.493071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e3dc8-bbae-4917-a86c-a219672b0f17 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:22.493887 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e3dc8-bbae-4917-a86c-a219672b0f17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:22.494195 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e3dc8-bbae-4917-a86c-a219672b0f17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:22.495653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e3dc8-bbae-4917-a86c-a219672b0f17 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:22.508298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 600/1218] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:36:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:22.514582 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e42947-5eee-48f0-9b7a-339a35b3a309 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:22.612475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e42947-5eee-48f0-9b7a-339a35b3a309 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:22.639738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:22.645504 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dcfd5-8311-4d54-a198-570241f6a1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:22.646157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dcfd5-8311-4d54-a198-570241f6a1b2 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:22.646442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dcfd5-8311-4d54-a198-570241f6a1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:22.646722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dcfd5-8311-4d54-a198-570241f6a1b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:22.647568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dcfd5-8311-4d54-a198-570241f6a1b2 None admin] RBAC: Adding query filter params (role.id=62fd6b166d1847b19e812160b459d5db, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=af6ef16884604753972c916f74271f42) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:22.647888 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dcfd5-8311-4d54-a198-570241f6a1b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:22.649324 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dcfd5-8311-4d54-a198-570241f6a1b2 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:22.654839 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 619/1219] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:36:22 2022] GET /identity/v3/role_assignments?user.id=af6ef16884604753972c916f74271f42&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=62fd6b166d1847b19e812160b459d5db => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:24.666298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21265b20-4ebd-4c6e-9cd0-55b2c2b34225 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:24.666952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21265b20-4ebd-4c6e-9cd0-55b2c2b34225 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:24.666952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21265b20-4ebd-4c6e-9cd0-55b2c2b34225 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:24.668251 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 601/1220] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:36:24.674573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4f192-19ae-4c00-8c70-f74352f3aca2 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:24.675004 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4f192-19ae-4c00-8c70-f74352f3aca2 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:24.675393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4f192-19ae-4c00-8c70-f74352f3aca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:24.691866 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-32a4f192-19ae-4c00-8c70-f74352f3aca2 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:36:24.693050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-32a4f192-19ae-4c00-8c70-f74352f3aca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:36:24.757927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 620/1221] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:36:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 27 18:36:24.781287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21265b20-4ebd-4c6e-9cd0-55b2c2b34225 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:24.880628 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21265b20-4ebd-4c6e-9cd0-55b2c2b34225 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:24.913759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a821e1b-1bf9-485f-90a7-183c651a0c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:24.914547 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a821e1b-1bf9-485f-90a7-183c651a0c5f None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:24.914830 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a821e1b-1bf9-485f-90a7-183c651a0c5f None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:24.915104 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a821e1b-1bf9-485f-90a7-183c651a0c5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:24.925717 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a821e1b-1bf9-485f-90a7-183c651a0c5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:36:24.933576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-3a821e1b-1bf9-485f-90a7-183c651a0c5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:36:24.933576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:24.933576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:24.933576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:24.933576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:24.933576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:24.933576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:24.933576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:24.933576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:24.933576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:24.933576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:24.933576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:24.933576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:36:24.933576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:36:24.933576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:36:24.933576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:36:24.934705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:36:24.934705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:36:24.934705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:36:24.934705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:36:24.934705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:24.934705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:24.934705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:24.934705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:24.934705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:24.934705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:24.934705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:24.934705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:24.934705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:24.934705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:24.934705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:24.934705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:24.935838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:24.935838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:24.935838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:24.935838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:24.935838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:36:24.935838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:36:24.935838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:36:24.935838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:36:24.935838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:36:24.935838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:36:24.935838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:36:24.935838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:24.935838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 602/1222] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:36:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:24.941831 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4f192-19ae-4c00-8c70-f74352f3aca2 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:25.039047 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4f192-19ae-4c00-8c70-f74352f3aca2 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:25.062497 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:25.073614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38833b-936c-4c98-a38b-165ac4ce8c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:25.084053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38833b-936c-4c98-a38b-165ac4ce8c08 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:25.084053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38833b-936c-4c98-a38b-165ac4ce8c08 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:25.084053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db38833b-936c-4c98-a38b-165ac4ce8c08 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:25.084053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38833b-936c-4c98-a38b-165ac4ce8c08 None admin] RBAC: Adding query filter params (name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:25.084053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38833b-936c-4c98-a38b-165ac4ce8c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:25.084053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db38833b-936c-4c98-a38b-165ac4ce8c08 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:25.084958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 621/1223] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:36:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:25.090600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a821e1b-1bf9-485f-90a7-183c651a0c5f None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:25.133537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:25.191963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a821e1b-1bf9-485f-90a7-183c651a0c5f None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:25.225850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778651b7-2589-407d-8fc1-1eda4e5b1cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:25.226903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778651b7-2589-407d-8fc1-1eda4e5b1cd0 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:25.227189 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778651b7-2589-407d-8fc1-1eda4e5b1cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:25.227468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778651b7-2589-407d-8fc1-1eda4e5b1cd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:25.238273 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778651b7-2589-407d-8fc1-1eda4e5b1cd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:25.239762 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778651b7-2589-407d-8fc1-1eda4e5b1cd0 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:25.256335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-778651b7-2589-407d-8fc1-1eda4e5b1cd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:25.256335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:25.256335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:25.256335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:25.256335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:25.256335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:25.256335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:25.256335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:25.256335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:25.256335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:25.256335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:25.256335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:25.256335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:36:25.256335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:36:25.256335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:36:25.257468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:36:25.257468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:25.257468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:25.257468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:25.257468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:25.257468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:25.257468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:25.257468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:25.257468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:25.257468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:25.257468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:25.257468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:25.257468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:25.257468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:25.257468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:25.257468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:25.257468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:25.258623 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:36:25.258623 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:36:25.258623 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:25.258623 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:25.258623 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 603/1224] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:25.263392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38833b-936c-4c98-a38b-165ac4ce8c08 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:25.361171 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db38833b-936c-4c98-a38b-165ac4ce8c08 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:25.392782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d054f-e3fe-47e3-9e37-2c3fd356c82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:25.393435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d054f-e3fe-47e3-9e37-2c3fd356c82e None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:25.393718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d054f-e3fe-47e3-9e37-2c3fd356c82e None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:25.393998 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d054f-e3fe-47e3-9e37-2c3fd356c82e None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:25.394709 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d054f-e3fe-47e3-9e37-2c3fd356c82e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:25.395019 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d054f-e3fe-47e3-9e37-2c3fd356c82e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:25.396411 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677d054f-e3fe-47e3-9e37-2c3fd356c82e None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:25.408538 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 622/1225] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:25.414186 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778651b7-2589-407d-8fc1-1eda4e5b1cd0 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:25.506921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:25.513491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778651b7-2589-407d-8fc1-1eda4e5b1cd0 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:25.548132 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b7105-ecab-4493-86cc-914dd7a1b396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:25.549472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b7105-ecab-4493-86cc-914dd7a1b396 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:25.549793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b7105-ecab-4493-86cc-914dd7a1b396 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:25.555147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b7105-ecab-4493-86cc-914dd7a1b396 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:25.557454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b7105-ecab-4493-86cc-914dd7a1b396 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:25.558920 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b7105-ecab-4493-86cc-914dd7a1b396 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:25.572855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-061b7105-ecab-4493-86cc-914dd7a1b396 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 18:36:25.572855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:25.572855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:25.572855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:25.572855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:25.572855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:25.572855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:25.572855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:25.572855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:25.572855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:25.572855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:25.572855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:25.572855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:36:25.572855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:36:25.572855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:36:25.572855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:25.574016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:25.575021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:25.575021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:25.575021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:36:25.575021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:36:25.575021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:36:25.575021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:36:25.575021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:36:25.575021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:36:25.575021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 18:36:25.575021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:25.575021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 604/1226] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:25.580773 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d054f-e3fe-47e3-9e37-2c3fd356c82e None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:25.627797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:25.678114 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677d054f-e3fe-47e3-9e37-2c3fd356c82e None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:25.711677 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83005b82-3d64-4031-ac58-4c3111680fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:25.712340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83005b82-3d64-4031-ac58-4c3111680fbc None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:25.712650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83005b82-3d64-4031-ac58-4c3111680fbc None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:25.712929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83005b82-3d64-4031-ac58-4c3111680fbc None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:25.713763 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83005b82-3d64-4031-ac58-4c3111680fbc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:25.714079 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83005b82-3d64-4031-ac58-4c3111680fbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:25.715564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83005b82-3d64-4031-ac58-4c3111680fbc None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:25.732966 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 623/1227] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Jun 27 18:36:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:25.738625 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b7105-ecab-4493-86cc-914dd7a1b396 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:25.838026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b7105-ecab-4493-86cc-914dd7a1b396 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:25.871801 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bddca-17a7-4076-b8bc-62c68a6e8f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:25.872680 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bddca-17a7-4076-b8bc-62c68a6e8f43 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:25.872968 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bddca-17a7-4076-b8bc-62c68a6e8f43 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:25.873249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bddca-17a7-4076-b8bc-62c68a6e8f43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:25.885951 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bddca-17a7-4076-b8bc-62c68a6e8f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:25.886486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bddca-17a7-4076-b8bc-62c68a6e8f43 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:25.903873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-843bddca-17a7-4076-b8bc-62c68a6e8f43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:25.903873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:25.903873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:25.903873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:25.903873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:25.903873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:25.903873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:25.903873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:25.903873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:25.903873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:25.903873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:25.903873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:25.903873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:36:25.903873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:36:25.903873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:36:25.904969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:36:25.904969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:25.904969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:25.904969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:25.904969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:25.904969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:25.904969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:25.904969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:25.904969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:25.904969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:25.904969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:25.904969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:25.904969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:25.904969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:25.904969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:25.904969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:25.904969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:25.905940 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:36:25.905940 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:36:25.905940 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:25.905940 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:25.905940 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 605/1228] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:25.911344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83005b82-3d64-4031-ac58-4c3111680fbc None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:26.006813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83005b82-3d64-4031-ac58-4c3111680fbc None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:26.009113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:26.040628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dd01d-550b-4428-86cd-fd22396fe05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:26.041328 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dd01d-550b-4428-86cd-fd22396fe05b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:26.041612 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dd01d-550b-4428-86cd-fd22396fe05b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:26.041889 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dd01d-550b-4428-86cd-fd22396fe05b None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:26.042603 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41dd01d-550b-4428-86cd-fd22396fe05b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:26.042910 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41dd01d-550b-4428-86cd-fd22396fe05b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:26.044315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41dd01d-550b-4428-86cd-fd22396fe05b None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:26.055476 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 624/1229] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:26.061070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bddca-17a7-4076-b8bc-62c68a6e8f43 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:26.071721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:26.158840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bddca-17a7-4076-b8bc-62c68a6e8f43 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:26.194834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178a2b8-a4a6-409d-ad65-c8fbd1e0c8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:26.197116 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178a2b8-a4a6-409d-ad65-c8fbd1e0c8d3 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:26.197116 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178a2b8-a4a6-409d-ad65-c8fbd1e0c8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:26.197116 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178a2b8-a4a6-409d-ad65-c8fbd1e0c8d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:26.203332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178a2b8-a4a6-409d-ad65-c8fbd1e0c8d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:26.205827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178a2b8-a4a6-409d-ad65-c8fbd1e0c8d3 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:26.219657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-e178a2b8-a4a6-409d-ad65-c8fbd1e0c8d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:36:26.219657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:26.219657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:26.219657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:26.219657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:26.219657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:26.219657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:26.219657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:26.219657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:26.219657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:26.219657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:26.219657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:26.219657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:36:26.219657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:36:26.219657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:36:26.220689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:36:26.220689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:26.220689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:26.220689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:26.220689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:26.220689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:26.220689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:26.220689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:26.220689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:26.220689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:26.220689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:26.220689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:26.220689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:26.220689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:26.220689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:26.220689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:26.220689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:26.221650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:36:26.221650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:36:26.221650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:36:26.221650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:36:26.221650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:36:26.221650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:36:26.221650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:36:26.221650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:26.221650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 606/1230] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:36:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:36:26.226947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dd01d-550b-4428-86cd-fd22396fe05b None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:26.325820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dd01d-550b-4428-86cd-fd22396fe05b None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:26.359446 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3527a4-6278-4b60-8bf0-fef4420cbeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:26.360752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3527a4-6278-4b60-8bf0-fef4420cbeda None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:26.360951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3527a4-6278-4b60-8bf0-fef4420cbeda None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:26.361277 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3527a4-6278-4b60-8bf0-fef4420cbeda None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:26.362074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3527a4-6278-4b60-8bf0-fef4420cbeda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:26.362384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3527a4-6278-4b60-8bf0-fef4420cbeda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:26.363840 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3527a4-6278-4b60-8bf0-fef4420cbeda None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:26.375613 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 625/1231] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:36:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:26.382032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178a2b8-a4a6-409d-ad65-c8fbd1e0c8d3 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:26.445728 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:26.478478 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178a2b8-a4a6-409d-ad65-c8fbd1e0c8d3 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:26.512702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0c8ebd-0ab1-41d0-b524-de3d86d2dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:26.513586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c8ebd-0ab1-41d0-b524-de3d86d2dd14 None admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:26.513868 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c8ebd-0ab1-41d0-b524-de3d86d2dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:26.514142 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0c8ebd-0ab1-41d0-b524-de3d86d2dd14 None admin] PATH_INFO: `/v3/projects/94dba2006b6747f8badff33745bde432/users/af6ef16884604753972c916f74271f42/roles/62fd6b166d1847b19e812160b459d5db` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:26.528537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c8ebd-0ab1-41d0-b524-de3d86d2dd14 None admin] RBAC: Authorizing `identity:create_grant(project_id=94dba2006b6747f8badff33745bde432, user_id=af6ef16884604753972c916f74271f42, role_id=62fd6b166d1847b19e812160b459d5db)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:26.529810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0c8ebd-0ab1-41d0-b524-de3d86d2dd14 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:26.631214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 607/1232] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:36:26 2022] PUT /identity/v3/projects/94dba2006b6747f8badff33745bde432/users/af6ef16884604753972c916f74271f42/roles/62fd6b166d1847b19e812160b459d5db => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:36:28.615414 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93b7cd-2c95-499a-bd6a-b15b18a23edc None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:28.615992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93b7cd-2c95-499a-bd6a-b15b18a23edc None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:28.615992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93b7cd-2c95-499a-bd6a-b15b18a23edc None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:28.617408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 626/1233] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:36:28.622547 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e504b3-bc8b-460d-910b-7eca368c60c1 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:28.622928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e504b3-bc8b-460d-910b-7eca368c60c1 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:28.623104 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e504b3-bc8b-460d-910b-7eca368c60c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:28.639277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-87e504b3-bc8b-460d-910b-7eca368c60c1 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:36:28.640505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-87e504b3-bc8b-460d-910b-7eca368c60c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:36:28.705724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 608/1234] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:36:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:36:28.729749 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93b7cd-2c95-499a-bd6a-b15b18a23edc None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:28.755674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:28.830909 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93b7cd-2c95-499a-bd6a-b15b18a23edc None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:28.866852 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20789c34-ef56-4746-b417-1324daf79954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:28.867668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20789c34-ef56-4746-b417-1324daf79954 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:28.867951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20789c34-ef56-4746-b417-1324daf79954 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:28.868224 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20789c34-ef56-4746-b417-1324daf79954 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:28.878673 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20789c34-ef56-4746-b417-1324daf79954 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:36:28.886617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-20789c34-ef56-4746-b417-1324daf79954 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:36:28.886617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:28.886617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:28.886617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:28.886617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:28.886617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:28.886617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:28.886617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:28.886617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:28.886617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:28.886617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:28.886617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:28.886617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:36:28.886617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:36:28.886617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:36:28.886617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:36:28.887761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:36:28.887761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:36:28.887761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:36:28.887761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:36:28.887761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:28.887761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:28.887761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:28.887761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:28.887761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:28.887761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:28.887761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:28.887761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:28.887761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:28.887761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:28.887761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:28.887761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:28.888687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:28.888687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:28.888687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:28.888687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:28.888687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:36:28.888687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:36:28.888687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:36:28.888687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:36:28.888687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:36:28.888687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:36:28.888687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 27 18:36:28.888687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:36:28.888687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 627/1235] 10.222.0.36 () {56 vars in 1102 bytes} [Mon Jun 27 18:36:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:28.893722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e504b3-bc8b-460d-910b-7eca368c60c1 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:28.939335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:28.991894 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e504b3-bc8b-460d-910b-7eca368c60c1 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:29.023975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eebd96-8f6b-403c-82d0-8ef116f8863e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:29.024633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eebd96-8f6b-403c-82d0-8ef116f8863e None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:29.024924 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eebd96-8f6b-403c-82d0-8ef116f8863e None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:29.025209 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eebd96-8f6b-403c-82d0-8ef116f8863e None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:29.025959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eebd96-8f6b-403c-82d0-8ef116f8863e None admin] RBAC: Adding query filter params (name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:29.026274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eebd96-8f6b-403c-82d0-8ef116f8863e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:29.027673 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eebd96-8f6b-403c-82d0-8ef116f8863e None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:29.037598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 609/1236] 10.222.0.36 () {56 vars in 1103 bytes} [Mon Jun 27 18:36:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:29.043210 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20789c34-ef56-4746-b417-1324daf79954 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:29.126374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:29.141356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20789c34-ef56-4746-b417-1324daf79954 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:29.173880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd387d2-983a-4023-b8b1-4ebb9804bcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:29.174673 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd387d2-983a-4023-b8b1-4ebb9804bcd8 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:29.174959 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd387d2-983a-4023-b8b1-4ebb9804bcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:29.175238 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd387d2-983a-4023-b8b1-4ebb9804bcd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:29.185315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd387d2-983a-4023-b8b1-4ebb9804bcd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:29.186757 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd387d2-983a-4023-b8b1-4ebb9804bcd8 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:29.203692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-9fd387d2-983a-4023-b8b1-4ebb9804bcd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:29.203692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:29.203692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:29.203692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:29.203692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:29.203692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:29.203692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:29.203692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:29.203692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:29.203692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:29.203692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:29.203692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:29.203692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:36:29.203692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:36:29.203692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:36:29.204770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:36:29.204770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:29.204770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:29.204770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:29.204770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:29.204770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:29.204770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:29.204770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:29.204770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:29.204770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:29.204770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:29.204770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:29.204770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:29.204770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:29.204770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:29.204770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:29.204770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:29.205736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:36:29.205736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:36:29.205736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:29.205736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:36:29.205736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 628/1237] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:36:29.210515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eebd96-8f6b-403c-82d0-8ef116f8863e None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:29.308281 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eebd96-8f6b-403c-82d0-8ef116f8863e None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:29.317995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:29.342420 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0590f4e-d816-4753-9a7b-506d39b03750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:29.343077 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0590f4e-d816-4753-9a7b-506d39b03750 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:29.343365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0590f4e-d816-4753-9a7b-506d39b03750 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:29.343685 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0590f4e-d816-4753-9a7b-506d39b03750 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:29.345098 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0590f4e-d816-4753-9a7b-506d39b03750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:29.345361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0590f4e-d816-4753-9a7b-506d39b03750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:29.346756 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0590f4e-d816-4753-9a7b-506d39b03750 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:29.358034 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 610/1238] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:29.363687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd387d2-983a-4023-b8b1-4ebb9804bcd8 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:29.461596 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd387d2-983a-4023-b8b1-4ebb9804bcd8 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:29.494037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08dfce-2f05-47a7-bcf1-6df7c9412f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:29.494817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08dfce-2f05-47a7-bcf1-6df7c9412f2d None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:29.495099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08dfce-2f05-47a7-bcf1-6df7c9412f2d None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:29.495374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08dfce-2f05-47a7-bcf1-6df7c9412f2d None admin] PATH_INFO: `/v3/users/placement` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:29.498011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:29.503056 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08dfce-2f05-47a7-bcf1-6df7c9412f2d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:29.504543 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f08dfce-2f05-47a7-bcf1-6df7c9412f2d None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:29.519261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-5f08dfce-2f05-47a7-bcf1-6df7c9412f2d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 18:36:29.519261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:29.519261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:29.519261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:29.519261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:29.519261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:29.519261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:29.519261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:29.519261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:29.519261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:29.519261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:29.519261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:29.519261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:36:29.519261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:36:29.519261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:36:29.519261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:29.520478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:29.521777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:29.521777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:29.521777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:36:29.521777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:36:29.521777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:36:29.521777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:36:29.521777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:36:29.521777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:36:29.521777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 18:36:29.521777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:36:29.521777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 629/1239] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:36:29.527725 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0590f4e-d816-4753-9a7b-506d39b03750 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:29.628118 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0590f4e-d816-4753-9a7b-506d39b03750 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:29.662052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fec965-938d-41cb-ab4d-9ee2b7841da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:29.662717 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fec965-938d-41cb-ab4d-9ee2b7841da3 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:29.663006 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fec965-938d-41cb-ab4d-9ee2b7841da3 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:29.663298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fec965-938d-41cb-ab4d-9ee2b7841da3 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:29.664196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fec965-938d-41cb-ab4d-9ee2b7841da3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:29.664510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fec965-938d-41cb-ab4d-9ee2b7841da3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:29.665944 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fec965-938d-41cb-ab4d-9ee2b7841da3 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:29.682779 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 611/1240] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Jun 27 18:36:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:29.688960 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08dfce-2f05-47a7-bcf1-6df7c9412f2d None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:29.788271 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08dfce-2f05-47a7-bcf1-6df7c9412f2d None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:29.821057 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c627614-b9f1-4768-8ec1-b378da3b3c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:29.821693 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c627614-b9f1-4768-8ec1-b378da3b3c6b None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:29.821981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c627614-b9f1-4768-8ec1-b378da3b3c6b None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:29.822258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c627614-b9f1-4768-8ec1-b378da3b3c6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:29.881399 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:29.887655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c627614-b9f1-4768-8ec1-b378da3b3c6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:29.889105 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c627614-b9f1-4768-8ec1-b378da3b3c6b None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:29.983626 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 630/1241] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:36:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:36:29.989499 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fec965-938d-41cb-ab4d-9ee2b7841da3 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:30.016885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:30.086915 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fec965-938d-41cb-ab4d-9ee2b7841da3 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:30.120708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc64e53-f3a8-4009-b80e-ed8f8a2b0371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:30.121501 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc64e53-f3a8-4009-b80e-ed8f8a2b0371 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:30.121778 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc64e53-f3a8-4009-b80e-ed8f8a2b0371 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:30.122054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc64e53-f3a8-4009-b80e-ed8f8a2b0371 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:30.132710 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc64e53-f3a8-4009-b80e-ed8f8a2b0371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:30.134144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc64e53-f3a8-4009-b80e-ed8f8a2b0371 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:30.150974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-5fc64e53-f3a8-4009-b80e-ed8f8a2b0371 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:30.150974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:30.150974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:30.150974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:30.150974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:30.150974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:30.150974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:30.150974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:30.150974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:30.150974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:30.150974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:30.150974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:30.150974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:36:30.150974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:36:30.150974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:36:30.152167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:36:30.152167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:30.152167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:30.152167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:30.152167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:30.152167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:30.152167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:30.152167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:30.152167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:30.152167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:30.152167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:30.152167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:30.152167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:30.152167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:30.152167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:30.152167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:30.152167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:30.153490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:36:30.153490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:36:30.153490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:30.153490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:30.153490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 612/1242] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:36:30.157887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c627614-b9f1-4768-8ec1-b378da3b3c6b None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:30.249099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:30.255424 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c627614-b9f1-4768-8ec1-b378da3b3c6b None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:30.288462 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569693cd-dc0a-46ec-9aa2-65616bbfbc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:30.289115 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569693cd-dc0a-46ec-9aa2-65616bbfbc8d None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:30.289398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569693cd-dc0a-46ec-9aa2-65616bbfbc8d None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:30.289676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569693cd-dc0a-46ec-9aa2-65616bbfbc8d None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:30.290390 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569693cd-dc0a-46ec-9aa2-65616bbfbc8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:30.290704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569693cd-dc0a-46ec-9aa2-65616bbfbc8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:30.292100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569693cd-dc0a-46ec-9aa2-65616bbfbc8d None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:30.303602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 631/1243] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:30.309214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc64e53-f3a8-4009-b80e-ed8f8a2b0371 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:30.385071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:30.405639 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc64e53-f3a8-4009-b80e-ed8f8a2b0371 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:30.438929 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccac1cd-5259-46ad-a07d-5233556ebea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:30.439735 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccac1cd-5259-46ad-a07d-5233556ebea0 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:30.440018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccac1cd-5259-46ad-a07d-5233556ebea0 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:30.440292 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccac1cd-5259-46ad-a07d-5233556ebea0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:30.446793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccac1cd-5259-46ad-a07d-5233556ebea0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:30.448293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccac1cd-5259-46ad-a07d-5233556ebea0 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:30.462932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-6ccac1cd-5259-46ad-a07d-5233556ebea0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:36:30.462932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:30.462932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:30.462932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:30.462932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:30.462932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:30.462932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:30.462932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:30.462932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:30.462932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:30.462932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:30.462932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:30.462932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:36:30.462932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:36:30.462932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:36:30.464070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:36:30.464070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:30.464070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:30.464070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:30.464070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:30.464070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:30.464070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:30.464070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:30.464070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:30.464070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:30.464070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:30.464070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:30.464070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:30.464070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:30.464070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:30.464070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:30.464070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:30.465182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:36:30.465182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:36:30.465182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:36:30.465182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:36:30.465182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:36:30.465182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:36:30.465182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:36:30.465182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:30.465182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 613/1244] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:36:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:30.470549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569693cd-dc0a-46ec-9aa2-65616bbfbc8d None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:30.573021 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569693cd-dc0a-46ec-9aa2-65616bbfbc8d None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:30.605582 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70959d10-9386-46d4-a7ce-816575c294c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:30.606233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70959d10-9386-46d4-a7ce-816575c294c8 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:30.606518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70959d10-9386-46d4-a7ce-816575c294c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:30.606816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70959d10-9386-46d4-a7ce-816575c294c8 None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:30.607612 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70959d10-9386-46d4-a7ce-816575c294c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:30.612859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70959d10-9386-46d4-a7ce-816575c294c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:30.612859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70959d10-9386-46d4-a7ce-816575c294c8 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:30.621614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 632/1245] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:36:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:30.627683 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccac1cd-5259-46ad-a07d-5233556ebea0 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:30.728701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccac1cd-5259-46ad-a07d-5233556ebea0 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:30.761185 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29785f-d046-4aaa-b6fc-0bc941f4fd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:30.761819 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29785f-d046-4aaa-b6fc-0bc941f4fd80 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:30.762108 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29785f-d046-4aaa-b6fc-0bc941f4fd80 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:30.762388 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29785f-d046-4aaa-b6fc-0bc941f4fd80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:30.763213 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29785f-d046-4aaa-b6fc-0bc941f4fd80 None admin] RBAC: Adding query filter params (role.id=62fd6b166d1847b19e812160b459d5db, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=af6ef16884604753972c916f74271f42) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:30.763558 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29785f-d046-4aaa-b6fc-0bc941f4fd80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:30.764982 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29785f-d046-4aaa-b6fc-0bc941f4fd80 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:30.771333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 614/1246] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:36:30 2022] GET /identity/v3/role_assignments?user.id=af6ef16884604753972c916f74271f42&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=62fd6b166d1847b19e812160b459d5db => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:32.859382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4689538-ceee-4a63-97d6-b01403bf7a5f None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:32.860072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4689538-ceee-4a63-97d6-b01403bf7a5f None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:32.860072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4689538-ceee-4a63-97d6-b01403bf7a5f None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:32.861377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 633/1247] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:36:32.866659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435f2b8-2112-4b6b-a131-e7c731a5435b None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:32.867063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435f2b8-2112-4b6b-a131-e7c731a5435b None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:32.867217 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435f2b8-2112-4b6b-a131-e7c731a5435b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:32.872214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:32.884638 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-f435f2b8-2112-4b6b-a131-e7c731a5435b None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:36:32.886342 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-f435f2b8-2112-4b6b-a131-e7c731a5435b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:36:32.948848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 615/1248] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:36:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:36:32.973053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4689538-ceee-4a63-97d6-b01403bf7a5f None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:32.990965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:33.072641 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4689538-ceee-4a63-97d6-b01403bf7a5f None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:33.105033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d75a40-a7ec-4762-88af-ed67e3864040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:33.105813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d75a40-a7ec-4762-88af-ed67e3864040 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:33.106092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d75a40-a7ec-4762-88af-ed67e3864040 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:33.106359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d75a40-a7ec-4762-88af-ed67e3864040 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:33.116718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d75a40-a7ec-4762-88af-ed67e3864040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:36:33.124426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-05d75a40-a7ec-4762-88af-ed67e3864040 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:36:33.124426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:33.124426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:33.124426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:33.124426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:33.124426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:33.124426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:33.124426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:33.124426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:33.124426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:33.124426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:33.124426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:33.124426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:36:33.124426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:36:33.124426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:36:33.124426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:36:33.125590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:36:33.125590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:36:33.125590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:36:33.125590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:36:33.125590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:33.125590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:33.125590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:33.125590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:33.125590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:33.125590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:33.125590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:33.125590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:33.125590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:33.125590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:33.125590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:33.125590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:33.127297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:33.127297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:33.127297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:33.127297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:33.127297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:36:33.127297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:36:33.127297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:36:33.127297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:36:33.127297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:36:33.127297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:36:33.127297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:36:33.127297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:36:33.127297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 634/1249] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:36:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:33.132179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435f2b8-2112-4b6b-a131-e7c731a5435b None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:33.227884 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435f2b8-2112-4b6b-a131-e7c731a5435b None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:33.257914 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:33.262604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6d583-99b5-4709-b750-fcd122ee1a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:33.263262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6d583-99b5-4709-b750-fcd122ee1a4a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:33.263602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6d583-99b5-4709-b750-fcd122ee1a4a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:33.263877 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6d583-99b5-4709-b750-fcd122ee1a4a None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:33.264636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6d583-99b5-4709-b750-fcd122ee1a4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:33.264927 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6d583-99b5-4709-b750-fcd122ee1a4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:33.266342 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6d583-99b5-4709-b750-fcd122ee1a4a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:33.274527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 616/1250] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:36:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:33.280159 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d75a40-a7ec-4762-88af-ed67e3864040 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:33.355312 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:33.378260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d75a40-a7ec-4762-88af-ed67e3864040 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:33.410622 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed863be9-116b-404b-b99a-44d22ac91ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:33.411440 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed863be9-116b-404b-b99a-44d22ac91ddd None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:33.411752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed863be9-116b-404b-b99a-44d22ac91ddd None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:33.412029 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed863be9-116b-404b-b99a-44d22ac91ddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:33.422213 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed863be9-116b-404b-b99a-44d22ac91ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:33.424532 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed863be9-116b-404b-b99a-44d22ac91ddd None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:33.441481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-ed863be9-116b-404b-b99a-44d22ac91ddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:33.441481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:33.441481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:33.441481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:33.441481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:33.441481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:33.441481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:33.441481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:33.441481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:33.441481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:33.441481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:33.441481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:33.441481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:36:33.441481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:36:33.441481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:36:33.442556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:36:33.442556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:33.442556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:33.442556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:33.442556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:33.442556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:33.442556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:33.442556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:33.442556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:33.442556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:33.442556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:33.442556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:33.442556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:33.442556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:33.442556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:33.442556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:33.442556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:33.448100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:36:33.448100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:36:33.448100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:33.448100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:36:33.448100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 635/1251] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:33.448405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6d583-99b5-4709-b750-fcd122ee1a4a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:33.547263 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6d583-99b5-4709-b750-fcd122ee1a4a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:33.580624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff477b1-e88a-44d3-a8c0-fef31d00750f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:33.581277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff477b1-e88a-44d3-a8c0-fef31d00750f None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:33.581559 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff477b1-e88a-44d3-a8c0-fef31d00750f None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:33.581835 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff477b1-e88a-44d3-a8c0-fef31d00750f None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:33.582547 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff477b1-e88a-44d3-a8c0-fef31d00750f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:33.582852 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff477b1-e88a-44d3-a8c0-fef31d00750f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:33.584238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff477b1-e88a-44d3-a8c0-fef31d00750f None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:33.596069 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 617/1252] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:33.601874 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed863be9-116b-404b-b99a-44d22ac91ddd None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:33.698720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed863be9-116b-404b-b99a-44d22ac91ddd None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:33.724000 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:33.731956 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219f6fe-4e56-4aab-b949-0f97063a6fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:33.732751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219f6fe-4e56-4aab-b949-0f97063a6fee None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:33.733033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219f6fe-4e56-4aab-b949-0f97063a6fee None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:33.733310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219f6fe-4e56-4aab-b949-0f97063a6fee None admin] PATH_INFO: `/v3/users/placement` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:33.742137 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219f6fe-4e56-4aab-b949-0f97063a6fee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:33.743610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219f6fe-4e56-4aab-b949-0f97063a6fee None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:33.758228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-d219f6fe-4e56-4aab-b949-0f97063a6fee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 18:36:33.758228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:33.758228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:33.758228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:33.758228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:33.758228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:33.758228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:33.758228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:33.758228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:33.758228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:33.758228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:33.758228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:33.758228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:36:33.758228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:36:33.758228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:36:33.758228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:33.759503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:33.768515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:33.768515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:33.768515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:36:33.768515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:36:33.768515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:36:33.768515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:36:33.768515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:36:33.768515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:36:33.768515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 18:36:33.768515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:36:33.768515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 636/1253] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:33.769311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff477b1-e88a-44d3-a8c0-fef31d00750f None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:33.820992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:33.864836 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff477b1-e88a-44d3-a8c0-fef31d00750f None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:33.897197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdb7fd-ef38-4de8-9d96-3b60590abdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:33.897850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdb7fd-ef38-4de8-9d96-3b60590abdea None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:33.898129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdb7fd-ef38-4de8-9d96-3b60590abdea None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:33.898406 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fdb7fd-ef38-4de8-9d96-3b60590abdea None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:33.899239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdb7fd-ef38-4de8-9d96-3b60590abdea None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:33.899566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdb7fd-ef38-4de8-9d96-3b60590abdea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:33.900992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fdb7fd-ef38-4de8-9d96-3b60590abdea None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:33.918431 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 618/1254] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Jun 27 18:36:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:33.924786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219f6fe-4e56-4aab-b949-0f97063a6fee None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:34.027430 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219f6fe-4e56-4aab-b949-0f97063a6fee None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:34.061001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ecb80-1449-4bba-9d4e-5a7599b4dddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:34.061645 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ecb80-1449-4bba-9d4e-5a7599b4dddd None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:34.061931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ecb80-1449-4bba-9d4e-5a7599b4dddd None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:34.062209 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ecb80-1449-4bba-9d4e-5a7599b4dddd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:34.116489 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:34.128730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ecb80-1449-4bba-9d4e-5a7599b4dddd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:34.130174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ecb80-1449-4bba-9d4e-5a7599b4dddd None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:34.223742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 637/1255] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:36:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:36:34.229825 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdb7fd-ef38-4de8-9d96-3b60590abdea None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:34.326337 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fdb7fd-ef38-4de8-9d96-3b60590abdea None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:34.338901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:34.359707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8acf70-1299-4d5b-a2bf-4078126fa7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:34.361081 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8acf70-1299-4d5b-a2bf-4078126fa7dd None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:34.361367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8acf70-1299-4d5b-a2bf-4078126fa7dd None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:34.361630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8acf70-1299-4d5b-a2bf-4078126fa7dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:34.371277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8acf70-1299-4d5b-a2bf-4078126fa7dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:34.372738 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8acf70-1299-4d5b-a2bf-4078126fa7dd None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:34.389632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-2f8acf70-1299-4d5b-a2bf-4078126fa7dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:34.389632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:34.389632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:34.389632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:34.389632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:34.389632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:34.389632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:34.389632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:34.389632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:34.389632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:34.389632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:34.389632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:34.389632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:36:34.389632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:36:34.389632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:36:34.390653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:36:34.390653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:34.390653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:34.390653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:34.390653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:34.390653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:34.390653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:34.390653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:34.390653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:34.390653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:34.390653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:34.390653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:34.390653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:34.390653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:34.390653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:34.390653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:34.390653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:34.391747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:36:34.391747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:36:34.391747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:34.391747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:34.391747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 619/1256] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:34.396685 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ecb80-1449-4bba-9d4e-5a7599b4dddd None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:34.482975 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:34.495459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ecb80-1449-4bba-9d4e-5a7599b4dddd None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:34.528787 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952e882-8c53-4752-8a8c-e66d75b4bae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:34.529452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952e882-8c53-4752-8a8c-e66d75b4bae8 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:34.529739 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952e882-8c53-4752-8a8c-e66d75b4bae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:34.530039 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952e882-8c53-4752-8a8c-e66d75b4bae8 None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:34.530747 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952e882-8c53-4752-8a8c-e66d75b4bae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:34.531060 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952e882-8c53-4752-8a8c-e66d75b4bae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:34.532975 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952e882-8c53-4752-8a8c-e66d75b4bae8 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:34.544346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 638/1257] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:34.550575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8acf70-1299-4d5b-a2bf-4078126fa7dd None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:34.647919 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8acf70-1299-4d5b-a2bf-4078126fa7dd None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:34.681805 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222b2ab-b493-47a5-b5f3-f1a76d627756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:34.682578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222b2ab-b493-47a5-b5f3-f1a76d627756 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:34.682858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222b2ab-b493-47a5-b5f3-f1a76d627756 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:34.683128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222b2ab-b493-47a5-b5f3-f1a76d627756 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:34.689761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222b2ab-b493-47a5-b5f3-f1a76d627756 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:34.691242 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222b2ab-b493-47a5-b5f3-f1a76d627756 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:34.705190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-1222b2ab-b493-47a5-b5f3-f1a76d627756 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:36:34.705190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:34.705190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:34.705190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:34.705190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:34.705190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:34.705190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:34.705190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:34.705190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:34.705190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:34.705190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:34.705190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:34.705190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:36:34.705190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:36:34.705190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:36:34.706200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:36:34.706200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:34.706200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:34.706200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:34.706200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:34.706200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:34.706200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:34.706200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:34.706200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:34.706200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:34.706200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:34.706200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:34.706200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:34.706200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:34.706200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:34.706200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:34.706200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:34.707101 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:36:34.707101 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:36:34.707101 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:36:34.707101 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:36:34.707101 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:36:34.707101 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:36:34.707101 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:36:34.707101 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:34.707101 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 620/1258] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:36:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:34.712828 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952e882-8c53-4752-8a8c-e66d75b4bae8 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:34.810307 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952e882-8c53-4752-8a8c-e66d75b4bae8 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:34.843829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84412d-4522-4336-9ede-3cf34059621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:34.844490 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84412d-4522-4336-9ede-3cf34059621e None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:34.845396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84412d-4522-4336-9ede-3cf34059621e None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:34.845678 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84412d-4522-4336-9ede-3cf34059621e None admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:34.846514 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84412d-4522-4336-9ede-3cf34059621e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:34.846831 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84412d-4522-4336-9ede-3cf34059621e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:34.848300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84412d-4522-4336-9ede-3cf34059621e None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:34.861321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 639/1259] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:36:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:34.867401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222b2ab-b493-47a5-b5f3-f1a76d627756 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:34.895151 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:34.966246 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222b2ab-b493-47a5-b5f3-f1a76d627756 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:34.999321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4409f0-2784-4976-ba89-f400dbf1d3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:34.999991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4409f0-2784-4976-ba89-f400dbf1d3ba None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:35.000316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4409f0-2784-4976-ba89-f400dbf1d3ba None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:35.000591 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4409f0-2784-4976-ba89-f400dbf1d3ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:35.001459 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4409f0-2784-4976-ba89-f400dbf1d3ba None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=af6ef16884604753972c916f74271f42) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:35.001768 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4409f0-2784-4976-ba89-f400dbf1d3ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:35.003185 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4409f0-2784-4976-ba89-f400dbf1d3ba None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:35.009544 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 621/1260] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:36:34 2022] GET /identity/v3/role_assignments?user.id=af6ef16884604753972c916f74271f42&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=b156409c977248e1b23c26e589b1e04f => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:36.984208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9cfaf-3488-4415-8997-d12f6e804d00 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:36.984767 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9cfaf-3488-4415-8997-d12f6e804d00 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:36.984767 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9cfaf-3488-4415-8997-d12f6e804d00 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:36.986152 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 640/1261] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:36:36.991221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21d2c8-09b0-4dae-a689-3bc51457a42c None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:36.991655 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21d2c8-09b0-4dae-a689-3bc51457a42c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:36.991827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e21d2c8-09b0-4dae-a689-3bc51457a42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:37.008307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-2e21d2c8-09b0-4dae-a689-3bc51457a42c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:36:37.009499 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-2e21d2c8-09b0-4dae-a689-3bc51457a42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:36:37.076295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 622/1262] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:36:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:36:37.099857 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9cfaf-3488-4415-8997-d12f6e804d00 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:37.111040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:37.201013 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9cfaf-3488-4415-8997-d12f6e804d00 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:37.234959 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626395f-6be7-4816-a1a2-eacfc3eb0f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:37.235714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626395f-6be7-4816-a1a2-eacfc3eb0f68 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:37.235998 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626395f-6be7-4816-a1a2-eacfc3eb0f68 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:37.236326 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626395f-6be7-4816-a1a2-eacfc3eb0f68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:37.246189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626395f-6be7-4816-a1a2-eacfc3eb0f68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:36:37.254354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-6626395f-6be7-4816-a1a2-eacfc3eb0f68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:36:37.254354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:37.254354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:37.254354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:37.254354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:37.254354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:37.254354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:37.254354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:37.254354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:37.254354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:37.254354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:37.254354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:37.254354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:36:37.254354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:36:37.254354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:36:37.254354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:36:37.255485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:36:37.255485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:36:37.255485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:36:37.255485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:36:37.255485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:37.255485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:37.255485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:37.255485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:37.255485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:37.255485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:37.255485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:37.255485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:37.255485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:37.255485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:37.255485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:37.255485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:37.256779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:37.256779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:37.256779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:37.256779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:37.256779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:36:37.256779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:36:37.256779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:36:37.256779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:36:37.256779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:36:37.256779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:36:37.256779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:36:37.256779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:36:37.256779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 641/1263] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:36:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 27 18:36:37.261672 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21d2c8-09b0-4dae-a689-3bc51457a42c None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:37.281896 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:37.361833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e21d2c8-09b0-4dae-a689-3bc51457a42c None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:37.395675 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d80af1-b15e-4b11-9ea5-a559b7f45004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:37.396333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d80af1-b15e-4b11-9ea5-a559b7f45004 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:37.396617 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d80af1-b15e-4b11-9ea5-a559b7f45004 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:37.396896 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d80af1-b15e-4b11-9ea5-a559b7f45004 None admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:37.397635 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d80af1-b15e-4b11-9ea5-a559b7f45004 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:37.397941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d80af1-b15e-4b11-9ea5-a559b7f45004 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:37.399296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d80af1-b15e-4b11-9ea5-a559b7f45004 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:37.407391 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 623/1264] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:36:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:36:37.413137 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626395f-6be7-4816-a1a2-eacfc3eb0f68 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:37.479315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:37.512261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626395f-6be7-4816-a1a2-eacfc3eb0f68 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:37.546224 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7d701-814c-424d-a468-0ea4b7c2499e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:37.547095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7d701-814c-424d-a468-0ea4b7c2499e None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:37.547470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7d701-814c-424d-a468-0ea4b7c2499e None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:37.553642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7d701-814c-424d-a468-0ea4b7c2499e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:37.558859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7d701-814c-424d-a468-0ea4b7c2499e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:37.560352 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7d701-814c-424d-a468-0ea4b7c2499e None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:37.577488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-c9b7d701-814c-424d-a468-0ea4b7c2499e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:37.577488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:37.577488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:37.577488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:37.577488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:37.577488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:37.577488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:37.577488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:37.577488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:37.577488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:37.577488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:37.577488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:37.577488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:36:37.577488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:36:37.577488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:36:37.578557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:36:37.578557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:37.578557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:37.578557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:37.578557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:37.578557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:37.578557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:37.578557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:37.578557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:37.578557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:37.578557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:37.578557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:37.578557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:37.578557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:37.578557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:37.578557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:37.578557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:37.579579 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:36:37.579579 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:36:37.579579 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:37.579579 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:36:37.579579 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 642/1265] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:37.584460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d80af1-b15e-4b11-9ea5-a559b7f45004 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:37.665617 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:37.684143 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d80af1-b15e-4b11-9ea5-a559b7f45004 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:37.716089 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399afc2-f188-46bc-902e-7e652fa66f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:37.716742 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399afc2-f188-46bc-902e-7e652fa66f5a None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:37.717027 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399afc2-f188-46bc-902e-7e652fa66f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:37.717306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399afc2-f188-46bc-902e-7e652fa66f5a None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:37.718026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399afc2-f188-46bc-902e-7e652fa66f5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:37.718335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399afc2-f188-46bc-902e-7e652fa66f5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:37.719731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399afc2-f188-46bc-902e-7e652fa66f5a None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:37.731214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 624/1266] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:36:37.737576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7d701-814c-424d-a468-0ea4b7c2499e None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:37.837674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7d701-814c-424d-a468-0ea4b7c2499e None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:37.856786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:37.870789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04490caa-0abc-4d58-b444-a37d81f40b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:37.871721 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490caa-0abc-4d58-b444-a37d81f40b9f None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:37.872012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490caa-0abc-4d58-b444-a37d81f40b9f None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:37.872293 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490caa-0abc-4d58-b444-a37d81f40b9f None admin] PATH_INFO: `/v3/users/placement` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:37.880564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04490caa-0abc-4d58-b444-a37d81f40b9f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:37.885559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04490caa-0abc-4d58-b444-a37d81f40b9f None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:37.896732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-04490caa-0abc-4d58-b444-a37d81f40b9f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 18:36:37.896732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:37.896732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:37.896732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:37.896732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:37.896732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:37.896732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:37.896732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:37.896732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:37.896732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:37.896732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:37.896732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:37.896732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:36:37.896732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:36:37.896732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:36:37.896732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:37.897935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:37.899232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:37.899232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:37.899232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:36:37.899232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:36:37.899232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:36:37.899232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:36:37.899232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:36:37.899232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:36:37.899232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 18:36:37.899232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:36:37.899232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 643/1267] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:37.903918 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399afc2-f188-46bc-902e-7e652fa66f5a None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:38.003736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399afc2-f188-46bc-902e-7e652fa66f5a None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:38.039776 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa957fe-8232-4ed6-b7f8-d505970cb093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:38.040444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa957fe-8232-4ed6-b7f8-d505970cb093 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:38.040727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa957fe-8232-4ed6-b7f8-d505970cb093 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:38.041008 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa957fe-8232-4ed6-b7f8-d505970cb093 None admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:38.041840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa957fe-8232-4ed6-b7f8-d505970cb093 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:38.042154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa957fe-8232-4ed6-b7f8-d505970cb093 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:38.043605 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa957fe-8232-4ed6-b7f8-d505970cb093 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:38.052625 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:38.062085 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 625/1268] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Jun 27 18:36:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:38.067866 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04490caa-0abc-4d58-b444-a37d81f40b9f None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:38.169457 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04490caa-0abc-4d58-b444-a37d81f40b9f None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:38.203540 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabac42e-bbc9-4703-863b-e375d78db33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:38.204391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabac42e-bbc9-4703-863b-e375d78db33a None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:38.204676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabac42e-bbc9-4703-863b-e375d78db33a None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:38.204956 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabac42e-bbc9-4703-863b-e375d78db33a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:38.215664 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabac42e-bbc9-4703-863b-e375d78db33a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:38.217137 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabac42e-bbc9-4703-863b-e375d78db33a None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:38.234897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-fabac42e-bbc9-4703-863b-e375d78db33a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:38.234897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:38.234897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:38.234897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:38.234897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:38.234897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:38.234897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:38.234897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:38.234897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:38.234897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:38.234897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:38.234897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:38.234897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:36:38.234897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:36:38.234897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:36:38.236571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:36:38.236571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:38.236571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:38.236571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:38.236571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:38.236571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:38.236571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:38.236571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:38.236571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:38.236571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:38.236571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:38.236571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:38.236571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:38.236571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:38.236571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:38.236571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:38.236571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:38.237666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:36:38.237666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:36:38.237666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:38.237666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:36:38.237666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 644/1269] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:38.242388 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa957fe-8232-4ed6-b7f8-d505970cb093 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:38.339136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa957fe-8232-4ed6-b7f8-d505970cb093 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:38.372831 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01776c48-10be-46f8-99a4-7d9d5453eb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:38.373485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01776c48-10be-46f8-99a4-7d9d5453eb1d None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:38.373769 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01776c48-10be-46f8-99a4-7d9d5453eb1d None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:38.374045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01776c48-10be-46f8-99a4-7d9d5453eb1d None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:38.374762 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01776c48-10be-46f8-99a4-7d9d5453eb1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:38.375079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01776c48-10be-46f8-99a4-7d9d5453eb1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:38.376472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01776c48-10be-46f8-99a4-7d9d5453eb1d None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:38.387518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 626/1270] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:38.393722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabac42e-bbc9-4703-863b-e375d78db33a None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:38.425085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:38.492780 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabac42e-bbc9-4703-863b-e375d78db33a None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:38.526024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f42e1-f36f-4112-953d-6eed6dade801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:38.526863 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f42e1-f36f-4112-953d-6eed6dade801 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:38.527174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f42e1-f36f-4112-953d-6eed6dade801 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:38.527456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f42e1-f36f-4112-953d-6eed6dade801 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:38.534737 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f42e1-f36f-4112-953d-6eed6dade801 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:38.536233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f42e1-f36f-4112-953d-6eed6dade801 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:38.551040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-719f42e1-f36f-4112-953d-6eed6dade801 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:36:38.551040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:38.551040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:38.551040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:38.551040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:38.551040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:38.551040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:38.551040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:38.551040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:38.551040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:38.551040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:38.551040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:38.551040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:36:38.551040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:36:38.551040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:36:38.552090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:36:38.552090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:38.552090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:38.552090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:38.552090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:38.552090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:38.552090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:38.552090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:38.552090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:38.552090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:38.552090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:38.552090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:38.552090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:38.552090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:38.552090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:38.552090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:38.552090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:38.553377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:36:38.553377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:36:38.553377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:36:38.553377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:36:38.553377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:36:38.553377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:36:38.553377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:36:38.553377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:36:38.553377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 645/1271] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:36:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:38.558035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01776c48-10be-46f8-99a4-7d9d5453eb1d None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:38.615805 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:38.656454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01776c48-10be-46f8-99a4-7d9d5453eb1d None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:38.690727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ac9a7-8dc7-45c6-9c09-39b0713a3a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:38.691325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ac9a7-8dc7-45c6-9c09-39b0713a3a49 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:38.691641 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ac9a7-8dc7-45c6-9c09-39b0713a3a49 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:38.691926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ac9a7-8dc7-45c6-9c09-39b0713a3a49 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:38.692713 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ac9a7-8dc7-45c6-9c09-39b0713a3a49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:38.693029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ac9a7-8dc7-45c6-9c09-39b0713a3a49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:38.694460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ac9a7-8dc7-45c6-9c09-39b0713a3a49 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:38.706832 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 627/1272] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:36:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:38.712770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f42e1-f36f-4112-953d-6eed6dade801 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:38.802082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:38.810550 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f42e1-f36f-4112-953d-6eed6dade801 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:38.843667 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff8ce4-8581-44df-8ba3-42544534f047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:38.845086 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff8ce4-8581-44df-8ba3-42544534f047 None admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:38.845392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff8ce4-8581-44df-8ba3-42544534f047 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:38.845665 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff8ce4-8581-44df-8ba3-42544534f047 None admin] PATH_INFO: `/v3/projects/94dba2006b6747f8badff33745bde432/users/af6ef16884604753972c916f74271f42/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:38.847595 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff8ce4-8581-44df-8ba3-42544534f047 None admin] RBAC: Authorizing `identity:create_grant(project_id=94dba2006b6747f8badff33745bde432, user_id=af6ef16884604753972c916f74271f42, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:38.849029 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff8ce4-8581-44df-8ba3-42544534f047 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:38.956275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 646/1273] 10.222.0.36 () {58 vars in 1439 bytes} [Mon Jun 27 18:36:38 2022] PUT /identity/v3/projects/94dba2006b6747f8badff33745bde432/users/af6ef16884604753972c916f74271f42/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:36:40.965769 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162c559-844d-4952-b8ad-f65f1148c7c4 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:40.966303 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162c559-844d-4952-b8ad-f65f1148c7c4 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:40.966303 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162c559-844d-4952-b8ad-f65f1148c7c4 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:40.967773 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 628/1274] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:36:40.973631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2da8a9-d69d-4e06-b638-63fd34c528ad None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:40.974017 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2da8a9-d69d-4e06-b638-63fd34c528ad None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:40.983764 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2da8a9-d69d-4e06-b638-63fd34c528ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:40.990842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-8b2da8a9-d69d-4e06-b638-63fd34c528ad None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:36:40.992049 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-8b2da8a9-d69d-4e06-b638-63fd34c528ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:36:41.056967 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 647/1275] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:36:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:36:41.080525 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162c559-844d-4952-b8ad-f65f1148c7c4 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:41.182061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162c559-844d-4952-b8ad-f65f1148c7c4 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:41.198600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:41.214530 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b0954-11ac-4a6e-8024-99b71d300d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:41.215314 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b0954-11ac-4a6e-8024-99b71d300d39 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:41.215633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b0954-11ac-4a6e-8024-99b71d300d39 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:41.215960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b0954-11ac-4a6e-8024-99b71d300d39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:41.226378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b0954-11ac-4a6e-8024-99b71d300d39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 27 18:36:41.234025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-324b0954-11ac-4a6e-8024-99b71d300d39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:36:41.234025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:41.234025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:41.234025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:41.234025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:41.234025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:41.234025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:41.234025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:41.234025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:41.234025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:41.234025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:41.234025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:41.234025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 27 18:36:41.234025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 27 18:36:41.234025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 27 18:36:41.234025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 27 18:36:41.237244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 27 18:36:41.237244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 27 18:36:41.237244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 27 18:36:41.237244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 27 18:36:41.237244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:41.237244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:41.237244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:41.237244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:41.237244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:41.237244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:41.237244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:41.237244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:41.237244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:41.237244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:41.237244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:41.237244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:41.238099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:41.238099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:41.238099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:41.238099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:41.238099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 27 18:36:41.238099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 27 18:36:41.238099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 27 18:36:41.238099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 27 18:36:41.238099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 27 18:36:41.238099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 27 18:36:41.238099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 27 18:36:41.238099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:41.238099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 629/1276] 10.222.0.36 () {56 vars in 1096 bytes} [Mon Jun 27 18:36:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:41.242159 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2da8a9-d69d-4e06-b638-63fd34c528ad None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:41.321083 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:41.339037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2da8a9-d69d-4e06-b638-63fd34c528ad None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:41.371849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9b7b6-ea8f-4e08-a967-9e3eb1197320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:41.372512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9b7b6-ea8f-4e08-a967-9e3eb1197320 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:41.372799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9b7b6-ea8f-4e08-a967-9e3eb1197320 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:41.373080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc9b7b6-ea8f-4e08-a967-9e3eb1197320 None admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:41.373825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9b7b6-ea8f-4e08-a967-9e3eb1197320 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:41.374136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9b7b6-ea8f-4e08-a967-9e3eb1197320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:41.375546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc9b7b6-ea8f-4e08-a967-9e3eb1197320 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:41.383831 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 648/1277] 10.222.0.36 () {56 vars in 1099 bytes} [Mon Jun 27 18:36:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:41.389192 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b0954-11ac-4a6e-8024-99b71d300d39 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:41.492756 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b0954-11ac-4a6e-8024-99b71d300d39 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:41.526185 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b74d4a-88c0-4c55-a458-a50b96151cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:41.526978 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b74d4a-88c0-4c55-a458-a50b96151cde None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:41.527268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b74d4a-88c0-4c55-a458-a50b96151cde None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:41.527567 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b74d4a-88c0-4c55-a458-a50b96151cde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:41.538084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b74d4a-88c0-4c55-a458-a50b96151cde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:41.539548 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b74d4a-88c0-4c55-a458-a50b96151cde None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:41.556848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-13b74d4a-88c0-4c55-a458-a50b96151cde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:41.556848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:41.556848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:41.556848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:41.556848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:41.556848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:41.556848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:41.556848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:41.556848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:41.556848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:41.556848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:41.556848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:41.556848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:36:41.556848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:36:41.556848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:36:41.557922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:36:41.557922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:41.557922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:41.557922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:41.557922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:41.557922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:41.557922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:41.557922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:41.557922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:41.557922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:41.557922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:41.557922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:41.557922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:41.557922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:41.557922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:41.557922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:41.557922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:41.558932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:36:41.558932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:36:41.558932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:41.558932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:41.558932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 630/1278] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:41.564305 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9b7b6-ea8f-4e08-a967-9e3eb1197320 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:41.663275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc9b7b6-ea8f-4e08-a967-9e3eb1197320 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:41.696736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b3e2e-2b82-4fe3-8660-c447fe4b555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:41.697389 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3e2e-2b82-4fe3-8660-c447fe4b555d None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:41.697671 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3e2e-2b82-4fe3-8660-c447fe4b555d None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:41.697945 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67b3e2e-2b82-4fe3-8660-c447fe4b555d None admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:41.698656 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b3e2e-2b82-4fe3-8660-c447fe4b555d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:41.698964 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b3e2e-2b82-4fe3-8660-c447fe4b555d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:41.700434 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67b3e2e-2b82-4fe3-8660-c447fe4b555d None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:41.712654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 649/1279] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:41.718491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b74d4a-88c0-4c55-a458-a50b96151cde None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:41.749045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:41.818948 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b74d4a-88c0-4c55-a458-a50b96151cde None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:41.852665 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811c74a-f68f-4337-b4c1-04a09cbfa38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:41.853447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811c74a-f68f-4337-b4c1-04a09cbfa38c None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:41.853729 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811c74a-f68f-4337-b4c1-04a09cbfa38c None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:41.854010 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811c74a-f68f-4337-b4c1-04a09cbfa38c None admin] PATH_INFO: `/v3/users/placement` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:41.861877 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811c74a-f68f-4337-b4c1-04a09cbfa38c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:41.863428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811c74a-f68f-4337-b4c1-04a09cbfa38c None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:41.877580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-d811c74a-f68f-4337-b4c1-04a09cbfa38c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 27 18:36:41.877580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:41.877580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:41.877580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:41.877580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:41.877580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:41.877580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:41.877580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:41.877580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:41.877580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:41.877580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:41.877580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:41.877580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 27 18:36:41.877580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 27 18:36:41.877580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 27 18:36:41.877580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:41.878523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:41.879575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:41.879575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:41.879575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 27 18:36:41.879575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 27 18:36:41.879575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 27 18:36:41.879575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 27 18:36:41.879575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 27 18:36:41.879575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 27 18:36:41.879575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 27 18:36:41.879575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:41.879575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 631/1280] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:41.884689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b3e2e-2b82-4fe3-8660-c447fe4b555d None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:41.888493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:41.981853 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67b3e2e-2b82-4fe3-8660-c447fe4b555d None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:42.014847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac882b-7ae9-47fc-8824-0ea868319026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:42.015446 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac882b-7ae9-47fc-8824-0ea868319026 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:42.015759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac882b-7ae9-47fc-8824-0ea868319026 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:42.016591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac882b-7ae9-47fc-8824-0ea868319026 None admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:42.017505 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac882b-7ae9-47fc-8824-0ea868319026 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:42.017819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac882b-7ae9-47fc-8824-0ea868319026 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:42.019246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac882b-7ae9-47fc-8824-0ea868319026 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:42.036408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 650/1281] 10.222.0.36 () {56 vars in 1143 bytes} [Mon Jun 27 18:36:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:42.042204 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811c74a-f68f-4337-b4c1-04a09cbfa38c None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:42.132646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:42.142603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811c74a-f68f-4337-b4c1-04a09cbfa38c None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:42.177941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97ecfd-76f7-4986-8d80-96bb20c25ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:42.178585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97ecfd-76f7-4986-8d80-96bb20c25ff7 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:42.178870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97ecfd-76f7-4986-8d80-96bb20c25ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:42.179146 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97ecfd-76f7-4986-8d80-96bb20c25ff7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:42.244712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97ecfd-76f7-4986-8d80-96bb20c25ff7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:42.246169 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97ecfd-76f7-4986-8d80-96bb20c25ff7 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:42.337823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:42.348602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 632/1282] 10.222.0.36 () {58 vars in 1282 bytes} [Mon Jun 27 18:36:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 27 18:36:42.354961 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac882b-7ae9-47fc-8824-0ea868319026 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:42.422306 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:42.462286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac882b-7ae9-47fc-8824-0ea868319026 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:42.498503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141fb61-2fb8-4180-8136-88361f8865bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:42.499331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141fb61-2fb8-4180-8136-88361f8865bc None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:42.499651 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141fb61-2fb8-4180-8136-88361f8865bc None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:42.499932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141fb61-2fb8-4180-8136-88361f8865bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:42.511998 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141fb61-2fb8-4180-8136-88361f8865bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:42.513499 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141fb61-2fb8-4180-8136-88361f8865bc None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:42.536442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-8141fb61-2fb8-4180-8136-88361f8865bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:42.536442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:42.536442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:42.536442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:42.536442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:42.536442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:42.536442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:42.536442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:42.536442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:42.536442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:42.536442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:42.536442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:42.536442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 27 18:36:42.536442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 27 18:36:42.536442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 27 18:36:42.537527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 27 18:36:42.537527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:42.537527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:42.537527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:42.537527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:42.537527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:42.537527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:42.537527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:42.537527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:42.537527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:42.537527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:42.537527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:42.537527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:42.537527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:42.537527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:42.537527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:42.537527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:42.538455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 27 18:36:42.538455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 27 18:36:42.538455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 27 18:36:42.538455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:36:42.538455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 651/1283] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:42.543624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97ecfd-76f7-4986-8d80-96bb20c25ff7 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:42.649063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97ecfd-76f7-4986-8d80-96bb20c25ff7 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:42.682410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b72bc9-94c7-4e9f-9948-1c1d1f71a353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:42.683659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b72bc9-94c7-4e9f-9948-1c1d1f71a353 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:42.683659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b72bc9-94c7-4e9f-9948-1c1d1f71a353 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:42.683659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b72bc9-94c7-4e9f-9948-1c1d1f71a353 None admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:42.684385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b72bc9-94c7-4e9f-9948-1c1d1f71a353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:42.684697 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b72bc9-94c7-4e9f-9948-1c1d1f71a353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:42.686068 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b72bc9-94c7-4e9f-9948-1c1d1f71a353 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:42.698195 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 633/1284] 10.222.0.36 () {56 vars in 1109 bytes} [Mon Jun 27 18:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:42.704857 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141fb61-2fb8-4180-8136-88361f8865bc None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:42.807281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141fb61-2fb8-4180-8136-88361f8865bc None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:42.821706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:42.840954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2419f7f-b7bf-44f7-a149-5303ad661307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:42.841737 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2419f7f-b7bf-44f7-a149-5303ad661307 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:42.842026 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2419f7f-b7bf-44f7-a149-5303ad661307 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:42.842307 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2419f7f-b7bf-44f7-a149-5303ad661307 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:42.848778 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2419f7f-b7bf-44f7-a149-5303ad661307 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:42.850234 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2419f7f-b7bf-44f7-a149-5303ad661307 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:42.865058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application [None req-b2419f7f-b7bf-44f7-a149-5303ad661307 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:36:42.865058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:42.865058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:42.865058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:42.865058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:42.865058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:42.865058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:42.865058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:42.865058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:42.865058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:42.865058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:42.865058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:42.865058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 27 18:36:42.865058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 27 18:36:42.865058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 27 18:36:42.870971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 27 18:36:42.870971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:42.870971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:42.870971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:42.870971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:42.870971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:42.870971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:42.870971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:42.870971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:42.870971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:42.870971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:42.870971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:42.870971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:42.870971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:42.870971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:42.870971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:42.870971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:42.871953 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 27 18:36:42.871953 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 27 18:36:42.871953 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 27 18:36:42.871953 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 27 18:36:42.871953 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 27 18:36:42.871953 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 27 18:36:42.871953 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 27 18:36:42.871953 dv-cinder-844601-6-smb devstack@keystone.service[86869]: ERROR keystone.server.flask.application Jun 27 18:36:42.871953 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 652/1285] 10.222.0.36 () {56 vars in 1111 bytes} [Mon Jun 27 18:36:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:42.872446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b72bc9-94c7-4e9f-9948-1c1d1f71a353 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:42.921361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:42.971122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b72bc9-94c7-4e9f-9948-1c1d1f71a353 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:43.004503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8381099b-68cb-4920-904f-93f4148f9397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:43.005154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381099b-68cb-4920-904f-93f4148f9397 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:43.005438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381099b-68cb-4920-904f-93f4148f9397 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:43.005712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381099b-68cb-4920-904f-93f4148f9397 None admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:43.006490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381099b-68cb-4920-904f-93f4148f9397 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:43.006802 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381099b-68cb-4920-904f-93f4148f9397 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:43.008250 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8381099b-68cb-4920-904f-93f4148f9397 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:43.020159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 634/1286] 10.222.0.36 () {56 vars in 1148 bytes} [Mon Jun 27 18:36:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:43.026098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2419f7f-b7bf-44f7-a149-5303ad661307 None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:43.124056 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2419f7f-b7bf-44f7-a149-5303ad661307 None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:43.156615 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7e8ce-7da6-4159-94ef-07dd1a2597c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:43.157739 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7e8ce-7da6-4159-94ef-07dd1a2597c3 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:43.158017 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7e8ce-7da6-4159-94ef-07dd1a2597c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:43.158287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7e8ce-7da6-4159-94ef-07dd1a2597c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:43.159095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7e8ce-7da6-4159-94ef-07dd1a2597c3 None admin] RBAC: Adding query filter params (role.id=b156409c977248e1b23c26e589b1e04f, scope.project.id=94dba2006b6747f8badff33745bde432, user.id=af6ef16884604753972c916f74271f42) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:43.159404 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7e8ce-7da6-4159-94ef-07dd1a2597c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:43.160909 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7e8ce-7da6-4159-94ef-07dd1a2597c3 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:43.166595 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 653/1287] 10.222.0.36 () {56 vars in 1374 bytes} [Mon Jun 27 18:36:43 2022] GET /identity/v3/role_assignments?user.id=af6ef16884604753972c916f74271f42&scope.project.id=94dba2006b6747f8badff33745bde432&role.id=b156409c977248e1b23c26e589b1e04f => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:45.207935 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e59b8e-2999-4546-bd36-c6998fd27aa6 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:45.208489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e59b8e-2999-4546-bd36-c6998fd27aa6 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:45.208606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e59b8e-2999-4546-bd36-c6998fd27aa6 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:45.209973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 635/1288] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:36:45.215228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cc875-671e-4826-b778-3c992a76c8a2 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:45.215666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cc875-671e-4826-b778-3c992a76c8a2 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:45.215817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421cc875-671e-4826-b778-3c992a76c8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:45.233262 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-421cc875-671e-4826-b778-3c992a76c8a2 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:36:45.234456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-421cc875-671e-4826-b778-3c992a76c8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:36:45.262888 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:45.298985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 654/1289] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:36:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:36:45.321189 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e59b8e-2999-4546-bd36-c6998fd27aa6 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:45.420789 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e59b8e-2999-4546-bd36-c6998fd27aa6 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:45.431098 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:45.454385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6f14a-5916-4298-9685-52d03a0882f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:45.455183 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6f14a-5916-4298-9685-52d03a0882f7 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:45.455502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6f14a-5916-4298-9685-52d03a0882f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:45.455849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6f14a-5916-4298-9685-52d03a0882f7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:45.456689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6f14a-5916-4298-9685-52d03a0882f7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:45.458080 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6f14a-5916-4298-9685-52d03a0882f7 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:45.470702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-bea6f14a-5916-4298-9685-52d03a0882f7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 18:36:45.470702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:45.470702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:36:45.470702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:36:45.470702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:36:45.470702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:36:45.470702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:36:45.470702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:36:45.470702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 18:36:45.470702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:45.470702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:36:45.470702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:45.470702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:45.470702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:45.470702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:45.470702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:45.470702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:45.471997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:45.471997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:45.471997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:45.471997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:45.471997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:45.471997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:45.471997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:36:45.471997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:36:45.471997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:36:45.471997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:36:45.471997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:45.471997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:45.471997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:45.471997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:45.471997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:45.471997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:45.473073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:45.473073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:45.473073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:45.473073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:45.473073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:45.473073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:45.473073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:45.473073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:45.473073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:45.473073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:45.473073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:36:45.473073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:36:45.473073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 18:36:45.473073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:45.473073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 636/1290] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jun 27 18:36:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:45.478162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cc875-671e-4826-b778-3c992a76c8a2 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:45.574961 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421cc875-671e-4826-b778-3c992a76c8a2 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:45.609219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3134a-7fe8-4b04-bdfe-f81198b55518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:45.610481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3134a-7fe8-4b04-bdfe-f81198b55518 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:45.610767 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3134a-7fe8-4b04-bdfe-f81198b55518 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:45.611078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3134a-7fe8-4b04-bdfe-f81198b55518 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:45.611813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3134a-7fe8-4b04-bdfe-f81198b55518 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:45.612124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3134a-7fe8-4b04-bdfe-f81198b55518 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:45.613489 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3134a-7fe8-4b04-bdfe-f81198b55518 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:45.618284 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 655/1291] 10.222.0.36 () {56 vars in 1116 bytes} [Mon Jun 27 18:36:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:45.624023 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6f14a-5916-4298-9685-52d03a0882f7 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:45.722221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6f14a-5916-4298-9685-52d03a0882f7 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:45.755462 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261971fc-db53-4ad1-a4ea-f8500f2f3975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:45.756159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261971fc-db53-4ad1-a4ea-f8500f2f3975 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:45.756490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261971fc-db53-4ad1-a4ea-f8500f2f3975 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:45.756807 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261971fc-db53-4ad1-a4ea-f8500f2f3975 None admin] PATH_INFO: `/v3/services` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:45.757549 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261971fc-db53-4ad1-a4ea-f8500f2f3975 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:45.757887 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261971fc-db53-4ad1-a4ea-f8500f2f3975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:45.759255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261971fc-db53-4ad1-a4ea-f8500f2f3975 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:45.763812 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 637/1292] 10.222.0.36 () {56 vars in 1116 bytes} [Mon Jun 27 18:36:45 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:47.765357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1e872-44e7-4f2b-bf4e-ccbcb5bb1c56 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:47.766531 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1e872-44e7-4f2b-bf4e-ccbcb5bb1c56 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:47.766531 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1e872-44e7-4f2b-bf4e-ccbcb5bb1c56 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:47.767863 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 656/1293] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:36:47.773017 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d26c5e-8a36-4890-8cd3-6ad6e819fc77 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:47.773457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d26c5e-8a36-4890-8cd3-6ad6e819fc77 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:47.773674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d26c5e-8a36-4890-8cd3-6ad6e819fc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:47.790119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-f1d26c5e-8a36-4890-8cd3-6ad6e819fc77 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:36:47.791274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-f1d26c5e-8a36-4890-8cd3-6ad6e819fc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:36:47.820661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:47.856981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 638/1294] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:36:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:36:47.880159 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1e872-44e7-4f2b-bf4e-ccbcb5bb1c56 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:47.911480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:47.979093 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1e872-44e7-4f2b-bf4e-ccbcb5bb1c56 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:48.012157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68baae6c-0ccd-444d-9aa0-b8346f576603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:48.012811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baae6c-0ccd-444d-9aa0-b8346f576603 None admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:48.013099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baae6c-0ccd-444d-9aa0-b8346f576603 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:48.013379 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68baae6c-0ccd-444d-9aa0-b8346f576603 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:48.014093 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68baae6c-0ccd-444d-9aa0-b8346f576603 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:48.015461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68baae6c-0ccd-444d-9aa0-b8346f576603 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:48.104459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 657/1295] 10.222.0.36 () {60 vars in 1141 bytes} [Mon Jun 27 18:36:47 2022] POST /identity/v3/services => generated 246 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:36:50.133508 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfe144-f1f4-43c4-a0f1-dbd62c6fb946 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:50.134045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfe144-f1f4-43c4-a0f1-dbd62c6fb946 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:50.134137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfe144-f1f4-43c4-a0f1-dbd62c6fb946 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:50.135542 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 639/1296] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:36:50.140711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd681b-914b-4fd0-95f1-74616a9f675b None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:50.141125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd681b-914b-4fd0-95f1-74616a9f675b None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:50.141884 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd681b-914b-4fd0-95f1-74616a9f675b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:50.158237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-90fd681b-914b-4fd0-95f1-74616a9f675b None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:36:50.159424 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-90fd681b-914b-4fd0-95f1-74616a9f675b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:36:50.230376 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 658/1297] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:36:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:36:50.253775 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfe144-f1f4-43c4-a0f1-dbd62c6fb946 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:50.352811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfe144-f1f4-43c4-a0f1-dbd62c6fb946 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:50.386343 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d9854-11eb-4482-804c-d42614696eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:50.387075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d9854-11eb-4482-804c-d42614696eac None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:50.387394 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d9854-11eb-4482-804c-d42614696eac None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:50.387746 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d9854-11eb-4482-804c-d42614696eac None admin] PATH_INFO: `/v3/services/placement` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:50.388420 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d9854-11eb-4482-804c-d42614696eac None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:50.389803 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d9854-11eb-4482-804c-d42614696eac None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:50.401862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-7f6d9854-11eb-4482-804c-d42614696eac None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 18:36:50.401862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:50.401862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:36:50.401862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:36:50.401862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:36:50.401862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:36:50.401862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:36:50.401862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:36:50.401862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 18:36:50.401862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:50.401862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:36:50.401862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:50.401862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:50.401862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:50.401862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:50.401862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:50.401862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:50.403042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:50.403042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:50.403042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:50.403042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:50.403042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:50.403042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:50.403042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:36:50.403042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:36:50.403042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:36:50.403042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:36:50.403042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:50.403042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:50.403042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:50.403042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:50.403042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:50.403042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:50.404350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:50.404350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:50.404350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:50.404350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:50.404350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:50.404350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:50.404350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:50.404350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:50.404350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:50.404350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:50.404350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:36:50.404350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:36:50.404350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 18:36:50.404350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:50.404350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 640/1298] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jun 27 18:36:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:50.409038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd681b-914b-4fd0-95f1-74616a9f675b None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:50.427486 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:50.505354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd681b-914b-4fd0-95f1-74616a9f675b None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:50.540272 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02457fa-1cf6-42d3-b95b-311ab0f781ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:50.540928 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02457fa-1cf6-42d3-b95b-311ab0f781ee None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:50.541209 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02457fa-1cf6-42d3-b95b-311ab0f781ee None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:50.541484 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02457fa-1cf6-42d3-b95b-311ab0f781ee None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:50.542182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02457fa-1cf6-42d3-b95b-311ab0f781ee None admin] RBAC: Adding query filter params (name=placement) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:50.542488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02457fa-1cf6-42d3-b95b-311ab0f781ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:50.544030 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02457fa-1cf6-42d3-b95b-311ab0f781ee None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:50.549580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 659/1299] 10.222.0.36 () {56 vars in 1116 bytes} [Mon Jun 27 18:36:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:50.555458 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d9854-11eb-4482-804c-d42614696eac None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:50.586698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:50.652245 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d9854-11eb-4482-804c-d42614696eac None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:50.686119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f07fb-37da-468a-9ad3-6c4c554b6201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:50.686865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f07fb-37da-468a-9ad3-6c4c554b6201 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:50.687203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f07fb-37da-468a-9ad3-6c4c554b6201 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:50.687571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f07fb-37da-468a-9ad3-6c4c554b6201 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:50.688470 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f07fb-37da-468a-9ad3-6c4c554b6201 None admin] RBAC: Adding query filter params (interface=public, service_id=ad35d8cdaec0422489cd29d06e635209, region_id=RegionOne) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:50.688795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f07fb-37da-468a-9ad3-6c4c554b6201 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:50.690185 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f07fb-37da-468a-9ad3-6c4c554b6201 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:50.695583 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 641/1300] 10.222.0.36 () {56 vars in 1251 bytes} [Mon Jun 27 18:36:50 2022] GET /identity/v3/endpoints?service_id=ad35d8cdaec0422489cd29d06e635209&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:50.701182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02457fa-1cf6-42d3-b95b-311ab0f781ee None admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:50.782326 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:50.800384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02457fa-1cf6-42d3-b95b-311ab0f781ee None admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:50.832415 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98d114-0107-4c29-b741-09bbc1de70e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:50.833060 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98d114-0107-4c29-b741-09bbc1de70e0 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:50.833343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98d114-0107-4c29-b741-09bbc1de70e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:50.833619 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98d114-0107-4c29-b741-09bbc1de70e0 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:50.834288 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98d114-0107-4c29-b741-09bbc1de70e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:50.835679 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98d114-0107-4c29-b741-09bbc1de70e0 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:50.842402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 660/1301] 10.222.0.36 () {56 vars in 1087 bytes} [Mon Jun 27 18:36:50 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:36:52.855467 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525d384-bb32-4baa-8084-15c39029ed7d None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:52.856107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525d384-bb32-4baa-8084-15c39029ed7d None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:52.856107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525d384-bb32-4baa-8084-15c39029ed7d None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:52.857593 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 642/1302] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:36:52.863221 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54e9ee-dfc5-49a4-a464-bb9cab54b316 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:52.869378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54e9ee-dfc5-49a4-a464-bb9cab54b316 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:52.869378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54e9ee-dfc5-49a4-a464-bb9cab54b316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:52.880337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-db54e9ee-dfc5-49a4-a464-bb9cab54b316 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:36:52.881520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-db54e9ee-dfc5-49a4-a464-bb9cab54b316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:36:52.946423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 661/1303] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:36:52 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 27 18:36:52.969531 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525d384-bb32-4baa-8084-15c39029ed7d None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:53.064108 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:53.070576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525d384-bb32-4baa-8084-15c39029ed7d None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:53.105001 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985f31f-b88c-48d5-b771-1c3da94a7612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:53.105833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985f31f-b88c-48d5-b771-1c3da94a7612 None admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:53.106064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985f31f-b88c-48d5-b771-1c3da94a7612 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:53.106344 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985f31f-b88c-48d5-b771-1c3da94a7612 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:53.106991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985f31f-b88c-48d5-b771-1c3da94a7612 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:53.108443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985f31f-b88c-48d5-b771-1c3da94a7612 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:53.120959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application [None req-7985f31f-b88c-48d5-b771-1c3da94a7612 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 18:36:53.120959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:53.120959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 27 18:36:53.120959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 27 18:36:53.120959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 27 18:36:53.120959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 27 18:36:53.120959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 27 18:36:53.120959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:36:53.120959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 18:36:53.120959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:53.120959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 27 18:36:53.120959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:53.120959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 27 18:36:53.120959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 27 18:36:53.120959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 27 18:36:53.120959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 27 18:36:53.120959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 27 18:36:53.127020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 27 18:36:53.127020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 27 18:36:53.127020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 27 18:36:53.127020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 27 18:36:53.127020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 27 18:36:53.127020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 27 18:36:53.127020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 27 18:36:53.127020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 27 18:36:53.127020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 27 18:36:53.127020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 27 18:36:53.127020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 27 18:36:53.127020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 27 18:36:53.127020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 27 18:36:53.127020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 27 18:36:53.127020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 27 18:36:53.127020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.get_or_create( Jun 27 18:36:53.131019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 27 18:36:53.131019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application with Lock( Jun 27 18:36:53.131019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 27 18:36:53.131019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self._enter() Jun 27 18:36:53.131019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 27 18:36:53.131019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 27 18:36:53.131019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 27 18:36:53.131019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application return self.creator() Jun 27 18:36:53.131019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 27 18:36:53.131019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application created_value = creator( Jun 27 18:36:53.131019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 27 18:36:53.131019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 27 18:36:53.131019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 27 18:36:53.131019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: ERROR keystone.server.flask.application Jun 27 18:36:53.131019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 643/1304] 10.222.0.36 () {56 vars in 1117 bytes} [Mon Jun 27 18:36:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 27 18:36:53.132043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54e9ee-dfc5-49a4-a464-bb9cab54b316 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:53.202209 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:36:53.225045 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54e9ee-dfc5-49a4-a464-bb9cab54b316 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:53.258244 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dad7de-403a-42d7-b5d7-daeb8da7d099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:53.258900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dad7de-403a-42d7-b5d7-daeb8da7d099 None admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:53.259186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dad7de-403a-42d7-b5d7-daeb8da7d099 None admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:53.259462 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dad7de-403a-42d7-b5d7-daeb8da7d099 None admin] PATH_INFO: `/v3/services` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:53.260203 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dad7de-403a-42d7-b5d7-daeb8da7d099 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:36:53.260511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dad7de-403a-42d7-b5d7-daeb8da7d099 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:53.261887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dad7de-403a-42d7-b5d7-daeb8da7d099 None admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:53.266910 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 662/1305] 10.222.0.36 () {56 vars in 1116 bytes} [Mon Jun 27 18:36:53 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:36:53.272684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985f31f-b88c-48d5-b771-1c3da94a7612 None admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:36:53.371487 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985f31f-b88c-48d5-b771-1c3da94a7612 None admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:36:53.404118 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf6ebc-f221-4650-848d-a91589864153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:36:53.404781 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf6ebc-f221-4650-848d-a91589864153 None admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:36:53.405082 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf6ebc-f221-4650-848d-a91589864153 None admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:36:53.405359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf6ebc-f221-4650-848d-a91589864153 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:36:53.406687 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf6ebc-f221-4650-848d-a91589864153 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:36:53.408120 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf6ebc-f221-4650-848d-a91589864153 None admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:36:53.481426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 644/1306] 10.222.0.36 () {60 vars in 1144 bytes} [Mon Jun 27 18:36:53 2022] POST /identity/v3/endpoints => generated 331 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:37:03.263916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=30 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:37:03.476732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:33.884029 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d6014-e8b2-40de-bdfd-305e77c86401 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:33.885158 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d6014-e8b2-40de-bdfd-305e77c86401 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:33.885660 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d6014-e8b2-40de-bdfd-305e77c86401 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:33.887249 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 663/1307] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:42:33.892726 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e70b2-ff55-404e-8a16-0131f45c6ce8 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:33.893545 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e70b2-ff55-404e-8a16-0131f45c6ce8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:33.894046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e70b2-ff55-404e-8a16-0131f45c6ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:34.042225 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-dc8e70b2-ff55-404e-8a16-0131f45c6ce8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:42:34.048959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-dc8e70b2-ff55-404e-8a16-0131f45c6ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:34.287377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 645/1308] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:42:34.326218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67d72c-5f93-4695-87e2-7073023eb580 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:34.326645 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67d72c-5f93-4695-87e2-7073023eb580 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:34.333455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67d72c-5f93-4695-87e2-7073023eb580 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:34.333455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 664/1309] 10.222.0.36 () {54 vars in 964 bytes} [Mon Jun 27 18:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:42:34.336795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0df356-ee61-44de-96a5-eac6c0c53600 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:34.337218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0df356-ee61-44de-96a5-eac6c0c53600 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:34.337596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0df356-ee61-44de-96a5-eac6c0c53600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:34.437992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-1e0df356-ee61-44de-96a5-eac6c0c53600 None None] MFA Rules not processed for user `1e684ee875464138abc4e89060902100`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:42:34.439293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-1e0df356-ee61-44de-96a5-eac6c0c53600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:34.462282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:34.523663 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 646/1310] 10.222.0.36 () {58 vars in 1061 bytes} [Mon Jun 27 18:42:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:42:34.533801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67d72c-5f93-4695-87e2-7073023eb580 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:42:34.536035 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ae67d72c-5f93-4695-87e2-7073023eb580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:34.667018 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67d72c-5f93-4695-87e2-7073023eb580 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:42:34.749585 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b877b9c-90e1-4505-95f6-3d2dfc0abc51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:42:34.750654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877b9c-90e1-4505-95f6-3d2dfc0abc51 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:34.751149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877b9c-90e1-4505-95f6-3d2dfc0abc51 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:34.751836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877b9c-90e1-4505-95f6-3d2dfc0abc51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:34.753970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9b877b9c-90e1-4505-95f6-3d2dfc0abc51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:34.813668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:34.876317 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b877b9c-90e1-4505-95f6-3d2dfc0abc51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:42:34.878182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b877b9c-90e1-4505-95f6-3d2dfc0abc51 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:42:34.901420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 665/1311] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:42:37.282580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111e7ba-c367-4d77-b59a-2828288a8519 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:37.283121 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111e7ba-c367-4d77-b59a-2828288a8519 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:37.283238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5111e7ba-c367-4d77-b59a-2828288a8519 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:37.284554 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 647/1312] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:42:37.289906 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef588769-4dd6-42be-a80a-4c1eb935cae8 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:37.290321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef588769-4dd6-42be-a80a-4c1eb935cae8 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:37.290585 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef588769-4dd6-42be-a80a-4c1eb935cae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:37.360508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-ef588769-4dd6-42be-a80a-4c1eb935cae8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:42:37.361743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ef588769-4dd6-42be-a80a-4c1eb935cae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:37.466317 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 666/1313] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:42:37.505149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111e7ba-c367-4d77-b59a-2828288a8519 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:42:37.506707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5111e7ba-c367-4d77-b59a-2828288a8519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:37.610262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5111e7ba-c367-4d77-b59a-2828288a8519 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:42:37.683678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:37.686232 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96559017-f4df-4fc6-8f08-194cc1253450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:42:37.686885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96559017-f4df-4fc6-8f08-194cc1253450 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:37.687803 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96559017-f4df-4fc6-8f08-194cc1253450 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:37.688088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96559017-f4df-4fc6-8f08-194cc1253450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:37.689791 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-96559017-f4df-4fc6-8f08-194cc1253450 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:37.798836 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96559017-f4df-4fc6-8f08-194cc1253450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:42:37.800318 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96559017-f4df-4fc6-8f08-194cc1253450 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:42:37.819611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 648/1314] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:42:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:42:40.350962 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8afb01-3cc2-48c4-9a34-1e06ccbdda32 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:40.351636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8afb01-3cc2-48c4-9a34-1e06ccbdda32 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:40.351636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8afb01-3cc2-48c4-9a34-1e06ccbdda32 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:40.352926 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 667/1315] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:42:40.358014 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d85931-4729-4bb9-b0ff-f912d9d0b6e4 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:40.358412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d85931-4729-4bb9-b0ff-f912d9d0b6e4 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:40.358618 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d85931-4729-4bb9-b0ff-f912d9d0b6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:40.421873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-a5d85931-4729-4bb9-b0ff-f912d9d0b6e4 None None] MFA Rules not processed for user `fdc3b2b9c8654f7383bb4032c4f52f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:42:40.423081 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-a5d85931-4729-4bb9-b0ff-f912d9d0b6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:40.474623 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:40.519572 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 649/1316] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:42:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:42:40.558541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8afb01-3cc2-48c4-9a34-1e06ccbdda32 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:42:40.560105 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-0f8afb01-3cc2-48c4-9a34-1e06ccbdda32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:40.570374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:40.662183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8afb01-3cc2-48c4-9a34-1e06ccbdda32 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:42:40.732366 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f06f81e-d5ba-4c82-94c9-7bb52443404d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:42:40.733010 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06f81e-d5ba-4c82-94c9-7bb52443404d service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:40.733290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06f81e-d5ba-4c82-94c9-7bb52443404d service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:40.733564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f06f81e-d5ba-4c82-94c9-7bb52443404d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:40.735759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-1f06f81e-d5ba-4c82-94c9-7bb52443404d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:40.794792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:40.840072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06f81e-d5ba-4c82-94c9-7bb52443404d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:42:40.841498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f06f81e-d5ba-4c82-94c9-7bb52443404d service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:42:40.859580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 668/1317] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:42:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:42:43.576605 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e85a4-0390-486f-aa9f-223840ece379 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:43.577149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e85a4-0390-486f-aa9f-223840ece379 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:43.577149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e85a4-0390-486f-aa9f-223840ece379 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:43.578549 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 650/1318] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:42:43.583568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdf123-5a84-47ea-8d07-da43e63a7bc6 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:43.583992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdf123-5a84-47ea-8d07-da43e63a7bc6 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:43.584119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdf123-5a84-47ea-8d07-da43e63a7bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:43.647974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-8efdf123-5a84-47ea-8d07-da43e63a7bc6 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:42:43.649179 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-8efdf123-5a84-47ea-8d07-da43e63a7bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:43.742943 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 669/1319] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:42:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:42:43.781449 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e85a4-0390-486f-aa9f-223840ece379 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:42:43.782912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-1d1e85a4-0390-486f-aa9f-223840ece379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:43.884059 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e85a4-0390-486f-aa9f-223840ece379 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:42:43.954906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c86934c-ae6b-4ab9-ba4e-e19d6c64dfb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:42:43.955565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86934c-ae6b-4ab9-ba4e-e19d6c64dfb3 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:43.955858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86934c-ae6b-4ab9-ba4e-e19d6c64dfb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:43.956137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c86934c-ae6b-4ab9-ba4e-e19d6c64dfb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:43.957754 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0c86934c-ae6b-4ab9-ba4e-e19d6c64dfb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:43.965006 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:44.063689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86934c-ae6b-4ab9-ba4e-e19d6c64dfb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:42:44.065118 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c86934c-ae6b-4ab9-ba4e-e19d6c64dfb3 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:42:44.082510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 651/1320] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:42:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:42:47.064444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6186c6-fa5d-41be-87e2-9fa41fe49b3a None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:47.064985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6186c6-fa5d-41be-87e2-9fa41fe49b3a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:47.065100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6186c6-fa5d-41be-87e2-9fa41fe49b3a None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:47.066434 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 670/1321] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:42:47.071781 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20172f46-5f2e-420d-a83e-db1c36021957 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:47.072168 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20172f46-5f2e-420d-a83e-db1c36021957 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:47.072358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20172f46-5f2e-420d-a83e-db1c36021957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:47.136785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-20172f46-5f2e-420d-a83e-db1c36021957 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:42:47.137977 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-20172f46-5f2e-420d-a83e-db1c36021957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:47.198429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:47.236904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 652/1322] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:42:47.273848 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6186c6-fa5d-41be-87e2-9fa41fe49b3a None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:42:47.275802 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-1a6186c6-fa5d-41be-87e2-9fa41fe49b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:47.297276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:47.388600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6186c6-fa5d-41be-87e2-9fa41fe49b3a None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:42:47.465965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2247e-6743-45f7-9dce-9e2c01dc3eab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:42:47.466618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2247e-6743-45f7-9dce-9e2c01dc3eab service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:47.466906 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2247e-6743-45f7-9dce-9e2c01dc3eab service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:47.467186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2247e-6743-45f7-9dce-9e2c01dc3eab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:47.468954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2cf2247e-6743-45f7-9dce-9e2c01dc3eab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:47.543167 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:47.581260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2247e-6743-45f7-9dce-9e2c01dc3eab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:42:47.582713 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf2247e-6743-45f7-9dce-9e2c01dc3eab service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:42:47.600432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 671/1323] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:42:49.676893 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5361e6-ffd1-41c7-9ceb-ad06275d0404 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:49.677455 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5361e6-ffd1-41c7-9ceb-ad06275d0404 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:49.677546 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5361e6-ffd1-41c7-9ceb-ad06275d0404 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:49.678961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 653/1324] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:42:49.684073 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de00b5a-a1f9-411a-805d-d42f0812b46c None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:49.684484 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de00b5a-a1f9-411a-805d-d42f0812b46c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:49.684627 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de00b5a-a1f9-411a-805d-d42f0812b46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:49.748109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-4de00b5a-a1f9-411a-805d-d42f0812b46c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:42:49.749220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-4de00b5a-a1f9-411a-805d-d42f0812b46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:49.844224 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 672/1325] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:42:49.879524 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5361e6-ffd1-41c7-9ceb-ad06275d0404 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:42:49.881180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-cd5361e6-ffd1-41c7-9ceb-ad06275d0404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:49.984710 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5361e6-ffd1-41c7-9ceb-ad06275d0404 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:42:50.056782 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad332c0-91de-4956-9b86-62b94a046591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:42:50.057344 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad332c0-91de-4956-9b86-62b94a046591 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:50.057627 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad332c0-91de-4956-9b86-62b94a046591 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:50.057899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad332c0-91de-4956-9b86-62b94a046591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:50.059509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-8ad332c0-91de-4956-9b86-62b94a046591 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:50.076422 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:50.171157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad332c0-91de-4956-9b86-62b94a046591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:42:50.172631 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad332c0-91de-4956-9b86-62b94a046591 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:42:50.191447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 654/1326] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:42:52.253218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bed475-8bcb-4efa-bbcb-8b24b118c8c2 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:52.253766 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bed475-8bcb-4efa-bbcb-8b24b118c8c2 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:52.253766 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bed475-8bcb-4efa-bbcb-8b24b118c8c2 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:52.255157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 673/1327] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:42:52.260964 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b45e4-d821-42ea-9b8b-1535c7e43561 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:52.261501 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b45e4-d821-42ea-9b8b-1535c7e43561 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:52.261596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63b45e4-d821-42ea-9b8b-1535c7e43561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:52.325583 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-d63b45e4-d821-42ea-9b8b-1535c7e43561 None None] MFA Rules not processed for user `fdc3b2b9c8654f7383bb4032c4f52f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:42:52.326806 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d63b45e4-d821-42ea-9b8b-1535c7e43561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:52.390693 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:52.423917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 655/1328] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:42:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:42:52.460718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bed475-8bcb-4efa-bbcb-8b24b118c8c2 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:42:52.462261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-d6bed475-8bcb-4efa-bbcb-8b24b118c8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:52.495269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:52.574988 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bed475-8bcb-4efa-bbcb-8b24b118c8c2 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:42:52.647446 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fa5b0-106b-4cf4-a19a-c890e5ae5b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:42:52.648124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fa5b0-106b-4cf4-a19a-c890e5ae5b8a service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:52.648409 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fa5b0-106b-4cf4-a19a-c890e5ae5b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:52.648698 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fa5b0-106b-4cf4-a19a-c890e5ae5b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:52.650333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-867fa5b0-106b-4cf4-a19a-c890e5ae5b8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:52.729499 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:52.761186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fa5b0-106b-4cf4-a19a-c890e5ae5b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:42:52.762619 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fa5b0-106b-4cf4-a19a-c890e5ae5b8a service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:42:52.781157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 674/1329] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:42:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:42:55.233446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b74b88-3f1b-4523-bc89-c0c38059ab45 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:55.233995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b74b88-3f1b-4523-bc89-c0c38059ab45 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:55.233995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b74b88-3f1b-4523-bc89-c0c38059ab45 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:55.235668 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 656/1330] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:42:55.241026 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d033cdf-7e0a-447a-ac61-3675497b9c9c None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:55.241452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d033cdf-7e0a-447a-ac61-3675497b9c9c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:55.241584 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d033cdf-7e0a-447a-ac61-3675497b9c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:55.304223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-6d033cdf-7e0a-447a-ac61-3675497b9c9c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:42:55.305409 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-6d033cdf-7e0a-447a-ac61-3675497b9c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:55.399214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 675/1331] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:42:55.433817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b74b88-3f1b-4523-bc89-c0c38059ab45 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:42:55.435337 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-11b74b88-3f1b-4523-bc89-c0c38059ab45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:55.540906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b74b88-3f1b-4523-bc89-c0c38059ab45 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:42:55.614014 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba815749-2baa-44b1-985a-f0d0e6d906ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:42:55.614686 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba815749-2baa-44b1-985a-f0d0e6d906ec service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:55.614970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba815749-2baa-44b1-985a-f0d0e6d906ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:55.615246 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba815749-2baa-44b1-985a-f0d0e6d906ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:55.616932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ba815749-2baa-44b1-985a-f0d0e6d906ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:55.643335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:55.724305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba815749-2baa-44b1-985a-f0d0e6d906ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:42:55.725752 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba815749-2baa-44b1-985a-f0d0e6d906ec service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:42:55.744157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 657/1332] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:42:57.793537 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717028e-8b56-42f6-8304-a81261e8670a None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:57.793984 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717028e-8b56-42f6-8304-a81261e8670a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:57.794080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f717028e-8b56-42f6-8304-a81261e8670a None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:57.795433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 676/1333] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:42:57.800712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3c913-57da-4564-bdf7-5882a9cc0d17 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:57.801149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3c913-57da-4564-bdf7-5882a9cc0d17 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:57.801256 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3c913-57da-4564-bdf7-5882a9cc0d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:57.864374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-c7c3c913-57da-4564-bdf7-5882a9cc0d17 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:42:57.865620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c7c3c913-57da-4564-bdf7-5882a9cc0d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:57.941787 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:57.963379 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 658/1334] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:42:58.003185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717028e-8b56-42f6-8304-a81261e8670a None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:42:58.004772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f717028e-8b56-42f6-8304-a81261e8670a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:58.044670 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:58.107939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f717028e-8b56-42f6-8304-a81261e8670a None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:42:58.180610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f3c11-3303-4975-b7e7-3dd3bc18205b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:42:58.181250 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f3c11-3303-4975-b7e7-3dd3bc18205b service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:42:58.181534 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f3c11-3303-4975-b7e7-3dd3bc18205b service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:42:58.181811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f3c11-3303-4975-b7e7-3dd3bc18205b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:42:58.183424 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-c20f3c11-3303-4975-b7e7-3dd3bc18205b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:42:58.264187 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:42:58.289138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f3c11-3303-4975-b7e7-3dd3bc18205b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:42:58.290611 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f3c11-3303-4975-b7e7-3dd3bc18205b service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:42:58.309101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 677/1335] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:00.910514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed678-93d1-46fe-bb07-9f8519e9db46 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:00.911051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed678-93d1-46fe-bb07-9f8519e9db46 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:00.911051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed678-93d1-46fe-bb07-9f8519e9db46 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:00.912499 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 659/1336] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:00.917759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0505d-8ffc-407c-9b8e-8bd71aad4a4c None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:00.918177 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0505d-8ffc-407c-9b8e-8bd71aad4a4c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:00.918347 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0505d-8ffc-407c-9b8e-8bd71aad4a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:00.984523 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-bdd0505d-8ffc-407c-9b8e-8bd71aad4a4c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:00.985733 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-bdd0505d-8ffc-407c-9b8e-8bd71aad4a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:01.083779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 678/1337] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:01.121833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ed678-93d1-46fe-bb07-9f8519e9db46 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:01.123362 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3b6ed678-93d1-46fe-bb07-9f8519e9db46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:01.225910 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ed678-93d1-46fe-bb07-9f8519e9db46 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:01.298171 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40773409-b4d9-44f1-9e00-756b742ab635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:01.298811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40773409-b4d9-44f1-9e00-756b742ab635 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:01.299095 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40773409-b4d9-44f1-9e00-756b742ab635 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:01.299371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40773409-b4d9-44f1-9e00-756b742ab635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:01.301053 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-40773409-b4d9-44f1-9e00-756b742ab635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:01.337814 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:43:01.409817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40773409-b4d9-44f1-9e00-756b742ab635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:01.411240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40773409-b4d9-44f1-9e00-756b742ab635 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:01.428743 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 660/1338] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:05.510674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c55e64-499e-4e4a-a7cd-0adbcf6af9de None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:05.515004 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c55e64-499e-4e4a-a7cd-0adbcf6af9de None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:05.515004 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c55e64-499e-4e4a-a7cd-0adbcf6af9de None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:05.515004 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 679/1339] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:05.518601 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004c026-de0c-4ac1-88ec-e48727a192c9 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:05.519046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004c026-de0c-4ac1-88ec-e48727a192c9 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:05.519166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004c026-de0c-4ac1-88ec-e48727a192c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:05.594512 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-d004c026-de0c-4ac1-88ec-e48727a192c9 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:05.595748 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d004c026-de0c-4ac1-88ec-e48727a192c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:05.692856 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:43:05.706746 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 661/1340] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:05.746103 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c55e64-499e-4e4a-a7cd-0adbcf6af9de None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:05.748549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-37c55e64-499e-4e4a-a7cd-0adbcf6af9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:05.804560 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:43:05.853454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c55e64-499e-4e4a-a7cd-0adbcf6af9de None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:05.857082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5039ff-849b-42bf-9449-40e1ce818ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:05.857729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5039ff-849b-42bf-9449-40e1ce818ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:05.858014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5039ff-849b-42bf-9449-40e1ce818ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:05.858324 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5039ff-849b-42bf-9449-40e1ce818ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:05.868060 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5039ff-849b-42bf-9449-40e1ce818ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:05.869496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5039ff-849b-42bf-9449-40e1ce818ae7 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:05.879297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 680/1341] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:08.864630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b7271-16ae-4d7b-be92-5864a2ce8970 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:08.865254 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b7271-16ae-4d7b-be92-5864a2ce8970 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:08.865254 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b7271-16ae-4d7b-be92-5864a2ce8970 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:08.866574 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 662/1342] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:08.872513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ce32d-c564-4046-853a-1ccf3144e86a None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:08.872945 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ce32d-c564-4046-853a-1ccf3144e86a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:08.873067 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ce32d-c564-4046-853a-1ccf3144e86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:08.901570 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-af0ce32d-c564-4046-853a-1ccf3144e86a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:08.902824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-af0ce32d-c564-4046-853a-1ccf3144e86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:08.980559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 681/1343] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:09.019099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b7271-16ae-4d7b-be92-5864a2ce8970 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:09.029942 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b7271-16ae-4d7b-be92-5864a2ce8970 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:09.033463 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b74b84-506a-4c25-b574-0fd36fe17a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:09.034167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b74b84-506a-4c25-b574-0fd36fe17a56 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:09.034511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b74b84-506a-4c25-b574-0fd36fe17a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:09.034791 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b74b84-506a-4c25-b574-0fd36fe17a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:09.043609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b74b84-506a-4c25-b574-0fd36fe17a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:09.045046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b74b84-506a-4c25-b574-0fd36fe17a56 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:09.054723 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 663/1344] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:13.278490 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765f5b6-259b-4cb3-a51a-bbb5d67208de None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:13.279129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765f5b6-259b-4cb3-a51a-bbb5d67208de None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:13.279129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765f5b6-259b-4cb3-a51a-bbb5d67208de None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:13.280472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 682/1345] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:13.285670 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f8c21-540e-4a2d-95bd-e20efe4cab0d None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:13.286115 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f8c21-540e-4a2d-95bd-e20efe4cab0d None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:13.286208 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f8c21-540e-4a2d-95bd-e20efe4cab0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:13.303766 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-344f8c21-540e-4a2d-95bd-e20efe4cab0d None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:13.304966 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-344f8c21-540e-4a2d-95bd-e20efe4cab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:13.313663 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 664/1346] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:13.351668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765f5b6-259b-4cb3-a51a-bbb5d67208de None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:13.363361 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765f5b6-259b-4cb3-a51a-bbb5d67208de None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:13.366904 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631d351-97ce-45f1-8f03-f699f994e397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:13.367568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d351-97ce-45f1-8f03-f699f994e397 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:13.367863 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d351-97ce-45f1-8f03-f699f994e397 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:13.368147 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631d351-97ce-45f1-8f03-f699f994e397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:13.377895 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631d351-97ce-45f1-8f03-f699f994e397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:13.379370 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4631d351-97ce-45f1-8f03-f699f994e397 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:13.388906 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 683/1347] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:18.344997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca725366-4961-4da3-a852-a6bb29a976d4 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:18.345932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca725366-4961-4da3-a852-a6bb29a976d4 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:18.346443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca725366-4961-4da3-a852-a6bb29a976d4 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:18.349215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 665/1348] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jun 27 18:43:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:18.354424 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b230e-a323-483e-bf44-a9eef3b3a26b None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:18.354867 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b230e-a323-483e-bf44-a9eef3b3a26b None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:18.354974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b230e-a323-483e-bf44-a9eef3b3a26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:18.496241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-eb5b230e-a323-483e-bf44-a9eef3b3a26b None None] MFA Rules not processed for user `af6ef16884604753972c916f74271f42`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:18.496241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-eb5b230e-a323-483e-bf44-a9eef3b3a26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:18.534251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:43:18.584937 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 684/1349] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jun 27 18:43:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:22.689821 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d9822-0b76-49a8-b3a2-286b82758ae1 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:22.690360 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d9822-0b76-49a8-b3a2-286b82758ae1 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:22.690899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d9822-0b76-49a8-b3a2-286b82758ae1 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:22.692550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 666/1350] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jun 27 18:43:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:22.697554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c98b79-de18-48f3-8fc7-5b651a8df030 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:22.697955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c98b79-de18-48f3-8fc7-5b651a8df030 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:22.698165 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c98b79-de18-48f3-8fc7-5b651a8df030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:22.717457 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-f7c98b79-de18-48f3-8fc7-5b651a8df030 None None] MFA Rules not processed for user `af6ef16884604753972c916f74271f42`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:22.718732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f7c98b79-de18-48f3-8fc7-5b651a8df030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:22.727439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 685/1351] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jun 27 18:43:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:23.298729 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=13 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:43:24.324296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4fe4a-660c-4557-b65f-d63eef58f612 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:24.324944 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4fe4a-660c-4557-b65f-d63eef58f612 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:24.324944 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4fe4a-660c-4557-b65f-d63eef58f612 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:24.326175 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 667/1352] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jun 27 18:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:24.331960 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc32125-7866-48cf-b53b-ebf56516fa9e None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:24.332371 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc32125-7866-48cf-b53b-ebf56516fa9e None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:24.332647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc32125-7866-48cf-b53b-ebf56516fa9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:24.352016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-4dc32125-7866-48cf-b53b-ebf56516fa9e None None] MFA Rules not processed for user `af6ef16884604753972c916f74271f42`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:24.353229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-4dc32125-7866-48cf-b53b-ebf56516fa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:24.362322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 686/1353] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jun 27 18:43:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:43:27.918654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d843c9c-fea7-406f-9eed-7853afc9ecae None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:27.919644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d843c9c-fea7-406f-9eed-7853afc9ecae None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:27.920150 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d843c9c-fea7-406f-9eed-7853afc9ecae None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:27.922670 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 668/1354] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:27.927933 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4c04a-5bef-4db8-b377-28318515e17c None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:27.928773 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4c04a-5bef-4db8-b377-28318515e17c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:27.929258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4c04a-5bef-4db8-b377-28318515e17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:27.952872 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-76b4c04a-5bef-4db8-b377-28318515e17c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:27.954095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-76b4c04a-5bef-4db8-b377-28318515e17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:27.962132 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 687/1355] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:28.019704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb1de2-ae97-4748-a2d3-b6cb11e1e505 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:28.020213 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb1de2-ae97-4748-a2d3-b6cb11e1e505 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:28.020591 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb1de2-ae97-4748-a2d3-b6cb11e1e505 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:28.022153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 669/1356] 10.222.0.36 () {54 vars in 961 bytes} [Mon Jun 27 18:43:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:28.029196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41205bc9-afec-48ee-80a1-0e1e90ee8fb1 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:28.029587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41205bc9-afec-48ee-80a1-0e1e90ee8fb1 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:28.029962 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41205bc9-afec-48ee-80a1-0e1e90ee8fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:28.081038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-41205bc9-afec-48ee-80a1-0e1e90ee8fb1 None None] MFA Rules not processed for user `da1746d29f9e4e8b8626ad4b11931cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:28.082235 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-41205bc9-afec-48ee-80a1-0e1e90ee8fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:28.170851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 688/1357] 10.222.0.36 () {58 vars in 1058 bytes} [Mon Jun 27 18:43:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:28.179748 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb1de2-ae97-4748-a2d3-b6cb11e1e505 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:28.196083 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb1de2-ae97-4748-a2d3-b6cb11e1e505 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:28.202350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb485b8c-4f3f-42eb-bc8a-f6484c072e2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:28.202991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb485b8c-4f3f-42eb-bc8a-f6484c072e2e service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:28.203276 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb485b8c-4f3f-42eb-bc8a-f6484c072e2e service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:28.203591 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb485b8c-4f3f-42eb-bc8a-f6484c072e2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:28.213049 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb485b8c-4f3f-42eb-bc8a-f6484c072e2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:28.215256 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb485b8c-4f3f-42eb-bc8a-f6484c072e2e service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:28.225367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 670/1358] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:30.448863 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584524eb-5015-449d-b1a6-e9d51504a5b2 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:30.449350 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584524eb-5015-449d-b1a6-e9d51504a5b2 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:30.449452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584524eb-5015-449d-b1a6-e9d51504a5b2 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:30.452316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 689/1359] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:30.456597 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af36f2-1398-405c-a505-b6ca988f37fe None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:30.457018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af36f2-1398-405c-a505-b6ca988f37fe None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:30.457152 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af36f2-1398-405c-a505-b6ca988f37fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:30.475484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-61af36f2-1398-405c-a505-b6ca988f37fe None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:30.476801 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-61af36f2-1398-405c-a505-b6ca988f37fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:30.484955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 671/1360] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:30.531133 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584524eb-5015-449d-b1a6-e9d51504a5b2 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:30.547229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584524eb-5015-449d-b1a6-e9d51504a5b2 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:30.553297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1558ae6-9c2a-414e-91b1-c66fc6d6aac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:30.553941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1558ae6-9c2a-414e-91b1-c66fc6d6aac9 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:30.554224 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1558ae6-9c2a-414e-91b1-c66fc6d6aac9 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:30.554502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1558ae6-9c2a-414e-91b1-c66fc6d6aac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:30.563908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1558ae6-9c2a-414e-91b1-c66fc6d6aac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:30.566157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1558ae6-9c2a-414e-91b1-c66fc6d6aac9 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:30.577896 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 690/1361] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:33.075219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604868d6-f9af-4a2f-a86d-f904be9a818a None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:33.075755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604868d6-f9af-4a2f-a86d-f904be9a818a None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:33.075851 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604868d6-f9af-4a2f-a86d-f904be9a818a None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:33.077823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 672/1362] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:43:33.083158 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3af37-678d-44e5-b040-dd8a5a168ca3 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:33.083570 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3af37-678d-44e5-b040-dd8a5a168ca3 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:33.083753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3af37-678d-44e5-b040-dd8a5a168ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:33.102033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-f1c3af37-678d-44e5-b040-dd8a5a168ca3 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:33.103220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f1c3af37-678d-44e5-b040-dd8a5a168ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:33.112459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 691/1363] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:33.158734 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b18638-8057-49b7-a673-12537222e014 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:33.159100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b18638-8057-49b7-a673-12537222e014 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:33.159383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b18638-8057-49b7-a673-12537222e014 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:33.160779 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 673/1364] 10.222.0.36 () {54 vars in 961 bytes} [Mon Jun 27 18:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:33.166079 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18669c87-25a4-4526-ab04-973550899f03 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:33.166362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18669c87-25a4-4526-ab04-973550899f03 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:33.166636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18669c87-25a4-4526-ab04-973550899f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:33.185333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-18669c87-25a4-4526-ab04-973550899f03 None None] MFA Rules not processed for user `da1746d29f9e4e8b8626ad4b11931cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:33.186755 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-18669c87-25a4-4526-ab04-973550899f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:33.195958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 692/1365] 10.222.0.36 () {58 vars in 1058 bytes} [Mon Jun 27 18:43:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:43:33.203853 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b18638-8057-49b7-a673-12537222e014 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:33.218611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b18638-8057-49b7-a673-12537222e014 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:33.223983 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475cf324-33b4-4775-bdcf-ca0ba2115be9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:33.224679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf324-33b4-4775-bdcf-ca0ba2115be9 service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:33.225029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf324-33b4-4775-bdcf-ca0ba2115be9 service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:33.225313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475cf324-33b4-4775-bdcf-ca0ba2115be9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:33.233837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cf324-33b4-4775-bdcf-ca0ba2115be9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:33.235710 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475cf324-33b4-4775-bdcf-ca0ba2115be9 service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:33.244956 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 674/1366] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:35.459512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67225b3b-23a4-44ce-b7ff-a4afedf05b45 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:35.460077 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67225b3b-23a4-44ce-b7ff-a4afedf05b45 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:35.460077 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67225b3b-23a4-44ce-b7ff-a4afedf05b45 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:35.461748 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 693/1367] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:35.467272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974bc68-db76-4bbe-963d-38715177ccee None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:35.467757 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974bc68-db76-4bbe-963d-38715177ccee None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:35.467971 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974bc68-db76-4bbe-963d-38715177ccee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:35.487015 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-9974bc68-db76-4bbe-963d-38715177ccee None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:35.488256 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-9974bc68-db76-4bbe-963d-38715177ccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:35.497249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 675/1368] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:35.541798 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67225b3b-23a4-44ce-b7ff-a4afedf05b45 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:35.556712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67225b3b-23a4-44ce-b7ff-a4afedf05b45 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:35.562852 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df24ec06-70bd-4fba-abfc-a1c5c3820c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:35.563516 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24ec06-70bd-4fba-abfc-a1c5c3820c5a service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:35.563940 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24ec06-70bd-4fba-abfc-a1c5c3820c5a service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:35.564222 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df24ec06-70bd-4fba-abfc-a1c5c3820c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:35.573091 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24ec06-70bd-4fba-abfc-a1c5c3820c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:35.574743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df24ec06-70bd-4fba-abfc-a1c5c3820c5a service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:35.585345 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 694/1369] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:36.032108 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c5f9d-07df-4837-bb81-f8f5ff6df274 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:36.032673 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c5f9d-07df-4837-bb81-f8f5ff6df274 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:36.032957 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c5f9d-07df-4837-bb81-f8f5ff6df274 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:36.034506 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 676/1370] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:36.039971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050fce-3b75-4d89-9093-7bb27fad3649 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:36.040367 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050fce-3b75-4d89-9093-7bb27fad3649 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:36.040746 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050fce-3b75-4d89-9093-7bb27fad3649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:36.059065 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-27050fce-3b75-4d89-9093-7bb27fad3649 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:36.060432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-27050fce-3b75-4d89-9093-7bb27fad3649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:36.071586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 695/1371] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:43:36.418268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acfe46-6d43-477f-8a61-7f3bba9dbfb8 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:36.418268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acfe46-6d43-477f-8a61-7f3bba9dbfb8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:36.418268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acfe46-6d43-477f-8a61-7f3bba9dbfb8 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:36.418268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 677/1372] 10.222.0.36 () {54 vars in 963 bytes} [Mon Jun 27 18:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:36.425587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feac41c-9af5-48b5-ada9-038526ab9406 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:36.425893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feac41c-9af5-48b5-ada9-038526ab9406 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:36.426165 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feac41c-9af5-48b5-ada9-038526ab9406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:36.433823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:43:36.482335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-6feac41c-9af5-48b5-ada9-038526ab9406 None None] MFA Rules not processed for user `f7ccc6b9aeef498a93030b48306fe402`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:36.484485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-6feac41c-9af5-48b5-ada9-038526ab9406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:36.556816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 696/1373] 10.222.0.36 () {58 vars in 1060 bytes} [Mon Jun 27 18:43:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:36.565370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acfe46-6d43-477f-8a61-7f3bba9dbfb8 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:36.576672 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acfe46-6d43-477f-8a61-7f3bba9dbfb8 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:36.580794 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb7a02-2a02-4920-846a-25892e28eac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:36.581538 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb7a02-2a02-4920-846a-25892e28eac5 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:36.581901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb7a02-2a02-4920-846a-25892e28eac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:36.582257 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb7a02-2a02-4920-846a-25892e28eac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:36.591804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb7a02-2a02-4920-846a-25892e28eac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:36.593444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb7a02-2a02-4920-846a-25892e28eac5 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:36.603448 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 678/1374] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:37.742393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a6d6d-9b3b-4c7c-a4aa-38bf8383a8e6 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:37.742915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a6d6d-9b3b-4c7c-a4aa-38bf8383a8e6 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:37.742915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a6d6d-9b3b-4c7c-a4aa-38bf8383a8e6 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:37.744335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 697/1375] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:37.750188 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecd2ae-87f3-483b-84a9-a3b0686bbd8c None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:37.750621 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecd2ae-87f3-483b-84a9-a3b0686bbd8c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:37.750744 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecd2ae-87f3-483b-84a9-a3b0686bbd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:37.768770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-ccecd2ae-87f3-483b-84a9-a3b0686bbd8c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:37.769974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ccecd2ae-87f3-483b-84a9-a3b0686bbd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:37.777804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 679/1376] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:37.820674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a6d6d-9b3b-4c7c-a4aa-38bf8383a8e6 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:37.835351 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a6d6d-9b3b-4c7c-a4aa-38bf8383a8e6 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:37.840688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf928f0b-81a3-4f62-9393-956634462799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:37.841313 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928f0b-81a3-4f62-9393-956634462799 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:37.841598 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928f0b-81a3-4f62-9393-956634462799 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:37.841870 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928f0b-81a3-4f62-9393-956634462799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:37.849966 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf928f0b-81a3-4f62-9393-956634462799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:37.851520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf928f0b-81a3-4f62-9393-956634462799 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:37.860936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 698/1377] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:40.068907 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d29c65-c020-4ecd-b910-b83da4a87cda None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:40.069419 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d29c65-c020-4ecd-b910-b83da4a87cda None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:40.069518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d29c65-c020-4ecd-b910-b83da4a87cda None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:40.071107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 680/1378] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:40.076239 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9053493-2d76-484c-a888-bacc05dc2256 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:40.076634 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9053493-2d76-484c-a888-bacc05dc2256 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:40.077290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9053493-2d76-484c-a888-bacc05dc2256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:40.099815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-c9053493-2d76-484c-a888-bacc05dc2256 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:40.104343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-c9053493-2d76-484c-a888-bacc05dc2256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:40.115340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 699/1379] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:40.164387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d29c65-c020-4ecd-b910-b83da4a87cda None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:40.186231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d29c65-c020-4ecd-b910-b83da4a87cda None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:40.192488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032b61b-aeb7-41e3-a84a-6977c7055211 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:40.193308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032b61b-aeb7-41e3-a84a-6977c7055211 service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:40.193771 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032b61b-aeb7-41e3-a84a-6977c7055211 service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:40.194216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032b61b-aeb7-41e3-a84a-6977c7055211 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:40.204382 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032b61b-aeb7-41e3-a84a-6977c7055211 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:40.206346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032b61b-aeb7-41e3-a84a-6977c7055211 service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:40.218579 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 681/1380] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:42.521554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd564ead-5add-46e4-91ff-e902a365ed83 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:42.522070 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd564ead-5add-46e4-91ff-e902a365ed83 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:42.522177 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd564ead-5add-46e4-91ff-e902a365ed83 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:42.527045 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 700/1381] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:42.528697 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596d72-23b9-4bb4-94a3-c3582c17491a None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:42.529164 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596d72-23b9-4bb4-94a3-c3582c17491a None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:42.530308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36596d72-23b9-4bb4-94a3-c3582c17491a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:42.548374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-36596d72-23b9-4bb4-94a3-c3582c17491a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:42.549817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-36596d72-23b9-4bb4-94a3-c3582c17491a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:42.557630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 682/1382] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:42.603524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd564ead-5add-46e4-91ff-e902a365ed83 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:42.618844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd564ead-5add-46e4-91ff-e902a365ed83 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:42.624600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a6dbf-6d77-4bb8-aae5-f00346fb9dfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:42.625311 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a6dbf-6d77-4bb8-aae5-f00346fb9dfd service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:42.625666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a6dbf-6d77-4bb8-aae5-f00346fb9dfd service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:42.626010 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a6dbf-6d77-4bb8-aae5-f00346fb9dfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:42.634851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a6dbf-6d77-4bb8-aae5-f00346fb9dfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:42.636663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a6dbf-6d77-4bb8-aae5-f00346fb9dfd service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:42.647034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 701/1383] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:44.686625 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1574bc9-e070-46f1-a987-8770003a9bca None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:44.687186 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1574bc9-e070-46f1-a987-8770003a9bca None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:44.687186 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1574bc9-e070-46f1-a987-8770003a9bca None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:44.688582 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 683/1384] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:44.693735 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036257c-caa2-4337-a262-4ecfa270f40d None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:44.694331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036257c-caa2-4337-a262-4ecfa270f40d None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:44.694331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036257c-caa2-4337-a262-4ecfa270f40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:44.713635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-d036257c-caa2-4337-a262-4ecfa270f40d None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:44.714780 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-d036257c-caa2-4337-a262-4ecfa270f40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:44.723493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 702/1385] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:44.767684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1574bc9-e070-46f1-a987-8770003a9bca None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:44.785999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1574bc9-e070-46f1-a987-8770003a9bca None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:44.794512 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273801e2-31ef-421b-be8f-ab5237af5eb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:44.795602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273801e2-31ef-421b-be8f-ab5237af5eb1 service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:44.796127 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273801e2-31ef-421b-be8f-ab5237af5eb1 service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:44.796539 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273801e2-31ef-421b-be8f-ab5237af5eb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:44.809815 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273801e2-31ef-421b-be8f-ab5237af5eb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:44.813040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273801e2-31ef-421b-be8f-ab5237af5eb1 service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:44.827865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 684/1386] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:46.957589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979103e-94ed-4bb2-9369-f375e4c9219d None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:46.958203 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979103e-94ed-4bb2-9369-f375e4c9219d None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:46.958771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9979103e-94ed-4bb2-9369-f375e4c9219d None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:46.960737 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 703/1387] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:46.967762 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cee45-2467-4f3b-b4ec-35b5436237f2 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:46.968325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cee45-2467-4f3b-b4ec-35b5436237f2 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:46.968325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cee45-2467-4f3b-b4ec-35b5436237f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:46.986644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-0f9cee45-2467-4f3b-b4ec-35b5436237f2 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:46.987947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0f9cee45-2467-4f3b-b4ec-35b5436237f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:46.996172 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 685/1388] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:47.041753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979103e-94ed-4bb2-9369-f375e4c9219d None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:47.056734 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9979103e-94ed-4bb2-9369-f375e4c9219d None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:47.062920 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d4665-ad17-4eed-93d7-c3fa14607f7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:47.063582 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4665-ad17-4eed-93d7-c3fa14607f7b service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:47.063875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4665-ad17-4eed-93d7-c3fa14607f7b service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:47.064155 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d4665-ad17-4eed-93d7-c3fa14607f7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:47.072399 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d4665-ad17-4eed-93d7-c3fa14607f7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:47.074002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d4665-ad17-4eed-93d7-c3fa14607f7b service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:47.084577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 704/1389] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:49.269801 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825b85e-b9d0-4cc3-aa4e-fc5b34a2e195 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:49.270351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825b85e-b9d0-4cc3-aa4e-fc5b34a2e195 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:49.270351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825b85e-b9d0-4cc3-aa4e-fc5b34a2e195 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:49.271924 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 686/1390] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:49.277307 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62245c-52e8-4ff9-a261-e2464104dd4e None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:49.277828 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62245c-52e8-4ff9-a261-e2464104dd4e None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:49.278049 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62245c-52e8-4ff9-a261-e2464104dd4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:49.295931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-9d62245c-52e8-4ff9-a261-e2464104dd4e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:49.297096 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9d62245c-52e8-4ff9-a261-e2464104dd4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:49.305047 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 705/1391] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:49.350444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825b85e-b9d0-4cc3-aa4e-fc5b34a2e195 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:49.366052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825b85e-b9d0-4cc3-aa4e-fc5b34a2e195 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:49.371672 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f140b6b-f6b8-4781-b6ab-501bb9fa4383 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:49.372314 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f140b6b-f6b8-4781-b6ab-501bb9fa4383 service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:49.373292 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f140b6b-f6b8-4781-b6ab-501bb9fa4383 service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:49.373584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f140b6b-f6b8-4781-b6ab-501bb9fa4383 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:49.382106 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f140b6b-f6b8-4781-b6ab-501bb9fa4383 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:49.383771 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f140b6b-f6b8-4781-b6ab-501bb9fa4383 service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:49.393562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 687/1392] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:51.557980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66107c9-cd8a-4879-8bb0-878b6fe2cc7e None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:51.558513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66107c9-cd8a-4879-8bb0-878b6fe2cc7e None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:51.558513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66107c9-cd8a-4879-8bb0-878b6fe2cc7e None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:51.559928 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 706/1393] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:51.565337 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5a9ea-51d4-4df6-814a-86e1e91e2e95 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:51.565781 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5a9ea-51d4-4df6-814a-86e1e91e2e95 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:51.565902 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5a9ea-51d4-4df6-814a-86e1e91e2e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:51.584671 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-71a5a9ea-51d4-4df6-814a-86e1e91e2e95 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:51.585856 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-71a5a9ea-51d4-4df6-814a-86e1e91e2e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:51.594223 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 688/1394] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:51.637858 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66107c9-cd8a-4879-8bb0-878b6fe2cc7e None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:51.652343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66107c9-cd8a-4879-8bb0-878b6fe2cc7e None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:51.658169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b255f3-037f-48d1-845f-239943e24f86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:51.658807 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b255f3-037f-48d1-845f-239943e24f86 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:51.659087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b255f3-037f-48d1-845f-239943e24f86 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:51.659357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b255f3-037f-48d1-845f-239943e24f86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:51.667397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b255f3-037f-48d1-845f-239943e24f86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:51.668993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b255f3-037f-48d1-845f-239943e24f86 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:51.678156 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 707/1395] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:51.964344 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6107550-9c08-4412-a187-534a9dbbcb79 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:51.964662 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6107550-9c08-4412-a187-534a9dbbcb79 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:51.964945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6107550-9c08-4412-a187-534a9dbbcb79 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:51.966352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 689/1396] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:51.972104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf35732-fb7a-417a-9153-5bf909b9ce6c None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:51.972391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf35732-fb7a-417a-9153-5bf909b9ce6c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:51.972669 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf35732-fb7a-417a-9153-5bf909b9ce6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:51.991135 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-ecf35732-fb7a-417a-9153-5bf909b9ce6c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:51.992394 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ecf35732-fb7a-417a-9153-5bf909b9ce6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:52.000856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 708/1397] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:52.056590 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7960faa-f27a-4059-8742-1241fe861108 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:52.056825 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7960faa-f27a-4059-8742-1241fe861108 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:52.057157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7960faa-f27a-4059-8742-1241fe861108 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:52.058550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 690/1398] 10.222.0.36 () {54 vars in 962 bytes} [Mon Jun 27 18:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:52.064140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4d508-1293-4af9-b0dc-9624b5d9d8bb None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:52.064434 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4d508-1293-4af9-b0dc-9624b5d9d8bb None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:52.064711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4d508-1293-4af9-b0dc-9624b5d9d8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:52.123459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-77d4d508-1293-4af9-b0dc-9624b5d9d8bb None None] MFA Rules not processed for user `4e59193e90e240f6b9876d0455eea355`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:52.124675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-77d4d508-1293-4af9-b0dc-9624b5d9d8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:52.157660 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:43:52.186149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 709/1399] 10.222.0.36 () {58 vars in 1059 bytes} [Mon Jun 27 18:43:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:43:52.193962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7960faa-f27a-4059-8742-1241fe861108 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:52.204425 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7960faa-f27a-4059-8742-1241fe861108 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:52.208222 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca486f-026f-46e4-af4d-d9f659140e74 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e59193e90e240f6b9876d0455eea355', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:52.208851 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca486f-026f-46e4-af4d-d9f659140e74 service glance] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:52.209131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca486f-026f-46e4-af4d-d9f659140e74 service glance] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:52.209402 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca486f-026f-46e4-af4d-d9f659140e74 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:52.218429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca486f-026f-46e4-af4d-d9f659140e74 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:52.219905 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca486f-026f-46e4-af4d-d9f659140e74 service glance] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:52.229527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 691/1400] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:43:53.072849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0fb2f-4492-4f6a-8fb5-a5802423fa03 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:53.075758 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0fb2f-4492-4f6a-8fb5-a5802423fa03 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:53.075758 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0fb2f-4492-4f6a-8fb5-a5802423fa03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:53.120207 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-20b0fb2f-4492-4f6a-8fb5-a5802423fa03 None None] MFA Rules not processed for user `6e6313c444eb4a788b6559eff17959f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:53.121388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-20b0fb2f-4492-4f6a-8fb5-a5802423fa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:53.190847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 710/1401] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jun 27 18:43:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:53.234707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd73583-7e00-415c-be7a-beb4741d1682 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:53.235200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd73583-7e00-415c-be7a-beb4741d1682 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:53.235299 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd73583-7e00-415c-be7a-beb4741d1682 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:53.236767 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 692/1402] 10.222.0.36 () {54 vars in 942 bytes} [Mon Jun 27 18:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:53.242895 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7101776-8cbf-408f-889d-d32e8ad2de94 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:53.243191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7101776-8cbf-408f-889d-d32e8ad2de94 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:53.243465 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7101776-8cbf-408f-889d-d32e8ad2de94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:53.293130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-a7101776-8cbf-408f-889d-d32e8ad2de94 None None] MFA Rules not processed for user `94555ff897d94c90968c470d82ff9e2a`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:53.294389 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a7101776-8cbf-408f-889d-d32e8ad2de94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:53.366230 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 711/1403] 10.222.0.36 () {58 vars in 1039 bytes} [Mon Jun 27 18:43:53 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:43:53.375809 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd73583-7e00-415c-be7a-beb4741d1682 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:53.383248 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=61 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:43:53.389895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd73583-7e00-415c-be7a-beb4741d1682 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:53.394782 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f134268-b547-47a4-808e-aab171b4cdba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94555ff897d94c90968c470d82ff9e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:53.395410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f134268-b547-47a4-808e-aab171b4cdba service swift] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:53.395803 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f134268-b547-47a4-808e-aab171b4cdba service swift] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:53.396118 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f134268-b547-47a4-808e-aab171b4cdba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:53.404646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f134268-b547-47a4-808e-aab171b4cdba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:53.406239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f134268-b547-47a4-808e-aab171b4cdba service swift] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:53.414344 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 693/1404] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jun 27 18:43:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 18:43:53.890527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eccd6-1513-4179-8aab-c43facc5ce03 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:53.890813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eccd6-1513-4179-8aab-c43facc5ce03 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:53.891093 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307eccd6-1513-4179-8aab-c43facc5ce03 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:53.892500 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 712/1405] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:43:53.897784 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84273479-98f9-4f50-b8c9-d369ca735128 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:53.898075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84273479-98f9-4f50-b8c9-d369ca735128 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:53.898356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84273479-98f9-4f50-b8c9-d369ca735128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:53.919449 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-84273479-98f9-4f50-b8c9-d369ca735128 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:43:53.920709 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-84273479-98f9-4f50-b8c9-d369ca735128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:43:53.928830 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 694/1406] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:43:53.974079 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eccd6-1513-4179-8aab-c43facc5ce03 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:43:53.993330 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307eccd6-1513-4179-8aab-c43facc5ce03 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:43:53.999350 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652db7d-42b0-43c0-ba25-b353d8e2707e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:43:54.000020 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652db7d-42b0-43c0-ba25-b353d8e2707e service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:43:54.000308 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652db7d-42b0-43c0-ba25-b353d8e2707e service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:43:54.000589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652db7d-42b0-43c0-ba25-b353d8e2707e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:43:54.009126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652db7d-42b0-43c0-ba25-b353d8e2707e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:43:54.010732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652db7d-42b0-43c0-ba25-b353d8e2707e service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:43:54.015690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:43:54.023598 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 713/1407] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:03.913519 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=8 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:44:16.751057 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920081c-0f81-4961-911d-29a5faa4b1e5 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:16.751716 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920081c-0f81-4961-911d-29a5faa4b1e5 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:16.751716 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920081c-0f81-4961-911d-29a5faa4b1e5 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:16.753023 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 695/1408] 10.222.0.36 () {54 vars in 918 bytes} [Mon Jun 27 18:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:16.758144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46013151-bf3d-4fc6-b676-42fa3ea88df3 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:16.758595 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46013151-bf3d-4fc6-b676-42fa3ea88df3 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:16.758705 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46013151-bf3d-4fc6-b676-42fa3ea88df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:16.777760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-46013151-bf3d-4fc6-b676-42fa3ea88df3 None None] MFA Rules not processed for user `af6ef16884604753972c916f74271f42`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:16.778947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-46013151-bf3d-4fc6-b676-42fa3ea88df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:16.787229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 714/1409] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Jun 27 18:44:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:16.800811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5ef4b-7f76-4553-b409-29030a5c0372 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:16.801104 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5ef4b-7f76-4553-b409-29030a5c0372 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:16.801388 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e5ef4b-7f76-4553-b409-29030a5c0372 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:16.802732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 696/1410] 10.222.0.36 () {54 vars in 918 bytes} [Mon Jun 27 18:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:16.807231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041141a-e901-4535-84fd-43be4c8bc14b None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:16.807521 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041141a-e901-4535-84fd-43be4c8bc14b None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:16.807831 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041141a-e901-4535-84fd-43be4c8bc14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:16.826182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-9041141a-e901-4535-84fd-43be4c8bc14b None None] MFA Rules not processed for user `da1746d29f9e4e8b8626ad4b11931cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:16.827367 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9041141a-e901-4535-84fd-43be4c8bc14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:16.836445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 715/1411] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Jun 27 18:44:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:19.315006 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa29900-1024-43b6-9ace-38560505d82a None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:19.315491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa29900-1024-43b6-9ace-38560505d82a None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:19.315659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa29900-1024-43b6-9ace-38560505d82a None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:19.317045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 697/1412] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 18:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:19.322441 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976039e7-53aa-4ceb-af52-0efc797ceb0e None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:19.322872 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976039e7-53aa-4ceb-af52-0efc797ceb0e None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:19.323050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976039e7-53aa-4ceb-af52-0efc797ceb0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:19.341458 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-976039e7-53aa-4ceb-af52-0efc797ceb0e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:19.342726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-976039e7-53aa-4ceb-af52-0efc797ceb0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:19.350531 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 716/1413] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 18:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:19.394307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa29900-1024-43b6-9ace-38560505d82a None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:19.409170 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa29900-1024-43b6-9ace-38560505d82a None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:19.414757 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b64481d-08fc-4247-97cb-31dcb6b6ef23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:19.415392 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64481d-08fc-4247-97cb-31dcb6b6ef23 service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:19.415720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64481d-08fc-4247-97cb-31dcb6b6ef23 service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:19.416003 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b64481d-08fc-4247-97cb-31dcb6b6ef23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:19.424423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64481d-08fc-4247-97cb-31dcb6b6ef23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:19.426046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b64481d-08fc-4247-97cb-31dcb6b6ef23 service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:19.435495 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 698/1414] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:20.327325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db380ce6-89a8-4fc5-a008-90b60f55bb59 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:20.327907 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db380ce6-89a8-4fc5-a008-90b60f55bb59 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:20.327907 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db380ce6-89a8-4fc5-a008-90b60f55bb59 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:20.329298 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 717/1415] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 18:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:20.334066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66262de2-0a5e-465e-8768-ae6adddcb807 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:20.334495 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66262de2-0a5e-465e-8768-ae6adddcb807 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:20.334660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66262de2-0a5e-465e-8768-ae6adddcb807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:20.352689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-66262de2-0a5e-465e-8768-ae6adddcb807 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:20.354402 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-66262de2-0a5e-465e-8768-ae6adddcb807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:20.362832 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 699/1416] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 18:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:20.512639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db380ce6-89a8-4fc5-a008-90b60f55bb59 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:20.527019 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db380ce6-89a8-4fc5-a008-90b60f55bb59 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:20.532975 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb418e-1411-458d-b0c0-8a540b306b05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:20.533613 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb418e-1411-458d-b0c0-8a540b306b05 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:20.533900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb418e-1411-458d-b0c0-8a540b306b05 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:20.534172 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb418e-1411-458d-b0c0-8a540b306b05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:20.542354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb418e-1411-458d-b0c0-8a540b306b05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:20.544534 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb418e-1411-458d-b0c0-8a540b306b05 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:20.553832 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 718/1417] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:21.452868 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8862ae-325a-476f-ae8e-910e9a06aadb None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:21.453445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8862ae-325a-476f-ae8e-910e9a06aadb None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:21.453445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8862ae-325a-476f-ae8e-910e9a06aadb None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:21.454838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 700/1418] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 18:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:21.459821 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d0c40-6bdf-42de-b841-7ae64748470d None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:21.460273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d0c40-6bdf-42de-b841-7ae64748470d None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:21.460382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507d0c40-6bdf-42de-b841-7ae64748470d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:21.478511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-507d0c40-6bdf-42de-b841-7ae64748470d None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:21.479756 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-507d0c40-6bdf-42de-b841-7ae64748470d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:21.487889 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 719/1419] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 18:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:21.637834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8862ae-325a-476f-ae8e-910e9a06aadb None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:21.651863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8862ae-325a-476f-ae8e-910e9a06aadb None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:21.657969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7366d-f79d-4a93-aa9b-f56254ca4306 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:21.658602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7366d-f79d-4a93-aa9b-f56254ca4306 service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:21.658987 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7366d-f79d-4a93-aa9b-f56254ca4306 service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:21.659296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7366d-f79d-4a93-aa9b-f56254ca4306 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:21.667574 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7366d-f79d-4a93-aa9b-f56254ca4306 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:21.669184 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7366d-f79d-4a93-aa9b-f56254ca4306 service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:21.678387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 701/1420] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:22.523454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb386585-5977-4648-a0fe-6b0af04b981a None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:22.524052 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb386585-5977-4648-a0fe-6b0af04b981a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:22.524052 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb386585-5977-4648-a0fe-6b0af04b981a None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:22.525430 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 720/1421] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 18:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:22.533480 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60306-f055-47bc-aec1-8fb81a01f82a None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:22.533902 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60306-f055-47bc-aec1-8fb81a01f82a None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:22.534038 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60306-f055-47bc-aec1-8fb81a01f82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:22.552546 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-3fd60306-f055-47bc-aec1-8fb81a01f82a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:22.553752 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3fd60306-f055-47bc-aec1-8fb81a01f82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:22.561666 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 702/1422] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 18:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:22.712810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb386585-5977-4648-a0fe-6b0af04b981a None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:22.727188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb386585-5977-4648-a0fe-6b0af04b981a None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:22.733140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f10fa-f1d0-4a71-a4bd-456963019fe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:22.734016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f10fa-f1d0-4a71-a4bd-456963019fe8 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:22.734306 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f10fa-f1d0-4a71-a4bd-456963019fe8 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:22.734585 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f10fa-f1d0-4a71-a4bd-456963019fe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:22.742494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f10fa-f1d0-4a71-a4bd-456963019fe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:22.744116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f10fa-f1d0-4a71-a4bd-456963019fe8 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:22.753217 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 721/1423] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:44:23.605501 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa4561-0eb5-487f-927c-537a50502ce5 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:23.606019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa4561-0eb5-487f-927c-537a50502ce5 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:23.606151 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa4561-0eb5-487f-927c-537a50502ce5 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:23.607473 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 703/1424] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 18:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:23.612893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc4923-a8ed-4796-b7fa-70daef095c88 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:23.613308 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc4923-a8ed-4796-b7fa-70daef095c88 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:23.613451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc4923-a8ed-4796-b7fa-70daef095c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:23.631520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-73bc4923-a8ed-4796-b7fa-70daef095c88 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:23.632747 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-73bc4923-a8ed-4796-b7fa-70daef095c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:23.641125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 722/1425] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 18:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:23.790196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa4561-0eb5-487f-927c-537a50502ce5 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:23.804824 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa4561-0eb5-487f-927c-537a50502ce5 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:23.810706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585cbaf-8a15-41e4-a7d8-a3765de2d420 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:23.811332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585cbaf-8a15-41e4-a7d8-a3765de2d420 service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:23.811651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585cbaf-8a15-41e4-a7d8-a3765de2d420 service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:23.811928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585cbaf-8a15-41e4-a7d8-a3765de2d420 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:23.819941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585cbaf-8a15-41e4-a7d8-a3765de2d420 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:23.821516 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585cbaf-8a15-41e4-a7d8-a3765de2d420 service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:23.830959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 704/1426] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:24.763066 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381c6a6-8a19-4fd2-9ff5-7bfb0062ee0c None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:24.763684 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381c6a6-8a19-4fd2-9ff5-7bfb0062ee0c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:24.763684 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381c6a6-8a19-4fd2-9ff5-7bfb0062ee0c None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:24.765020 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 723/1427] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 18:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:24.769760 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52485a35-65a9-4f74-841a-6dcf533f0ff2 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:24.770187 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52485a35-65a9-4f74-841a-6dcf533f0ff2 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:24.770323 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52485a35-65a9-4f74-841a-6dcf533f0ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:24.788801 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-52485a35-65a9-4f74-841a-6dcf533f0ff2 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:24.789927 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-52485a35-65a9-4f74-841a-6dcf533f0ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:24.797535 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 705/1428] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 18:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:24.945144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381c6a6-8a19-4fd2-9ff5-7bfb0062ee0c None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:24.960225 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381c6a6-8a19-4fd2-9ff5-7bfb0062ee0c None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:24.965451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8cf59-ed94-4f9a-b83a-0f16f4ba9884 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:24.966091 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8cf59-ed94-4f9a-b83a-0f16f4ba9884 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:24.966369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8cf59-ed94-4f9a-b83a-0f16f4ba9884 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:24.966642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8cf59-ed94-4f9a-b83a-0f16f4ba9884 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:24.974677 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8cf59-ed94-4f9a-b83a-0f16f4ba9884 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:24.976298 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a8cf59-ed94-4f9a-b83a-0f16f4ba9884 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:24.985609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 724/1429] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:25.852914 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf61d3-ca3e-4941-89a9-705ef11386aa None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:25.853386 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf61d3-ca3e-4941-89a9-705ef11386aa None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:25.853496 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf61d3-ca3e-4941-89a9-705ef11386aa None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:25.854877 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 706/1430] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 18:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:25.860624 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbf38c-0fa6-47fc-b74b-4359f3c724e3 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:25.861064 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbf38c-0fa6-47fc-b74b-4359f3c724e3 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:25.861167 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbf38c-0fa6-47fc-b74b-4359f3c724e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:25.878625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-e2dbf38c-0fa6-47fc-b74b-4359f3c724e3 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:25.879847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e2dbf38c-0fa6-47fc-b74b-4359f3c724e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:25.888092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 725/1431] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 18:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:26.037523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf61d3-ca3e-4941-89a9-705ef11386aa None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:26.051681 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf61d3-ca3e-4941-89a9-705ef11386aa None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:26.056999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b760cda-b22b-4612-a7e7-1f67d107985d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:26.057627 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b760cda-b22b-4612-a7e7-1f67d107985d service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:26.057914 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b760cda-b22b-4612-a7e7-1f67d107985d service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:26.058220 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b760cda-b22b-4612-a7e7-1f67d107985d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:26.066184 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b760cda-b22b-4612-a7e7-1f67d107985d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:26.067789 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b760cda-b22b-4612-a7e7-1f67d107985d service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:26.077504 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 707/1432] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:26.943998 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448f5f0-afc3-4fd4-94b2-e21a3fd1633c None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:26.944580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448f5f0-afc3-4fd4-94b2-e21a3fd1633c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:26.944580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448f5f0-afc3-4fd4-94b2-e21a3fd1633c None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:26.945941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 726/1433] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 18:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:26.951001 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec175237-b179-4fe0-9c52-9a39403259fb None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:26.951436 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec175237-b179-4fe0-9c52-9a39403259fb None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:26.951583 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec175237-b179-4fe0-9c52-9a39403259fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:26.969316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-ec175237-b179-4fe0-9c52-9a39403259fb None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:26.970546 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ec175237-b179-4fe0-9c52-9a39403259fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:26.979443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 708/1434] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 18:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:27.131437 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448f5f0-afc3-4fd4-94b2-e21a3fd1633c None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:27.145472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448f5f0-afc3-4fd4-94b2-e21a3fd1633c None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:27.150730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0644e-5bb7-4d6f-bc54-34dae25fe735 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:27.151360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0644e-5bb7-4d6f-bc54-34dae25fe735 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:27.151676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0644e-5bb7-4d6f-bc54-34dae25fe735 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:27.152442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0644e-5bb7-4d6f-bc54-34dae25fe735 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:27.160356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0644e-5bb7-4d6f-bc54-34dae25fe735 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:27.161933 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0644e-5bb7-4d6f-bc54-34dae25fe735 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:27.171656 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 727/1435] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:28.022653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8feb84-ce0b-4e43-8bc3-5b776ac01421 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:28.023241 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8feb84-ce0b-4e43-8bc3-5b776ac01421 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:28.023241 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8feb84-ce0b-4e43-8bc3-5b776ac01421 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:28.024696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 709/1436] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 18:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:28.029552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b67ba6-2922-4b20-8118-3082bae3d597 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:28.029954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b67ba6-2922-4b20-8118-3082bae3d597 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:28.030110 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b67ba6-2922-4b20-8118-3082bae3d597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:28.047860 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-b1b67ba6-2922-4b20-8118-3082bae3d597 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:28.049063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b1b67ba6-2922-4b20-8118-3082bae3d597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:28.056955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 728/1437] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 18:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:28.206992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8feb84-ce0b-4e43-8bc3-5b776ac01421 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:28.221074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8feb84-ce0b-4e43-8bc3-5b776ac01421 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:28.226460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db3da2-20f3-4eb2-bc14-72cfff0b3be2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:28.227084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db3da2-20f3-4eb2-bc14-72cfff0b3be2 service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:28.227370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db3da2-20f3-4eb2-bc14-72cfff0b3be2 service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:28.227680 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db3da2-20f3-4eb2-bc14-72cfff0b3be2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:28.237363 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db3da2-20f3-4eb2-bc14-72cfff0b3be2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:28.238975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07db3da2-20f3-4eb2-bc14-72cfff0b3be2 service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:28.248802 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 710/1438] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:30.175296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbf55c-2faa-4572-9671-97064cde0a0a None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:30.175864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbf55c-2faa-4572-9671-97064cde0a0a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:30.175864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbf55c-2faa-4572-9671-97064cde0a0a None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:30.177180 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 729/1439] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 18:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:30.182560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bc07f-8a17-4644-a3f3-842cbe695727 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:30.183013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bc07f-8a17-4644-a3f3-842cbe695727 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:30.183265 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bc07f-8a17-4644-a3f3-842cbe695727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:30.201324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-0a1bc07f-8a17-4644-a3f3-842cbe695727 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:30.202524 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0a1bc07f-8a17-4644-a3f3-842cbe695727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:30.211891 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 711/1440] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 18:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:30.250536 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbf55c-2faa-4572-9671-97064cde0a0a None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:30.261036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbf55c-2faa-4572-9671-97064cde0a0a None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:30.264515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375bc14-cbd0-4371-8be9-2419effe5181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:30.265171 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375bc14-cbd0-4371-8be9-2419effe5181 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:30.265439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375bc14-cbd0-4371-8be9-2419effe5181 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:30.265719 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375bc14-cbd0-4371-8be9-2419effe5181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:30.274466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375bc14-cbd0-4371-8be9-2419effe5181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:30.275944 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e375bc14-cbd0-4371-8be9-2419effe5181 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:30.285735 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 730/1441] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:32.456977 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43545558-dbdb-429c-8e8e-b2a6c0eb3b20 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:32.457523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43545558-dbdb-429c-8e8e-b2a6c0eb3b20 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:32.457523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43545558-dbdb-429c-8e8e-b2a6c0eb3b20 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:32.458906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 712/1442] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 18:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:32.464743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc36cd4-bc1c-43e0-a361-5cbefcd2f62f None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:32.465184 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc36cd4-bc1c-43e0-a361-5cbefcd2f62f None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:32.465283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc36cd4-bc1c-43e0-a361-5cbefcd2f62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:32.483420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-1fc36cd4-bc1c-43e0-a361-5cbefcd2f62f None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:32.484916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-1fc36cd4-bc1c-43e0-a361-5cbefcd2f62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:32.492759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 731/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 18:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:32.530049 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43545558-dbdb-429c-8e8e-b2a6c0eb3b20 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:32.540483 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43545558-dbdb-429c-8e8e-b2a6c0eb3b20 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:32.544501 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c823e63-bf14-4341-8670-aec505d33c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:32.545152 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823e63-bf14-4341-8670-aec505d33c4f service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:32.545435 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823e63-bf14-4341-8670-aec505d33c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:32.545713 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c823e63-bf14-4341-8670-aec505d33c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:32.554370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c823e63-bf14-4341-8670-aec505d33c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:32.555823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c823e63-bf14-4341-8670-aec505d33c4f service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:32.565142 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 713/1444] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:34.918753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af46adc-b544-4f1b-b3fc-bb03a1fcc315 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:34.919297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af46adc-b544-4f1b-b3fc-bb03a1fcc315 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:34.919297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af46adc-b544-4f1b-b3fc-bb03a1fcc315 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:34.920699 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 732/1445] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 18:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:34.925868 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e24c13-c2a1-4612-90d5-1561303e5995 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:34.926319 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e24c13-c2a1-4612-90d5-1561303e5995 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:34.926429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e24c13-c2a1-4612-90d5-1561303e5995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:34.943676 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-91e24c13-c2a1-4612-90d5-1561303e5995 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:34.944862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-91e24c13-c2a1-4612-90d5-1561303e5995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:34.952983 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 714/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 18:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:44:34.991254 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af46adc-b544-4f1b-b3fc-bb03a1fcc315 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:35.001736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af46adc-b544-4f1b-b3fc-bb03a1fcc315 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:35.005220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fdcb79-e442-4f4d-8aba-90b93961bfff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:35.005833 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdcb79-e442-4f4d-8aba-90b93961bfff service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:35.006112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdcb79-e442-4f4d-8aba-90b93961bfff service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:35.006380 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fdcb79-e442-4f4d-8aba-90b93961bfff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:35.015475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fdcb79-e442-4f4d-8aba-90b93961bfff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:35.016931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fdcb79-e442-4f4d-8aba-90b93961bfff service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:35.026073 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 733/1447] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:37.181073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672040f-f5da-4883-bdae-80853744bd6c None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:37.181649 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672040f-f5da-4883-bdae-80853744bd6c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:37.181649 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672040f-f5da-4883-bdae-80853744bd6c None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:37.183071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 715/1448] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 18:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:37.188265 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0efdc4-e069-4de7-aac7-996143470d71 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:37.188666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0efdc4-e069-4de7-aac7-996143470d71 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:37.188830 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0efdc4-e069-4de7-aac7-996143470d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:37.206704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-9b0efdc4-e069-4de7-aac7-996143470d71 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:37.207971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9b0efdc4-e069-4de7-aac7-996143470d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:37.216256 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 734/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 18:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:37.253929 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672040f-f5da-4883-bdae-80853744bd6c None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:37.264936 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672040f-f5da-4883-bdae-80853744bd6c None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:37.268408 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44047a59-57cd-4fa5-8b1c-bce1255f3562 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:37.269035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44047a59-57cd-4fa5-8b1c-bce1255f3562 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:37.269321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44047a59-57cd-4fa5-8b1c-bce1255f3562 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:37.269601 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44047a59-57cd-4fa5-8b1c-bce1255f3562 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:37.278972 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44047a59-57cd-4fa5-8b1c-bce1255f3562 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:37.280429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44047a59-57cd-4fa5-8b1c-bce1255f3562 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:37.289631 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 716/1450] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:39.464612 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f897cb2-95e6-4fc1-ba73-5f091ead1a42 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:39.465157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f897cb2-95e6-4fc1-ba73-5f091ead1a42 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:39.465157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f897cb2-95e6-4fc1-ba73-5f091ead1a42 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:39.466516 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 735/1451] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 18:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:39.471637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35c63e-c615-4a98-b4f7-fc5ada7654a8 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:39.472087 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35c63e-c615-4a98-b4f7-fc5ada7654a8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:39.472195 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35c63e-c615-4a98-b4f7-fc5ada7654a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:39.490733 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-4c35c63e-c615-4a98-b4f7-fc5ada7654a8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:39.491975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-4c35c63e-c615-4a98-b4f7-fc5ada7654a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:39.500213 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 717/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 18:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:39.537158 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f897cb2-95e6-4fc1-ba73-5f091ead1a42 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:39.548208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f897cb2-95e6-4fc1-ba73-5f091ead1a42 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:39.551694 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92966f-769c-4722-962d-179b07d81b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:39.552320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92966f-769c-4722-962d-179b07d81b4c service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:39.552605 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92966f-769c-4722-962d-179b07d81b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:39.552882 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92966f-769c-4722-962d-179b07d81b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:39.562208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92966f-769c-4722-962d-179b07d81b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:39.563670 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92966f-769c-4722-962d-179b07d81b4c service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:39.572845 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 736/1453] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:41.648096 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9675370-7d52-4ce2-990f-27c35018a1a9 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:41.648637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9675370-7d52-4ce2-990f-27c35018a1a9 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:41.648637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9675370-7d52-4ce2-990f-27c35018a1a9 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:41.650029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 718/1454] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 18:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:41.655910 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b367de-8492-4e84-815b-b889b8a08970 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:41.656320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b367de-8492-4e84-815b-b889b8a08970 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:41.656470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b367de-8492-4e84-815b-b889b8a08970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:41.673632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-54b367de-8492-4e84-815b-b889b8a08970 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:41.674834 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-54b367de-8492-4e84-815b-b889b8a08970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:41.682409 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 737/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 18:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:41.720415 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9675370-7d52-4ce2-990f-27c35018a1a9 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:41.730837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9675370-7d52-4ce2-990f-27c35018a1a9 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:41.734608 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918015d1-79c5-4ab8-a1d7-8b7dc2a6ae5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:41.735233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918015d1-79c5-4ab8-a1d7-8b7dc2a6ae5c service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:41.735520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918015d1-79c5-4ab8-a1d7-8b7dc2a6ae5c service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:41.735824 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918015d1-79c5-4ab8-a1d7-8b7dc2a6ae5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:41.744481 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918015d1-79c5-4ab8-a1d7-8b7dc2a6ae5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:41.745957 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918015d1-79c5-4ab8-a1d7-8b7dc2a6ae5c service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:41.755220 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 719/1456] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:43.806677 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2c2e6-c110-47e6-a056-613285ca05e3 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:43.807729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2c2e6-c110-47e6-a056-613285ca05e3 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:43.807729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2c2e6-c110-47e6-a056-613285ca05e3 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:43.809072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 738/1457] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 18:44:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:43.814162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950ce75-54a2-43a8-b33b-aac03418331e None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:43.814597 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950ce75-54a2-43a8-b33b-aac03418331e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:43.814754 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950ce75-54a2-43a8-b33b-aac03418331e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:43.832551 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-5950ce75-54a2-43a8-b33b-aac03418331e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:43.833748 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5950ce75-54a2-43a8-b33b-aac03418331e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:43.841464 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 720/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 18:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:43.879060 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2c2e6-c110-47e6-a056-613285ca05e3 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:43.890253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2c2e6-c110-47e6-a056-613285ca05e3 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:43.893775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73252a-2c9d-4edc-929b-dacd82e1e8d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:43.894404 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73252a-2c9d-4edc-929b-dacd82e1e8d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:43.894691 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73252a-2c9d-4edc-929b-dacd82e1e8d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:43.894974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73252a-2c9d-4edc-929b-dacd82e1e8d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:43.903768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73252a-2c9d-4edc-929b-dacd82e1e8d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:43.905201 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73252a-2c9d-4edc-929b-dacd82e1e8d8 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:43.914431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 739/1459] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:45.962478 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95870a85-2557-4a31-b34f-021e55af6379 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:45.963032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95870a85-2557-4a31-b34f-021e55af6379 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:45.963032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95870a85-2557-4a31-b34f-021e55af6379 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:45.964954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 721/1460] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 18:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:45.970101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebff47-1612-4216-aa6e-fe11cc1fc654 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:45.970547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebff47-1612-4216-aa6e-fe11cc1fc654 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:45.970685 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ebff47-1612-4216-aa6e-fe11cc1fc654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:45.976739 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=79 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:44:45.989349 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-27ebff47-1612-4216-aa6e-fe11cc1fc654 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:45.990554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-27ebff47-1612-4216-aa6e-fe11cc1fc654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:45.998339 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 740/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 18:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:46.034696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95870a85-2557-4a31-b34f-021e55af6379 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:46.039973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=73 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:44:46.046363 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95870a85-2557-4a31-b34f-021e55af6379 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:46.050054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6c285e-8b8a-4375-9e94-5f611a968e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:46.050673 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c285e-8b8a-4375-9e94-5f611a968e85 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:46.050954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c285e-8b8a-4375-9e94-5f611a968e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:46.053640 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6c285e-8b8a-4375-9e94-5f611a968e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:46.059981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c285e-8b8a-4375-9e94-5f611a968e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:46.061403 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6c285e-8b8a-4375-9e94-5f611a968e85 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:46.070774 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 722/1462] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:48.104659 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda9873-33f3-4335-85e6-d313593eae9e None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:48.105218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda9873-33f3-4335-85e6-d313593eae9e None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:48.105218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda9873-33f3-4335-85e6-d313593eae9e None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:48.106542 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 741/1463] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 18:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:48.112252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d158787-f324-49cb-b620-c8e742d01fbf None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:48.112660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d158787-f324-49cb-b620-c8e742d01fbf None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:48.112809 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d158787-f324-49cb-b620-c8e742d01fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:48.130497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-8d158787-f324-49cb-b620-c8e742d01fbf None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:48.131723 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-8d158787-f324-49cb-b620-c8e742d01fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:48.139930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 723/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 18:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:48.175206 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda9873-33f3-4335-85e6-d313593eae9e None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:48.186175 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda9873-33f3-4335-85e6-d313593eae9e None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:48.189660 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702db9f9-8316-4c5c-a94c-24d72336b69f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:48.190282 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702db9f9-8316-4c5c-a94c-24d72336b69f service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:48.190566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702db9f9-8316-4c5c-a94c-24d72336b69f service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:48.190843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702db9f9-8316-4c5c-a94c-24d72336b69f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:48.200160 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702db9f9-8316-4c5c-a94c-24d72336b69f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:48.201589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702db9f9-8316-4c5c-a94c-24d72336b69f service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:48.210803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 742/1465] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:44:50.240238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586ba22-471d-4aa2-bb29-e4c71ae90522 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:50.240765 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586ba22-471d-4aa2-bb29-e4c71ae90522 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:50.240765 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586ba22-471d-4aa2-bb29-e4c71ae90522 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:50.242146 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 724/1466] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 18:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:44:50.247955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be7ad7-5872-45d8-bedd-4fc0ddcef765 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:50.248368 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be7ad7-5872-45d8-bedd-4fc0ddcef765 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:50.248524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be7ad7-5872-45d8-bedd-4fc0ddcef765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:50.266029 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-a5be7ad7-5872-45d8-bedd-4fc0ddcef765 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:44:50.267238 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a5be7ad7-5872-45d8-bedd-4fc0ddcef765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:44:50.275388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 743/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 18:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:44:50.312325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586ba22-471d-4aa2-bb29-e4c71ae90522 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:44:50.322759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586ba22-471d-4aa2-bb29-e4c71ae90522 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:44:50.326209 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81940c-6124-4e31-a6d8-7dcdddcf9de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:44:50.326833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81940c-6124-4e31-a6d8-7dcdddcf9de1 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:44:50.327115 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81940c-6124-4e31-a6d8-7dcdddcf9de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:44:50.327391 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81940c-6124-4e31-a6d8-7dcdddcf9de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:44:50.336024 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81940c-6124-4e31-a6d8-7dcdddcf9de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:44:50.337446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81940c-6124-4e31-a6d8-7dcdddcf9de1 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:44:50.347118 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 725/1468] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:45:00.260911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=11 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:00.343014 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=14 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:09.995781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98e123-c7ea-433d-9bcd-d54835410df5 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:09.996384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98e123-c7ea-433d-9bcd-d54835410df5 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:09.996384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98e123-c7ea-433d-9bcd-d54835410df5 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:09.997729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 744/1469] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:45:10.003126 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdda89-7edd-429b-b393-43f65894bcc6 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:10.003598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdda89-7edd-429b-b393-43f65894bcc6 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:10.003758 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdda89-7edd-429b-b393-43f65894bcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:10.021129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-58fdda89-7edd-429b-b393-43f65894bcc6 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:45:10.022333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-58fdda89-7edd-429b-b393-43f65894bcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:45:10.030559 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 726/1470] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:45:10.077088 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9df760-732f-4d64-a3b7-2d18648c9778 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:10.077381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9df760-732f-4d64-a3b7-2d18648c9778 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:10.077663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9df760-732f-4d64-a3b7-2d18648c9778 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:10.079027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 745/1471] 10.222.0.36 () {54 vars in 962 bytes} [Mon Jun 27 18:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:45:10.083676 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48711a3-58b4-4119-b660-a309e4880858 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:10.083973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48711a3-58b4-4119-b660-a309e4880858 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:10.084255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48711a3-58b4-4119-b660-a309e4880858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:10.103653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-b48711a3-58b4-4119-b660-a309e4880858 None None] MFA Rules not processed for user `4e59193e90e240f6b9876d0455eea355`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:45:10.104795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b48711a3-58b4-4119-b660-a309e4880858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:45:10.111458 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 727/1472] 10.222.0.36 () {58 vars in 1059 bytes} [Mon Jun 27 18:45:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:45:10.118473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9df760-732f-4d64-a3b7-2d18648c9778 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:45:10.129086 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9df760-732f-4d64-a3b7-2d18648c9778 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:45:10.132613 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45081498-6e84-4a2e-8b72-41971eb32058 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e59193e90e240f6b9876d0455eea355', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:45:10.133241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45081498-6e84-4a2e-8b72-41971eb32058 service glance] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:10.133542 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45081498-6e84-4a2e-8b72-41971eb32058 service glance] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:10.134343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45081498-6e84-4a2e-8b72-41971eb32058 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:10.143123 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45081498-6e84-4a2e-8b72-41971eb32058 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:45:10.144595 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45081498-6e84-4a2e-8b72-41971eb32058 service glance] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:45:10.154428 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 746/1473] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:45:12.242769 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc302b-2068-4a3f-85ef-0bb2cb697033 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:12.242769 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc302b-2068-4a3f-85ef-0bb2cb697033 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:12.242769 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc302b-2068-4a3f-85ef-0bb2cb697033 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:12.242769 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 728/1474] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:45:12.243623 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97796517-d80b-4a88-8c81-a72f69ffe688 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:12.243623 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97796517-d80b-4a88-8c81-a72f69ffe688 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:12.243623 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97796517-d80b-4a88-8c81-a72f69ffe688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:12.256693 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-97796517-d80b-4a88-8c81-a72f69ffe688 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:45:12.257905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-97796517-d80b-4a88-8c81-a72f69ffe688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:45:12.265943 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 747/1475] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:45:12.289685 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc302b-2068-4a3f-85ef-0bb2cb697033 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:45:12.302613 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc302b-2068-4a3f-85ef-0bb2cb697033 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:45:12.307083 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826a0fb-8667-4115-97ac-3edc42960b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:45:12.307822 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826a0fb-8667-4115-97ac-3edc42960b4e admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:12.308109 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826a0fb-8667-4115-97ac-3edc42960b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:12.308413 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826a0fb-8667-4115-97ac-3edc42960b4e admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:12.309148 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826a0fb-8667-4115-97ac-3edc42960b4e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:45:12.310913 dv-cinder-844601-6-smb devstack@keystone.service[86870]: WARNING py.warnings [None req-3826a0fb-8667-4115-97ac-3edc42960b4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:45:12.310913 dv-cinder-844601-6-smb devstack@keystone.service[86870]: warnings.warn(msg) Jun 27 18:45:12.310913 dv-cinder-844601-6-smb devstack@keystone.service[86870]: Jun 27 18:45:12.312100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826a0fb-8667-4115-97ac-3edc42960b4e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:45:12.330865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 729/1476] 10.222.0.36 () {56 vars in 1108 bytes} [Mon Jun 27 18:45:12 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:45:14.386543 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bc5e2-9f28-457d-bb0c-3572301b2942 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:14.387104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bc5e2-9f28-457d-bb0c-3572301b2942 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:14.387104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194bc5e2-9f28-457d-bb0c-3572301b2942 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:14.388501 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 748/1477] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:45:14.393932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871175d-2759-4a5a-ad25-5be5dbd936c7 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:14.394340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871175d-2759-4a5a-ad25-5be5dbd936c7 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:14.394488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871175d-2759-4a5a-ad25-5be5dbd936c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:14.412115 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-0871175d-2759-4a5a-ad25-5be5dbd936c7 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:45:14.413318 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0871175d-2759-4a5a-ad25-5be5dbd936c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:45:14.421695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 730/1478] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:45:14.465479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bc5e2-9f28-457d-bb0c-3572301b2942 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:45:14.479445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194bc5e2-9f28-457d-bb0c-3572301b2942 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:45:14.484998 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f5081-0c41-4aec-b631-bbbf13b0a4e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:45:14.485651 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f5081-0c41-4aec-b631-bbbf13b0a4e6 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:14.485931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f5081-0c41-4aec-b631-bbbf13b0a4e6 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:14.486203 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f5081-0c41-4aec-b631-bbbf13b0a4e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:14.494756 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f5081-0c41-4aec-b631-bbbf13b0a4e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:45:14.496373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f5081-0c41-4aec-b631-bbbf13b0a4e6 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:45:14.505517 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 749/1479] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:45:16.724032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b056288-8582-4e25-a696-7e784206cdb8 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:16.724573 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b056288-8582-4e25-a696-7e784206cdb8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:16.724573 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b056288-8582-4e25-a696-7e784206cdb8 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:16.725934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 731/1480] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:45:16.731043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d581193-9343-41cb-8846-886b25de1843 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:16.731449 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d581193-9343-41cb-8846-886b25de1843 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:16.731639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d581193-9343-41cb-8846-886b25de1843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:16.749628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-2d581193-9343-41cb-8846-886b25de1843 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:45:16.750814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2d581193-9343-41cb-8846-886b25de1843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:45:16.758518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 750/1481] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:45:16.794902 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b056288-8582-4e25-a696-7e784206cdb8 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:45:16.806014 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b056288-8582-4e25-a696-7e784206cdb8 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:45:16.809584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df4403-b46d-4bf6-a1b7-c0b7d0c83704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:45:16.810216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df4403-b46d-4bf6-a1b7-c0b7d0c83704 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:16.810507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df4403-b46d-4bf6-a1b7-c0b7d0c83704 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:16.810788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df4403-b46d-4bf6-a1b7-c0b7d0c83704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:16.819663 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df4403-b46d-4bf6-a1b7-c0b7d0c83704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:45:16.821738 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df4403-b46d-4bf6-a1b7-c0b7d0c83704 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:45:16.831110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 732/1482] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:45:18.891368 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c87a76-fed7-4296-9be4-95621765a8da None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:18.891969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c87a76-fed7-4296-9be4-95621765a8da None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:18.891969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c87a76-fed7-4296-9be4-95621765a8da None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:18.893318 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 751/1483] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:45:18.898370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f2214-36c3-4b98-8190-f79db3f05089 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:18.898781 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f2214-36c3-4b98-8190-f79db3f05089 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:18.899457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f2214-36c3-4b98-8190-f79db3f05089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:18.917380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-798f2214-36c3-4b98-8190-f79db3f05089 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:45:18.918571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-798f2214-36c3-4b98-8190-f79db3f05089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:45:18.926285 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 733/1484] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:45:18.963686 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c87a76-fed7-4296-9be4-95621765a8da None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:45:18.974022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c87a76-fed7-4296-9be4-95621765a8da None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:45:18.978093 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fa2ecb-b285-4ba1-bb40-b903569f66c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:45:18.978692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa2ecb-b285-4ba1-bb40-b903569f66c7 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:18.978971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa2ecb-b285-4ba1-bb40-b903569f66c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:18.979240 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fa2ecb-b285-4ba1-bb40-b903569f66c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:18.988064 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa2ecb-b285-4ba1-bb40-b903569f66c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:45:18.989479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fa2ecb-b285-4ba1-bb40-b903569f66c7 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:45:18.998550 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 752/1485] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:45:21.118518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c06b7-5a61-4e3a-bd18-d328d8e53472 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:21.119085 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c06b7-5a61-4e3a-bd18-d328d8e53472 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:21.119204 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c06b7-5a61-4e3a-bd18-d328d8e53472 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:21.120522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 734/1486] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:45:21.125611 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8849c-cd82-4367-9eee-74eb4326cddc None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:21.126057 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8849c-cd82-4367-9eee-74eb4326cddc None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:21.126164 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8849c-cd82-4367-9eee-74eb4326cddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:21.143964 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-37c8849c-cd82-4367-9eee-74eb4326cddc None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:45:21.145142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-37c8849c-cd82-4367-9eee-74eb4326cddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:45:21.152765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 753/1487] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:45:21.192931 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c06b7-5a61-4e3a-bd18-d328d8e53472 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:45:21.204162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c06b7-5a61-4e3a-bd18-d328d8e53472 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:45:21.207657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca0afc-3b00-4242-b0fc-2124d96b28e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:45:21.208317 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca0afc-3b00-4242-b0fc-2124d96b28e4 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:21.208599 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca0afc-3b00-4242-b0fc-2124d96b28e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:21.208877 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca0afc-3b00-4242-b0fc-2124d96b28e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:21.217694 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca0afc-3b00-4242-b0fc-2124d96b28e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:45:21.219170 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca0afc-3b00-4242-b0fc-2124d96b28e4 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:45:21.228492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 735/1488] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:45:23.585766 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb52ac-c753-43ca-8b8e-4bf24e523ce0 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:23.586305 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb52ac-c753-43ca-8b8e-4bf24e523ce0 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:23.586401 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb52ac-c753-43ca-8b8e-4bf24e523ce0 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:23.587733 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 754/1489] 10.222.0.36 () {54 vars in 926 bytes} [Mon Jun 27 18:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:45:23.592942 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e284e-a0ab-44d7-bb79-8200c68526ea None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:23.593374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e284e-a0ab-44d7-bb79-8200c68526ea None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:23.593515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e284e-a0ab-44d7-bb79-8200c68526ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:23.611174 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-3e8e284e-a0ab-44d7-bb79-8200c68526ea None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:45:23.612416 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3e8e284e-a0ab-44d7-bb79-8200c68526ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:45:23.620705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 736/1490] 10.222.0.36 () {58 vars in 1023 bytes} [Mon Jun 27 18:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:45:23.659439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb52ac-c753-43ca-8b8e-4bf24e523ce0 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:45:23.670487 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb52ac-c753-43ca-8b8e-4bf24e523ce0 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:45:23.674004 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5842fd-e63e-42f3-8bb8-7f73c17f891a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:45:23.674630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5842fd-e63e-42f3-8bb8-7f73c17f891a service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:45:23.674919 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5842fd-e63e-42f3-8bb8-7f73c17f891a service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:45:23.675200 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5842fd-e63e-42f3-8bb8-7f73c17f891a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:45:23.684610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5842fd-e63e-42f3-8bb8-7f73c17f891a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:45:23.686041 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5842fd-e63e-42f3-8bb8-7f73c17f891a service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:45:23.695297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 755/1491] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:45:33.605866 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=33 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:45:33.691215 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=33 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:46:55.290599 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ba26-3c39-4ec3-8316-b4dbf113aa06 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:46:55.291212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ba26-3c39-4ec3-8316-b4dbf113aa06 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:46:55.291212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d09ba26-3c39-4ec3-8316-b4dbf113aa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:46:55.309269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-3d09ba26-3c39-4ec3-8316-b4dbf113aa06 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:46:55.310453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3d09ba26-3c39-4ec3-8316-b4dbf113aa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:46:55.318149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 737/1492] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:46:55.325989 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7484c-5ac8-419c-9b58-b06b726a77b8 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:46:55.326461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7484c-5ac8-419c-9b58-b06b726a77b8 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:46:55.326564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d7484c-5ac8-419c-9b58-b06b726a77b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:46:55.343732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-a6d7484c-5ac8-419c-9b58-b06b726a77b8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:46:55.344894 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a6d7484c-5ac8-419c-9b58-b06b726a77b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:46:55.352988 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 756/1493] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:46:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:46:55.357474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09ba26-3c39-4ec3-8316-b4dbf113aa06 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:46:55.367425 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d09ba26-3c39-4ec3-8316-b4dbf113aa06 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:46:55.371850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010b8ac-6314-4cba-b8cc-88945e5a7fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:46:55.372490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b8ac-6314-4cba-b8cc-88945e5a7fcb admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:46:55.372771 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b8ac-6314-4cba-b8cc-88945e5a7fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:46:55.373045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010b8ac-6314-4cba-b8cc-88945e5a7fcb admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:46:55.373759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010b8ac-6314-4cba-b8cc-88945e5a7fcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:46:55.374066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010b8ac-6314-4cba-b8cc-88945e5a7fcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:46:55.375064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: WARNING py.warnings [None req-b010b8ac-6314-4cba-b8cc-88945e5a7fcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:46:55.375064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: warnings.warn(msg) Jun 27 18:46:55.375064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: Jun 27 18:46:55.375983 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b010b8ac-6314-4cba-b8cc-88945e5a7fcb admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:46:55.387116 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 738/1494] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:46:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:46:55.394808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7484c-5ac8-419c-9b58-b06b726a77b8 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:46:55.403631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d7484c-5ac8-419c-9b58-b06b726a77b8 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:46:55.408249 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bade9-f4c9-4cf4-aa83-5002f83aa27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:46:55.408883 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bade9-f4c9-4cf4-aa83-5002f83aa27e admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:46:55.409165 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bade9-f4c9-4cf4-aa83-5002f83aa27e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:46:55.409434 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527bade9-f4c9-4cf4-aa83-5002f83aa27e admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:46:55.410646 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bade9-f4c9-4cf4-aa83-5002f83aa27e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:46:55.412464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: WARNING py.warnings [None req-527bade9-f4c9-4cf4-aa83-5002f83aa27e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:46:55.412464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: warnings.warn(msg) Jun 27 18:46:55.412464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: Jun 27 18:46:55.426666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527bade9-f4c9-4cf4-aa83-5002f83aa27e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:46:55.514264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 757/1495] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:46:55 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:46:55.518556 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010b8ac-6314-4cba-b8cc-88945e5a7fcb admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:46:55.529235 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010b8ac-6314-4cba-b8cc-88945e5a7fcb admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:46:55.584776 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b637c74-ce04-4478-a72b-a98af281ad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:46:55.585442 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b637c74-ce04-4478-a72b-a98af281ad9c admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:46:55.585730 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b637c74-ce04-4478-a72b-a98af281ad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:46:55.586009 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b637c74-ce04-4478-a72b-a98af281ad9c admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:46:55.586705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b637c74-ce04-4478-a72b-a98af281ad9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:46:55.587741 dv-cinder-844601-6-smb devstack@keystone.service[86870]: WARNING py.warnings [None req-5b637c74-ce04-4478-a72b-a98af281ad9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:46:55.587741 dv-cinder-844601-6-smb devstack@keystone.service[86870]: warnings.warn(msg) Jun 27 18:46:55.587741 dv-cinder-844601-6-smb devstack@keystone.service[86870]: Jun 27 18:46:55.588963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b637c74-ce04-4478-a72b-a98af281ad9c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:46:55.685526 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 739/1496] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:46:55 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:46:55.689808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bade9-f4c9-4cf4-aa83-5002f83aa27e admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:46:55.700996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527bade9-f4c9-4cf4-aa83-5002f83aa27e admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:46:55.705689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18eac8e-635d-455b-b677-619e91891615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:46:55.706342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18eac8e-635d-455b-b677-619e91891615 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:46:55.706627 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18eac8e-635d-455b-b677-619e91891615 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:46:55.706928 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18eac8e-635d-455b-b677-619e91891615 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:46:55.707789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18eac8e-635d-455b-b677-619e91891615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:46:55.708809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: WARNING py.warnings [None req-c18eac8e-635d-455b-b677-619e91891615 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:46:55.708809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: warnings.warn(msg) Jun 27 18:46:55.708809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: Jun 27 18:46:55.709689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18eac8e-635d-455b-b677-619e91891615 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:46:55.722598 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 758/1497] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:46:55.726536 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b637c74-ce04-4478-a72b-a98af281ad9c admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:46:55.736677 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b637c74-ce04-4478-a72b-a98af281ad9c admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:46:55.741775 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b46d2-7b5a-4ec7-bfea-e9692840664b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:46:55.742470 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b46d2-7b5a-4ec7-bfea-e9692840664b admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:46:55.742873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b46d2-7b5a-4ec7-bfea-e9692840664b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:46:55.743190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b46d2-7b5a-4ec7-bfea-e9692840664b admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:46:55.743958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b46d2-7b5a-4ec7-bfea-e9692840664b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:46:55.744973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: WARNING py.warnings [None req-609b46d2-7b5a-4ec7-bfea-e9692840664b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:46:55.744973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: warnings.warn(msg) Jun 27 18:46:55.744973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: Jun 27 18:46:55.745910 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b46d2-7b5a-4ec7-bfea-e9692840664b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:46:55.760137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 740/1498] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:46:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:46:55.764573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18eac8e-635d-455b-b677-619e91891615 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:46:55.774197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18eac8e-635d-455b-b677-619e91891615 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:46:55.778688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e025d0fa-9b9f-4df4-9cbc-25fa52bed6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:46:55.779577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025d0fa-9b9f-4df4-9cbc-25fa52bed6b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:46:55.779860 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025d0fa-9b9f-4df4-9cbc-25fa52bed6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:46:55.780134 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e025d0fa-9b9f-4df4-9cbc-25fa52bed6b7 admin admin] PATH_INFO: `/v3/projects/7213e2e1252a42fa8c1b0ebf6e4d4ab8/users/183cee275c324df2b4becbeaec1b2e08/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:46:55.794291 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025d0fa-9b9f-4df4-9cbc-25fa52bed6b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7213e2e1252a42fa8c1b0ebf6e4d4ab8, user_id=183cee275c324df2b4becbeaec1b2e08, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:46:55.795306 dv-cinder-844601-6-smb devstack@keystone.service[86869]: WARNING py.warnings [None req-e025d0fa-9b9f-4df4-9cbc-25fa52bed6b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:46:55.795306 dv-cinder-844601-6-smb devstack@keystone.service[86869]: warnings.warn(msg) Jun 27 18:46:55.795306 dv-cinder-844601-6-smb devstack@keystone.service[86869]: Jun 27 18:46:55.797259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e025d0fa-9b9f-4df4-9cbc-25fa52bed6b7 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:46:55.855507 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 759/1499] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:46:55 2022] PUT /identity/v3/projects/7213e2e1252a42fa8c1b0ebf6e4d4ab8/users/183cee275c324df2b4becbeaec1b2e08/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:46:55.867878 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da2129-c2e5-4849-9998-c4089d7ecc01 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:46:55.868174 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da2129-c2e5-4849-9998-c4089d7ecc01 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:46:55.868462 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da2129-c2e5-4849-9998-c4089d7ecc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:46:55.893998 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-57da2129-c2e5-4849-9998-c4089d7ecc01 None None] MFA Rules not processed for user `183cee275c324df2b4becbeaec1b2e08`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:46:55.895214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-57da2129-c2e5-4849-9998-c4089d7ecc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:46:55.956868 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 741/1500] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:46:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:46:55.969853 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d12d1-37bc-43cf-ba83-98d4db93383d None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:46:55.970144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d12d1-37bc-43cf-ba83-98d4db93383d None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:46:55.970426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d12d1-37bc-43cf-ba83-98d4db93383d None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:46:55.971828 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 760/1501] 10.222.0.36 () {54 vars in 963 bytes} [Mon Jun 27 18:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:46:55.977122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4990f9d-3209-4537-b0b6-7546b2bf98c1 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:46:55.977422 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4990f9d-3209-4537-b0b6-7546b2bf98c1 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:46:55.977702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4990f9d-3209-4537-b0b6-7546b2bf98c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:46:55.995758 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-b4990f9d-3209-4537-b0b6-7546b2bf98c1 None None] MFA Rules not processed for user `f7ccc6b9aeef498a93030b48306fe402`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:46:55.996927 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b4990f9d-3209-4537-b0b6-7546b2bf98c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:46:56.038721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:46:56.045777 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 742/1502] 10.222.0.36 () {58 vars in 1060 bytes} [Mon Jun 27 18:46:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:46:56.054007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d12d1-37bc-43cf-ba83-98d4db93383d None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:46:56.064466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d12d1-37bc-43cf-ba83-98d4db93383d None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:46:56.067965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c2612-d3c6-4aef-83b1-69f1d3afb280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:46:56.068582 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c2612-d3c6-4aef-83b1-69f1d3afb280 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:46:56.068861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c2612-d3c6-4aef-83b1-69f1d3afb280 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:46:56.069131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c2612-d3c6-4aef-83b1-69f1d3afb280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:46:56.077187 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c2612-d3c6-4aef-83b1-69f1d3afb280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:46:56.078604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c2612-d3c6-4aef-83b1-69f1d3afb280 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:46:56.087144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 761/1503] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:46:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:46:56.129178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c442cd0-c87a-42ab-9c81-f2537e9daa0f None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:46:56.129472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c442cd0-c87a-42ab-9c81-f2537e9daa0f None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:46:56.129755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c442cd0-c87a-42ab-9c81-f2537e9daa0f None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:46:56.131079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 743/1504] 10.222.0.36 () {52 vars in 829 bytes} [Mon Jun 27 18:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:46:56.134606 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c2612-d3c6-4aef-83b1-69f1d3afb280 service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:46:56.195114 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c2612-d3c6-4aef-83b1-69f1d3afb280 service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:46:56.199609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1ab0b-ca71-4685-9586-25324f222bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:46:56.200480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1ab0b-ca71-4685-9586-25324f222bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:46:56.200763 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1ab0b-ca71-4685-9586-25324f222bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:46:56.201041 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1ab0b-ca71-4685-9586-25324f222bb4 admin admin] PATH_INFO: `/v3/users/183cee275c324df2b4becbeaec1b2e08` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:46:56.202249 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1ab0b-ca71-4685-9586-25324f222bb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=183cee275c324df2b4becbeaec1b2e08)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:46:56.203263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: WARNING py.warnings [None req-9ab1ab0b-ca71-4685-9586-25324f222bb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:46:56.203263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: warnings.warn(msg) Jun 27 18:46:56.203263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: Jun 27 18:46:56.204495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1ab0b-ca71-4685-9586-25324f222bb4 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:46:56.410759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9ab1ab0b-ca71-4685-9586-25324f222bb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '183cee275c324df2b4becbeaec1b2e08'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:46:56.483949 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9ab1ab0b-ca71-4685-9586-25324f222bb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '183cee275c324df2b4becbeaec1b2e08'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:46:56.502130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9ab1ab0b-ca71-4685-9586-25324f222bb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '183cee275c324df2b4becbeaec1b2e08'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:46:56.510658 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:46:56.514804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9ab1ab0b-ca71-4685-9586-25324f222bb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '183cee275c324df2b4becbeaec1b2e08'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:46:56.515540 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9ab1ab0b-ca71-4685-9586-25324f222bb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '183cee275c324df2b4becbeaec1b2e08'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:46:56.522079 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 762/1505] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:46:56 2022] DELETE /identity/v3/users/183cee275c324df2b4becbeaec1b2e08 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:46:56.526460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0625c-c32d-40f5-bbaa-910b48183de5 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:46:56.526923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0625c-c32d-40f5-bbaa-910b48183de5 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:46:56.527029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0625c-c32d-40f5-bbaa-910b48183de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:46:56.546341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-7ed0625c-c32d-40f5-bbaa-910b48183de5 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:46:56.548070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-7ed0625c-c32d-40f5-bbaa-910b48183de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:46:56.604436 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 744/1506] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:46:56.614216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1ab0b-ca71-4685-9586-25324f222bb4 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:46:56.615655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9ab1ab0b-ca71-4685-9586-25324f222bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:46:56.673452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1ab0b-ca71-4685-9586-25324f222bb4 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:46:56.676871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96140e8-b6cc-474a-8493-9069a66d401c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:46:56.677502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96140e8-b6cc-474a-8493-9069a66d401c service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:46:56.677784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96140e8-b6cc-474a-8493-9069a66d401c service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:46:56.678052 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96140e8-b6cc-474a-8493-9069a66d401c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:46:56.686577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96140e8-b6cc-474a-8493-9069a66d401c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:46:56.688033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96140e8-b6cc-474a-8493-9069a66d401c service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:46:56.697592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 763/1507] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:46:57.564658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0625c-c32d-40f5-bbaa-910b48183de5 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:46:57.566141 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-7ed0625c-c32d-40f5-bbaa-910b48183de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:46:57.577954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0625c-c32d-40f5-bbaa-910b48183de5 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:46:57.583405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0403f-3c7e-417d-a461-a8e5ad10ae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:46:57.591212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0403f-3c7e-417d-a461-a8e5ad10ae5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:46:57.591212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0403f-3c7e-417d-a461-a8e5ad10ae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:46:57.591212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0403f-3c7e-417d-a461-a8e5ad10ae5c admin admin] PATH_INFO: `/v3/projects/7213e2e1252a42fa8c1b0ebf6e4d4ab8` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:46:57.591212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0403f-3c7e-417d-a461-a8e5ad10ae5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7213e2e1252a42fa8c1b0ebf6e4d4ab8)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:46:57.591212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: WARNING py.warnings [None req-cbd0403f-3c7e-417d-a461-a8e5ad10ae5c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:46:57.591212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: warnings.warn(msg) Jun 27 18:46:57.591212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: Jun 27 18:46:57.591747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0403f-3c7e-417d-a461-a8e5ad10ae5c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:46:57.732862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-cbd0403f-3c7e-417d-a461-a8e5ad10ae5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7213e2e1252a42fa8c1b0ebf6e4d4ab8', 'request_id': 'req-cbd0403f-3c7e-417d-a461-a8e5ad10ae5c'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:46:57.813450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-cbd0403f-3c7e-417d-a461-a8e5ad10ae5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7213e2e1252a42fa8c1b0ebf6e4d4ab8', 'request_id': 'req-cbd0403f-3c7e-417d-a461-a8e5ad10ae5c'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:46:57.820598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-cbd0403f-3c7e-417d-a461-a8e5ad10ae5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7213e2e1252a42fa8c1b0ebf6e4d4ab8', 'request_id': 'req-cbd0403f-3c7e-417d-a461-a8e5ad10ae5c'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:46:57.839666 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-cbd0403f-3c7e-417d-a461-a8e5ad10ae5c admin admin] The token cache is being invalidate because project 7213e2e1252a42fa8c1b0ebf6e4d4ab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:46:57.839949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-cbd0403f-3c7e-417d-a461-a8e5ad10ae5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:46:57.840808 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-cbd0403f-3c7e-417d-a461-a8e5ad10ae5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:46:57.842352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 745/1508] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:46:57 2022] DELETE /identity/v3/projects/7213e2e1252a42fa8c1b0ebf6e4d4ab8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:47:06.693557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=29 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:47:07.836636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:40.207447 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3883860-0522-4cb9-9ba5-b4914d3ed04b None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:40.208055 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3883860-0522-4cb9-9ba5-b4914d3ed04b None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:40.208055 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3883860-0522-4cb9-9ba5-b4914d3ed04b None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:40.209379 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 764/1509] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 18:48:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:48:40.214182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa1daa-c083-49f7-9ccf-aca13cfa8cd8 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:40.214684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa1daa-c083-49f7-9ccf-aca13cfa8cd8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:40.214799 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa1daa-c083-49f7-9ccf-aca13cfa8cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:40.232990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-3eaa1daa-c083-49f7-9ccf-aca13cfa8cd8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:48:40.234203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3eaa1daa-c083-49f7-9ccf-aca13cfa8cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:48:40.291017 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 746/1510] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 18:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:48:40.445188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3883860-0522-4cb9-9ba5-b4914d3ed04b None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:48:40.446999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a3883860-0522-4cb9-9ba5-b4914d3ed04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:48:40.521412 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3883860-0522-4cb9-9ba5-b4914d3ed04b None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:48:40.526766 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a949bf9-2c2c-48ec-9930-68931e3a5ab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:48:40.527415 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a949bf9-2c2c-48ec-9930-68931e3a5ab6 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:40.527730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a949bf9-2c2c-48ec-9930-68931e3a5ab6 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:40.528012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a949bf9-2c2c-48ec-9930-68931e3a5ab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:40.536275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a949bf9-2c2c-48ec-9930-68931e3a5ab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:48:40.537892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a949bf9-2c2c-48ec-9930-68931e3a5ab6 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:48:40.547194 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 765/1511] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:48:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:48:41.371568 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130eaa9-5d9f-4557-af22-f86f00ea0c9c None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:41.372141 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130eaa9-5d9f-4557-af22-f86f00ea0c9c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:41.372141 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130eaa9-5d9f-4557-af22-f86f00ea0c9c None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:41.373517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 747/1512] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 18:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:48:41.378390 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe4daa-bf4e-400e-9eb8-ca6d6277d006 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:41.378815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe4daa-bf4e-400e-9eb8-ca6d6277d006 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:41.378923 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe4daa-bf4e-400e-9eb8-ca6d6277d006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:41.396964 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-4afe4daa-bf4e-400e-9eb8-ca6d6277d006 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:48:41.398150 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-4afe4daa-bf4e-400e-9eb8-ca6d6277d006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:48:41.405740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 766/1513] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 18:48:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:48:41.556071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130eaa9-5d9f-4557-af22-f86f00ea0c9c None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:48:41.571473 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130eaa9-5d9f-4557-af22-f86f00ea0c9c None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:48:41.576809 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054019b9-0f3e-46e0-8f81-e7d264c2280f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:48:41.577442 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054019b9-0f3e-46e0-8f81-e7d264c2280f service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:41.577730 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054019b9-0f3e-46e0-8f81-e7d264c2280f service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:41.578010 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054019b9-0f3e-46e0-8f81-e7d264c2280f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:41.586571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054019b9-0f3e-46e0-8f81-e7d264c2280f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:48:41.588200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054019b9-0f3e-46e0-8f81-e7d264c2280f service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:48:41.597476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 748/1514] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:48:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:48:42.393195 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904ac5d-672c-419b-9545-f8c4bb3e7f79 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:42.393735 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904ac5d-672c-419b-9545-f8c4bb3e7f79 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:42.393835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904ac5d-672c-419b-9545-f8c4bb3e7f79 None None] PATH_INFO: `/v3` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:42.395080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 767/1515] 10.222.0.27 () {54 vars in 925 bytes} [Mon Jun 27 18:48:42 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:48:42.425257 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d747601-1b59-45b2-ab8c-01d8bf5b4623 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:42.425715 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d747601-1b59-45b2-ab8c-01d8bf5b4623 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:42.425847 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d747601-1b59-45b2-ab8c-01d8bf5b4623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:42.443439 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-9d747601-1b59-45b2-ab8c-01d8bf5b4623 None None] MFA Rules not processed for user `af6ef16884604753972c916f74271f42`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:48:42.444718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-9d747601-1b59-45b2-ab8c-01d8bf5b4623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:48:42.506516 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 749/1516] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Jun 27 18:48:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:48:46.540808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce4353-46b0-4f07-aa8a-f3af361d8500 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:46.541386 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce4353-46b0-4f07-aa8a-f3af361d8500 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:46.541386 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce4353-46b0-4f07-aa8a-f3af361d8500 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:46.542741 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 768/1517] 10.222.0.36 () {54 vars in 960 bytes} [Mon Jun 27 18:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:48:46.547547 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7760842-73a0-4ffa-843d-3cdb14cab859 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:46.547979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7760842-73a0-4ffa-843d-3cdb14cab859 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:46.548126 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7760842-73a0-4ffa-843d-3cdb14cab859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:46.566062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-d7760842-73a0-4ffa-843d-3cdb14cab859 None None] MFA Rules not processed for user `af6ef16884604753972c916f74271f42`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:48:46.567817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d7760842-73a0-4ffa-843d-3cdb14cab859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:48:46.576107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 750/1518] 10.222.0.36 () {58 vars in 1057 bytes} [Mon Jun 27 18:48:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:48:46.583276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce4353-46b0-4f07-aa8a-f3af361d8500 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:48:46.596229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce4353-46b0-4f07-aa8a-f3af361d8500 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:48:46.601052 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe3381-2326-4830-93a6-1a8ee3f5211b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af6ef16884604753972c916f74271f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:48:46.601668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe3381-2326-4830-93a6-1a8ee3f5211b service placement] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:46.601949 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe3381-2326-4830-93a6-1a8ee3f5211b service placement] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:46.602222 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe3381-2326-4830-93a6-1a8ee3f5211b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:46.610531 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe3381-2326-4830-93a6-1a8ee3f5211b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:48:46.612142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe3381-2326-4830-93a6-1a8ee3f5211b service placement] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:48:46.622055 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 769/1519] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:48:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:48:52.817810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47494a2e-34c9-47a7-97ca-c6663c0016d7 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:52.824547 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47494a2e-34c9-47a7-97ca-c6663c0016d7 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:52.824547 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47494a2e-34c9-47a7-97ca-c6663c0016d7 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:52.824547 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 751/1520] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 18:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:48:52.824847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f605e1-7801-4737-875b-2e133235c72a None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:52.825224 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f605e1-7801-4737-875b-2e133235c72a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:52.825325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f605e1-7801-4737-875b-2e133235c72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:52.842908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-29f605e1-7801-4737-875b-2e133235c72a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:48:52.844173 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-29f605e1-7801-4737-875b-2e133235c72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:48:52.852488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 770/1521] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 18:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:48:53.004363 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47494a2e-34c9-47a7-97ca-c6663c0016d7 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:48:53.018247 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47494a2e-34c9-47a7-97ca-c6663c0016d7 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:48:53.024069 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b268fac5-0708-4046-849c-e793eb37019e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:48:53.024697 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268fac5-0708-4046-849c-e793eb37019e service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:53.024979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268fac5-0708-4046-849c-e793eb37019e service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:53.025252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b268fac5-0708-4046-849c-e793eb37019e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:53.033212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268fac5-0708-4046-849c-e793eb37019e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:48:53.036357 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b268fac5-0708-4046-849c-e793eb37019e service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:48:53.044750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 752/1522] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:48:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:48:53.861006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd12b3-fe81-4466-ac83-9db2c5e03727 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:53.861542 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd12b3-fe81-4466-ac83-9db2c5e03727 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:53.861669 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd12b3-fe81-4466-ac83-9db2c5e03727 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:53.862935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 771/1523] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jun 27 18:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:48:53.867686 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10100d-a8a5-4de2-b053-8eb8661d1d99 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:53.868119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10100d-a8a5-4de2-b053-8eb8661d1d99 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:53.868256 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10100d-a8a5-4de2-b053-8eb8661d1d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:53.886046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-3b10100d-a8a5-4de2-b053-8eb8661d1d99 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:48:53.887231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3b10100d-a8a5-4de2-b053-8eb8661d1d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:48:53.894799 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 753/1524] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jun 27 18:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:48:54.045149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd12b3-fe81-4466-ac83-9db2c5e03727 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:48:54.059001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd12b3-fe81-4466-ac83-9db2c5e03727 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:48:54.064305 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e71e4c-4f8a-4463-984c-6c3f3e5c7f47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:48:54.064930 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e71e4c-4f8a-4463-984c-6c3f3e5c7f47 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:54.065210 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e71e4c-4f8a-4463-984c-6c3f3e5c7f47 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:54.065481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e71e4c-4f8a-4463-984c-6c3f3e5c7f47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:54.073853 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e71e4c-4f8a-4463-984c-6c3f3e5c7f47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:48:54.075410 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e71e4c-4f8a-4463-984c-6c3f3e5c7f47 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:48:54.085173 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 772/1525] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:48:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:48:57.972008 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b092e-860f-4da8-996f-3080a72bf276 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:57.972621 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b092e-860f-4da8-996f-3080a72bf276 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:57.972621 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008b092e-860f-4da8-996f-3080a72bf276 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:57.973958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 754/1526] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 18:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:48:57.979488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072af671-2d3f-4d1b-94b5-195c65ac31c8 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:57.979938 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072af671-2d3f-4d1b-94b5-195c65ac31c8 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:57.980082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072af671-2d3f-4d1b-94b5-195c65ac31c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:57.997714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-072af671-2d3f-4d1b-94b5-195c65ac31c8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:48:57.998894 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-072af671-2d3f-4d1b-94b5-195c65ac31c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:48:58.007336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 773/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 18:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:48:58.043557 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b092e-860f-4da8-996f-3080a72bf276 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:48:58.045250 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-008b092e-860f-4da8-996f-3080a72bf276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:48:58.101889 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008b092e-860f-4da8-996f-3080a72bf276 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:48:58.105661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28716582-2b95-4605-aee2-d88be1586141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:48:58.106290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28716582-2b95-4605-aee2-d88be1586141 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:48:58.106570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28716582-2b95-4605-aee2-d88be1586141 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:48:58.106845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28716582-2b95-4605-aee2-d88be1586141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:48:58.115433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28716582-2b95-4605-aee2-d88be1586141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:48:58.116871 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28716582-2b95-4605-aee2-d88be1586141 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:48:58.121635 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:48:58.126172 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 755/1528] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:49:00.137660 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15807bf4-2509-4296-b88e-265843f1d053 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:49:00.138229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15807bf4-2509-4296-b88e-265843f1d053 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:49:00.138229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15807bf4-2509-4296-b88e-265843f1d053 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:49:00.139497 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 774/1529] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 18:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:49:00.144832 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa5bf-fb13-43f4-b5ad-7661402c2d4c None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:49:00.145302 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa5bf-fb13-43f4-b5ad-7661402c2d4c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:49:00.145406 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa5bf-fb13-43f4-b5ad-7661402c2d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:49:00.164656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-3c9aa5bf-fb13-43f4-b5ad-7661402c2d4c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:49:00.165832 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3c9aa5bf-fb13-43f4-b5ad-7661402c2d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:49:00.173602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 756/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 18:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:49:00.210898 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15807bf4-2509-4296-b88e-265843f1d053 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:49:00.221463 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15807bf4-2509-4296-b88e-265843f1d053 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:49:00.225510 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20483a-8d58-4676-87a7-d1a2a81e523c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:49:00.227859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20483a-8d58-4676-87a7-d1a2a81e523c service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:49:00.227859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20483a-8d58-4676-87a7-d1a2a81e523c service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:49:00.227859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20483a-8d58-4676-87a7-d1a2a81e523c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:49:00.235627 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20483a-8d58-4676-87a7-d1a2a81e523c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:49:00.237164 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20483a-8d58-4676-87a7-d1a2a81e523c service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:49:00.247068 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 775/1531] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:49:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:49:03.768987 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b9783-b5f9-4c96-bbea-300489899ab3 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:49:03.770083 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b9783-b5f9-4c96-bbea-300489899ab3 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:49:03.770083 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b9783-b5f9-4c96-bbea-300489899ab3 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:49:03.771445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 757/1532] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 18:49:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:49:03.776696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef3da6-e07e-4c21-b739-30275d1d4add None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:49:03.777156 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef3da6-e07e-4c21-b739-30275d1d4add None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:49:03.777273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef3da6-e07e-4c21-b739-30275d1d4add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:49:03.795827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-bbef3da6-e07e-4c21-b739-30275d1d4add None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:49:03.797052 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-bbef3da6-e07e-4c21-b739-30275d1d4add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:49:03.805095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 776/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 18:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:49:04.108191 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b9783-b5f9-4c96-bbea-300489899ab3 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:49:04.109866 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c60b9783-b5f9-4c96-bbea-300489899ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:49:04.166632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b9783-b5f9-4c96-bbea-300489899ab3 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:49:04.170161 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c87c14-00e9-43ac-b9b6-f85876669ad7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:49:04.170801 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c87c14-00e9-43ac-b9b6-f85876669ad7 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:49:04.171089 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c87c14-00e9-43ac-b9b6-f85876669ad7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:49:04.171370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c87c14-00e9-43ac-b9b6-f85876669ad7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:49:04.180327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c87c14-00e9-43ac-b9b6-f85876669ad7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:49:04.181752 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c87c14-00e9-43ac-b9b6-f85876669ad7 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:49:04.191725 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 758/1534] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:49:06.246507 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a133b7f-733a-4f48-a122-1f144aa9faf3 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:49:06.247054 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a133b7f-733a-4f48-a122-1f144aa9faf3 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:49:06.247152 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a133b7f-733a-4f48-a122-1f144aa9faf3 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:49:06.248538 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 777/1535] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jun 27 18:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:49:06.254366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58239b19-d70e-4fd2-bb01-c71844d20f9e None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:49:06.254799 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58239b19-d70e-4fd2-bb01-c71844d20f9e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:49:06.254934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58239b19-d70e-4fd2-bb01-c71844d20f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:49:06.273595 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-58239b19-d70e-4fd2-bb01-c71844d20f9e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:49:06.274802 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-58239b19-d70e-4fd2-bb01-c71844d20f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:49:06.282566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 759/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jun 27 18:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:49:06.583722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a133b7f-733a-4f48-a122-1f144aa9faf3 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:49:06.585367 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2a133b7f-733a-4f48-a122-1f144aa9faf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:49:06.598025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a133b7f-733a-4f48-a122-1f144aa9faf3 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:49:06.601544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada9d51-2907-407f-ba6d-3fb530c467f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:49:06.602172 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada9d51-2907-407f-ba6d-3fb530c467f9 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:49:06.602458 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada9d51-2907-407f-ba6d-3fb530c467f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:49:06.602738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada9d51-2907-407f-ba6d-3fb530c467f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:49:06.611634 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada9d51-2907-407f-ba6d-3fb530c467f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:49:06.613064 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada9d51-2907-407f-ba6d-3fb530c467f9 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:49:06.622176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 778/1537] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:49:16.267831 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=32 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:49:16.618096 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=70 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:39.333509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5ffd6-ad4a-4a83-b47c-dc9f3d856711 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.334188 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5ffd6-ad4a-4a83-b47c-dc9f3d856711 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.334188 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5ffd6-ad4a-4a83-b47c-dc9f3d856711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.359929 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-5cd5ffd6-ad4a-4a83-b47c-dc9f3d856711 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:39.361341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5cd5ffd6-ad4a-4a83-b47c-dc9f3d856711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:39.376396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 760/1538] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:50:39.386133 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343bfed-6f3f-42df-95fd-5fec76e7e3f3 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.386781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343bfed-6f3f-42df-95fd-5fec76e7e3f3 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.386781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343bfed-6f3f-42df-95fd-5fec76e7e3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.412987 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-c343bfed-6f3f-42df-95fd-5fec76e7e3f3 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:39.414476 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-c343bfed-6f3f-42df-95fd-5fec76e7e3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:39.427789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 779/1539] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:39.432874 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5ffd6-ad4a-4a83-b47c-dc9f3d856711 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:39.448523 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0438e5-eed7-4726-a178-8f982a5ef071 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.448896 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0438e5-eed7-4726-a178-8f982a5ef071 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.449077 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0438e5-eed7-4726-a178-8f982a5ef071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.449414 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5ffd6-ad4a-4a83-b47c-dc9f3d856711 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:39.461040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb4151-3e4d-4eb1-adbf-81ca9ea75239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:39.461735 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb4151-3e4d-4eb1-adbf-81ca9ea75239 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.462024 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb4151-3e4d-4eb1-adbf-81ca9ea75239 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.462300 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb4151-3e4d-4eb1-adbf-81ca9ea75239 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.463041 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb4151-3e4d-4eb1-adbf-81ca9ea75239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:50:39.463354 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb4151-3e4d-4eb1-adbf-81ca9ea75239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:39.465049 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb4151-3e4d-4eb1-adbf-81ca9ea75239 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:39.475225 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-1c0438e5-eed7-4726-a178-8f982a5ef071 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:39.476457 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-1c0438e5-eed7-4726-a178-8f982a5ef071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:39.490558 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 780/1540] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:50:39.494171 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 761/1541] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:50:39.501092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2db618-44c9-46d2-acc2-9b995c42d639 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.501548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2db618-44c9-46d2-acc2-9b995c42d639 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.501955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2db618-44c9-46d2-acc2-9b995c42d639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.502830 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb4151-3e4d-4eb1-adbf-81ca9ea75239 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:39.528937 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb4151-3e4d-4eb1-adbf-81ca9ea75239 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:39.535893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-9e2db618-44c9-46d2-acc2-9b995c42d639 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:39.537900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9e2db618-44c9-46d2-acc2-9b995c42d639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:39.546034 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a29122-b828-4352-ab6d-e85f7e63dfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:39.547397 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a29122-b828-4352-ab6d-e85f7e63dfe2 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.547720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a29122-b828-4352-ab6d-e85f7e63dfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.548000 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a29122-b828-4352-ab6d-e85f7e63dfe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.548721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a29122-b828-4352-ab6d-e85f7e63dfe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:39.549750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: WARNING py.warnings [None req-13a29122-b828-4352-ab6d-e85f7e63dfe2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:50:39.549750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: warnings.warn(msg) Jun 27 18:50:39.549750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: Jun 27 18:50:39.550964 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a29122-b828-4352-ab6d-e85f7e63dfe2 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:39.551584 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 781/1542] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:39.556570 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2db618-44c9-46d2-acc2-9b995c42d639 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:39.567423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2db618-44c9-46d2-acc2-9b995c42d639 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:39.579365 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf5284-0959-4c37-be1f-210ccb320a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:39.580208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf5284-0959-4c37-be1f-210ccb320a4e admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.580356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf5284-0959-4c37-be1f-210ccb320a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.580624 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf5284-0959-4c37-be1f-210ccb320a4e admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.581523 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf5284-0959-4c37-be1f-210ccb320a4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:50:39.582425 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf5284-0959-4c37-be1f-210ccb320a4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:39.584012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: WARNING py.warnings [None req-cdbf5284-0959-4c37-be1f-210ccb320a4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:50:39.584012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: warnings.warn(msg) Jun 27 18:50:39.584012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: Jun 27 18:50:39.585065 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf5284-0959-4c37-be1f-210ccb320a4e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:39.604802 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 782/1543] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:50:39.606819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88148698-4baf-4e9c-ae96-e0782dcf2d62 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.607276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88148698-4baf-4e9c-ae96-e0782dcf2d62 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.611907 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88148698-4baf-4e9c-ae96-e0782dcf2d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.636296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-88148698-4baf-4e9c-ae96-e0782dcf2d62 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:39.637876 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-88148698-4baf-4e9c-ae96-e0782dcf2d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:39.650074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 783/1544] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:39.650901 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88148698-4baf-4e9c-ae96-e0782dcf2d62 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:39.663511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88148698-4baf-4e9c-ae96-e0782dcf2d62 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:39.670344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2dd46-795e-4105-80aa-40cf12b5121b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:39.671557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2dd46-795e-4105-80aa-40cf12b5121b admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.672644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2dd46-795e-4105-80aa-40cf12b5121b admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.673166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2dd46-795e-4105-80aa-40cf12b5121b admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.674128 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2dd46-795e-4105-80aa-40cf12b5121b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:39.676935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2dd46-795e-4105-80aa-40cf12b5121b admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:39.678438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 762/1545] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:50:39 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:50:39.680170 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edeb71a-5802-4b41-a414-5dd15614c4ff None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.680464 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edeb71a-5802-4b41-a414-5dd15614c4ff None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.680747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edeb71a-5802-4b41-a414-5dd15614c4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.710817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-7edeb71a-5802-4b41-a414-5dd15614c4ff None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:39.712071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-7edeb71a-5802-4b41-a414-5dd15614c4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:39.772776 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 763/1546] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:39.774576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c7ee1-8055-4234-9250-2ce0361c1a54 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.774865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c7ee1-8055-4234-9250-2ce0361c1a54 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.775144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c7ee1-8055-4234-9250-2ce0361c1a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.798175 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 784/1547] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:50:39 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:39.798838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-8d0c7ee1-8055-4234-9250-2ce0361c1a54 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:39.799652 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5872e31-6fa3-4d1c-8149-17237bc5cb04 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.805402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5872e31-6fa3-4d1c-8149-17237bc5cb04 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.805513 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-8d0c7ee1-8055-4234-9250-2ce0361c1a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:39.805616 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5872e31-6fa3-4d1c-8149-17237bc5cb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.820248 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-a5872e31-6fa3-4d1c-8149-17237bc5cb04 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:39.821452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a5872e31-6fa3-4d1c-8149-17237bc5cb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:39.865195 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 764/1548] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:39.871216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fa5a2-39af-4226-ba5b-3c3dc51aa58e None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.871216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fa5a2-39af-4226-ba5b-3c3dc51aa58e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.871216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fa5a2-39af-4226-ba5b-3c3dc51aa58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.883710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 785/1549] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:39.884760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5872e31-6fa3-4d1c-8149-17237bc5cb04 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:39.885024 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-a71fa5a2-39af-4226-ba5b-3c3dc51aa58e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:39.886283 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-a71fa5a2-39af-4226-ba5b-3c3dc51aa58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:39.894906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 765/1550] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:39.896035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe0d16-7c84-4a90-acb4-94b5a8669ba6 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.896326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe0d16-7c84-4a90-acb4-94b5a8669ba6 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.896618 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe0d16-7c84-4a90-acb4-94b5a8669ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.902019 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5872e31-6fa3-4d1c-8149-17237bc5cb04 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:39.907212 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b926e0-84aa-4760-81ef-31da9eebc3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:39.907936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b926e0-84aa-4760-81ef-31da9eebc3fb admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.908220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b926e0-84aa-4760-81ef-31da9eebc3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.908542 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b926e0-84aa-4760-81ef-31da9eebc3fb admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.909206 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b926e0-84aa-4760-81ef-31da9eebc3fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:39.910223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: WARNING py.warnings [None req-00b926e0-84aa-4760-81ef-31da9eebc3fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:50:39.910223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: warnings.warn(msg) Jun 27 18:50:39.910223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: Jun 27 18:50:39.911445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b926e0-84aa-4760-81ef-31da9eebc3fb admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:39.916042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-8fbe0d16-7c84-4a90-acb4-94b5a8669ba6 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:39.917284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-8fbe0d16-7c84-4a90-acb4-94b5a8669ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:39.926146 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 766/1551] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:39.927363 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72b7fb-aec7-44dc-8cf8-bc5eac069354 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.927707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72b7fb-aec7-44dc-8cf8-bc5eac069354 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.927990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72b7fb-aec7-44dc-8cf8-bc5eac069354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.945172 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-6b72b7fb-aec7-44dc-8cf8-bc5eac069354 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:39.946352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-6b72b7fb-aec7-44dc-8cf8-bc5eac069354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:39.954100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 767/1552] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:39.955280 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6e0d2-2033-4eda-80e0-fc6d2865c4e2 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.955664 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6e0d2-2033-4eda-80e0-fc6d2865c4e2 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.955944 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6e0d2-2033-4eda-80e0-fc6d2865c4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.973325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-81b6e0d2-2033-4eda-80e0-fc6d2865c4e2 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:39.974473 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-81b6e0d2-2033-4eda-80e0-fc6d2865c4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:39.982403 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 768/1553] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:39.983115 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6e0d2-2033-4eda-80e0-fc6d2865c4e2 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:39.992708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6e0d2-2033-4eda-80e0-fc6d2865c4e2 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:39.997112 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a06952-b380-45f0-a6c6-b961eea57568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:39.997742 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a06952-b380-45f0-a6c6-b961eea57568 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:39.998026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a06952-b380-45f0-a6c6-b961eea57568 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:39.998303 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a06952-b380-45f0-a6c6-b961eea57568 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:39.998977 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a06952-b380-45f0-a6c6-b961eea57568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.000961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a06952-b380-45f0-a6c6-b961eea57568 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.007321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 786/1554] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:50:39 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:40.009335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b926e0-84aa-4760-81ef-31da9eebc3fb admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.018989 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b926e0-84aa-4760-81ef-31da9eebc3fb admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.023715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2907a9-4740-4fad-be7a-06f97a3902d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.024361 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2907a9-4740-4fad-be7a-06f97a3902d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.024666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2907a9-4740-4fad-be7a-06f97a3902d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.024992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2907a9-4740-4fad-be7a-06f97a3902d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.025720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2907a9-4740-4fad-be7a-06f97a3902d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:50:40.026031 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2907a9-4740-4fad-be7a-06f97a3902d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.027659 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2907a9-4740-4fad-be7a-06f97a3902d5 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.041233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 787/1555] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:50:40.042538 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05cc85-ab1e-4ca0-bc4a-e1cce447ede5 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.042834 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05cc85-ab1e-4ca0-bc4a-e1cce447ede5 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.043117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05cc85-ab1e-4ca0-bc4a-e1cce447ede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.060844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-9a05cc85-ab1e-4ca0-bc4a-e1cce447ede5 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:40.062058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9a05cc85-ab1e-4ca0-bc4a-e1cce447ede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:40.070042 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 788/1556] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:40.071423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4b4c9-6a65-4c6e-828c-3e28a90c0801 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.071745 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4b4c9-6a65-4c6e-828c-3e28a90c0801 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.072027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4b4c9-6a65-4c6e-828c-3e28a90c0801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.083975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 769/1557] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:50:39 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:40.087608 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c248c5-861a-4d93-a84b-50c5da616e63 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.087608 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c248c5-861a-4d93-a84b-50c5da616e63 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.087608 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c248c5-861a-4d93-a84b-50c5da616e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.090406 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-fbe4b4c9-6a65-4c6e-828c-3e28a90c0801 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:40.091644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-fbe4b4c9-6a65-4c6e-828c-3e28a90c0801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:40.100374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 789/1558] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:40.101295 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4b4c9-6a65-4c6e-828c-3e28a90c0801 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.105881 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-16c248c5-861a-4d93-a84b-50c5da616e63 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:40.107034 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-16c248c5-861a-4d93-a84b-50c5da616e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:40.113491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4b4c9-6a65-4c6e-828c-3e28a90c0801 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.115717 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 770/1559] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:40.117073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fc035-2f63-48d2-826a-ee4d111cda30 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.117365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fc035-2f63-48d2-826a-ee4d111cda30 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.117648 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08fc035-2f63-48d2-826a-ee4d111cda30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.121527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a7324-442f-4766-a3bd-69e5abd624ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.122178 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a7324-442f-4766-a3bd-69e5abd624ee admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.122462 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a7324-442f-4766-a3bd-69e5abd624ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.122741 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a7324-442f-4766-a3bd-69e5abd624ee admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.123473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a7324-442f-4766-a3bd-69e5abd624ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:50:40.123822 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a7324-442f-4766-a3bd-69e5abd624ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.125477 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a7324-442f-4766-a3bd-69e5abd624ee admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.134966 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-c08fc035-2f63-48d2-826a-ee4d111cda30 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:40.136188 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c08fc035-2f63-48d2-826a-ee4d111cda30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:40.137329 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 790/1560] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:50:40.137932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a7324-442f-4766-a3bd-69e5abd624ee admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.148272 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a7324-442f-4766-a3bd-69e5abd624ee admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.150688 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 771/1561] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:40.150688 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fc035-2f63-48d2-826a-ee4d111cda30 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.154466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef5a5e-c9a2-4c4b-9239-d45d5ff2e0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.154466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef5a5e-c9a2-4c4b-9239-d45d5ff2e0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.154466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef5a5e-c9a2-4c4b-9239-d45d5ff2e0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.154466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef5a5e-c9a2-4c4b-9239-d45d5ff2e0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.154893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef5a5e-c9a2-4c4b-9239-d45d5ff2e0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.156638 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:40.157021 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef5a5e-c9a2-4c4b-9239-d45d5ff2e0f7 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.161617 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08fc035-2f63-48d2-826a-ee4d111cda30 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.166183 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d9154-c420-4ea4-ab9f-00e7084d0d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.166852 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d9154-c420-4ea4-ab9f-00e7084d0d86 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.167133 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d9154-c420-4ea4-ab9f-00e7084d0d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.167380 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 791/1562] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:40.167595 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d9154-c420-4ea4-ab9f-00e7084d0d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.168118 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d9154-c420-4ea4-ab9f-00e7084d0d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.168233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef5a5e-c9a2-4c4b-9239-d45d5ff2e0f7 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.170009 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d9154-c420-4ea4-ab9f-00e7084d0d86 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.179635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef5a5e-c9a2-4c4b-9239-d45d5ff2e0f7 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.184400 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3d5bb-ec50-46ee-a72f-4a5e7072349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.190784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3d5bb-ec50-46ee-a72f-4a5e7072349a admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.190784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3d5bb-ec50-46ee-a72f-4a5e7072349a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.190784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3d5bb-ec50-46ee-a72f-4a5e7072349a admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.190784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3d5bb-ec50-46ee-a72f-4a5e7072349a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:50:40.190784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3d5bb-ec50-46ee-a72f-4a5e7072349a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.190784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3d5bb-ec50-46ee-a72f-4a5e7072349a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.200244 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 792/1563] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:50:40.201018 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3d5bb-ec50-46ee-a72f-4a5e7072349a admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.210256 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3d5bb-ec50-46ee-a72f-4a5e7072349a admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.215183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ae114-f46a-4cd8-8333-d4a48c56a5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.215952 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ae114-f46a-4cd8-8333-d4a48c56a5fe admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.216236 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ae114-f46a-4cd8-8333-d4a48c56a5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.216516 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3ae114-f46a-4cd8-8333-d4a48c56a5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.217225 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ae114-f46a-4cd8-8333-d4a48c56a5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.219346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3ae114-f46a-4cd8-8333-d4a48c56a5fe admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.229569 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 793/1564] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:40.230322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ae114-f46a-4cd8-8333-d4a48c56a5fe admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.240151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3ae114-f46a-4cd8-8333-d4a48c56a5fe admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.244702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c206a-2fca-4485-bbf3-ad7e4dc7939e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.248278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c206a-2fca-4485-bbf3-ad7e4dc7939e admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.248278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c206a-2fca-4485-bbf3-ad7e4dc7939e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.248278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c206a-2fca-4485-bbf3-ad7e4dc7939e admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.248278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c206a-2fca-4485-bbf3-ad7e4dc7939e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:50:40.248278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c206a-2fca-4485-bbf3-ad7e4dc7939e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.248716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c206a-2fca-4485-bbf3-ad7e4dc7939e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.249860 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:40.260513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 794/1565] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:50:40.261261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c206a-2fca-4485-bbf3-ad7e4dc7939e admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.270834 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c206a-2fca-4485-bbf3-ad7e4dc7939e admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.275524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21f1a4-28d8-4b4d-b855-dfa99b8d51fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.276175 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21f1a4-28d8-4b4d-b855-dfa99b8d51fe admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.276596 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21f1a4-28d8-4b4d-b855-dfa99b8d51fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.280052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 772/1566] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:50:40 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:40.280199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21f1a4-28d8-4b4d-b855-dfa99b8d51fe admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.280199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21f1a4-28d8-4b4d-b855-dfa99b8d51fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:50:40.280372 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d9154-c420-4ea4-ab9f-00e7084d0d86 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.280482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21f1a4-28d8-4b4d-b855-dfa99b8d51fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.280482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b21f1a4-28d8-4b4d-b855-dfa99b8d51fe admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.291720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 795/1567] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:50:40.292563 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21f1a4-28d8-4b4d-b855-dfa99b8d51fe admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.302072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b21f1a4-28d8-4b4d-b855-dfa99b8d51fe admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.349558 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d9154-c420-4ea4-ab9f-00e7084d0d86 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.354624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22db05-c3f1-401f-bc40-57238ce3f9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.355279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22db05-c3f1-401f-bc40-57238ce3f9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.355595 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22db05-c3f1-401f-bc40-57238ce3f9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.355876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b22db05-c3f1-401f-bc40-57238ce3f9c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.356702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22db05-c3f1-401f-bc40-57238ce3f9c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.358326 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86719bce-30d5-4090-bf2d-55931e968cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.358592 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b22db05-c3f1-401f-bc40-57238ce3f9c0 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.358985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86719bce-30d5-4090-bf2d-55931e968cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.359271 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86719bce-30d5-4090-bf2d-55931e968cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.359576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86719bce-30d5-4090-bf2d-55931e968cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.360331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86719bce-30d5-4090-bf2d-55931e968cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:50:40.360643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86719bce-30d5-4090-bf2d-55931e968cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.362276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86719bce-30d5-4090-bf2d-55931e968cd0 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.374222 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 796/1568] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:50:40.375021 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86719bce-30d5-4090-bf2d-55931e968cd0 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.384464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86719bce-30d5-4090-bf2d-55931e968cd0 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.388979 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c813ba-b940-4ead-9ec8-14c0883bb641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.389588 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c813ba-b940-4ead-9ec8-14c0883bb641 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.389877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c813ba-b940-4ead-9ec8-14c0883bb641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.390156 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c813ba-b940-4ead-9ec8-14c0883bb641 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.391357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c813ba-b940-4ead-9ec8-14c0883bb641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.392958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c813ba-b940-4ead-9ec8-14c0883bb641 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.403407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 797/1569] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:40.404626 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c813ba-b940-4ead-9ec8-14c0883bb641 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.414253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c813ba-b940-4ead-9ec8-14c0883bb641 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.418795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc2a6b-387f-46aa-995f-8dd1c7ce76f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.419431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc2a6b-387f-46aa-995f-8dd1c7ce76f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.420020 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc2a6b-387f-46aa-995f-8dd1c7ce76f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.420302 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc2a6b-387f-46aa-995f-8dd1c7ce76f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.420961 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc2a6b-387f-46aa-995f-8dd1c7ce76f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.422833 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc2a6b-387f-46aa-995f-8dd1c7ce76f6 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.431146 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 773/1570] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:50:40 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:40.431146 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22db05-c3f1-401f-bc40-57238ce3f9c0 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.491809 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b22db05-c3f1-401f-bc40-57238ce3f9c0 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.496405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266c873-7e09-411e-a749-e8495fc8222d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.497057 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266c873-7e09-411e-a749-e8495fc8222d admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.497340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266c873-7e09-411e-a749-e8495fc8222d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.497613 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266c873-7e09-411e-a749-e8495fc8222d admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.498333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266c873-7e09-411e-a749-e8495fc8222d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.500030 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266c873-7e09-411e-a749-e8495fc8222d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.509721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 774/1571] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:40.510947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266c873-7e09-411e-a749-e8495fc8222d admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.511952 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 798/1572] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:50:40 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:40.514639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc2a6b-387f-46aa-995f-8dd1c7ce76f6 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.524615 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266c873-7e09-411e-a749-e8495fc8222d admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.574020 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc2a6b-387f-46aa-995f-8dd1c7ce76f6 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.579101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c3b12-a57b-4f2e-9cbe-2868cf839206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.579799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c3b12-a57b-4f2e-9cbe-2868cf839206 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.580086 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c3b12-a57b-4f2e-9cbe-2868cf839206 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.580364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012c3b12-a57b-4f2e-9cbe-2868cf839206 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.581086 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c3b12-a57b-4f2e-9cbe-2868cf839206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.581502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d9193-3ac3-4975-b95f-579ad7bcaed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.582165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9193-3ac3-4975-b95f-579ad7bcaed9 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.582541 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9193-3ac3-4975-b95f-579ad7bcaed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.582821 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9193-3ac3-4975-b95f-579ad7bcaed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.583007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012c3b12-a57b-4f2e-9cbe-2868cf839206 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.583508 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d9193-3ac3-4975-b95f-579ad7bcaed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.585465 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d9193-3ac3-4975-b95f-579ad7bcaed9 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.589967 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:40.686090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 799/1573] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:50:40 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:40.686090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c3b12-a57b-4f2e-9cbe-2868cf839206 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.686398 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 775/1574] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:50:40 2022] POST /identity/v3/projects => generated 393 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:40.686398 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d9193-3ac3-4975-b95f-579ad7bcaed9 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.696870 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012c3b12-a57b-4f2e-9cbe-2868cf839206 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.726444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:40.748518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d9193-3ac3-4975-b95f-579ad7bcaed9 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.753703 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c38a80-c505-4b79-b0ee-d012e694018d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.754367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c38a80-c505-4b79-b0ee-d012e694018d admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.754653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c38a80-c505-4b79-b0ee-d012e694018d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.754933 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c38a80-c505-4b79-b0ee-d012e694018d admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.755737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c38a80-c505-4b79-b0ee-d012e694018d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.755861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec51e3-a1dc-48ae-bc40-b89ded1a987c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.756458 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec51e3-a1dc-48ae-bc40-b89ded1a987c admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.756938 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec51e3-a1dc-48ae-bc40-b89ded1a987c admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.757405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec51e3-a1dc-48ae-bc40-b89ded1a987c admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.758044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c38a80-c505-4b79-b0ee-d012e694018d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.758477 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec51e3-a1dc-48ae-bc40-b89ded1a987c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.760454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec51e3-a1dc-48ae-bc40-b89ded1a987c admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.872847 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 776/1575] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:50:40 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:40.873659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c38a80-c505-4b79-b0ee-d012e694018d admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.896565 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 800/1576] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:50:40 2022] POST /identity/v3/projects => generated 403 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:40.900492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec51e3-a1dc-48ae-bc40-b89ded1a987c admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:40.938692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c38a80-c505-4b79-b0ee-d012e694018d admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.958763 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec51e3-a1dc-48ae-bc40-b89ded1a987c admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:40.963415 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a425f7-3b80-477b-b7b2-e69df60e60ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.964104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a425f7-3b80-477b-b7b2-e69df60e60ea admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.964390 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a425f7-3b80-477b-b7b2-e69df60e60ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.964677 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a425f7-3b80-477b-b7b2-e69df60e60ea admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:40.965365 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a425f7-3b80-477b-b7b2-e69df60e60ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:40.967311 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a425f7-3b80-477b-b7b2-e69df60e60ea admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:40.993256 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714de4a8-8ba1-4c93-a220-b540c72f8574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:40.994166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714de4a8-8ba1-4c93-a220-b540c72f8574 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:40.994477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714de4a8-8ba1-4c93-a220-b540c72f8574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:40.994752 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714de4a8-8ba1-4c93-a220-b540c72f8574 admin admin] PATH_INFO: `/v3/projects/991f84dedd5a46108574c5b121634db0/users/ded25521da0d425ea95e7763d7161ff4/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.008832 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714de4a8-8ba1-4c93-a220-b540c72f8574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=991f84dedd5a46108574c5b121634db0, user_id=ded25521da0d425ea95e7763d7161ff4, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.009857 dv-cinder-844601-6-smb devstack@keystone.service[86870]: WARNING py.warnings [None req-714de4a8-8ba1-4c93-a220-b540c72f8574 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:50:41.009857 dv-cinder-844601-6-smb devstack@keystone.service[86870]: warnings.warn(msg) Jun 27 18:50:41.009857 dv-cinder-844601-6-smb devstack@keystone.service[86870]: Jun 27 18:50:41.011871 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714de4a8-8ba1-4c93-a220-b540c72f8574 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.026337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 801/1577] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:50:40 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:41.027158 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a425f7-3b80-477b-b7b2-e69df60e60ea admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.036455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a425f7-3b80-477b-b7b2-e69df60e60ea admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.041036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045a782-833b-4250-91d2-31534df0326f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.041890 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045a782-833b-4250-91d2-31534df0326f admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.042200 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045a782-833b-4250-91d2-31534df0326f admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.042474 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045a782-833b-4250-91d2-31534df0326f admin admin] PATH_INFO: `/v3/projects/ebb63d35730e4bb792eae0d0f8e6bb38/users/f455a84e20834cec8b84aa88ef263b56/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.057390 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045a782-833b-4250-91d2-31534df0326f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb63d35730e4bb792eae0d0f8e6bb38, user_id=f455a84e20834cec8b84aa88ef263b56, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.060191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045a782-833b-4250-91d2-31534df0326f admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.116202 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 777/1578] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:50:40 2022] PUT /identity/v3/projects/991f84dedd5a46108574c5b121634db0/users/ded25521da0d425ea95e7763d7161ff4/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:41.117007 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714de4a8-8ba1-4c93-a220-b540c72f8574 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.120838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:41.144294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 802/1579] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:50:41 2022] PUT /identity/v3/projects/ebb63d35730e4bb792eae0d0f8e6bb38/users/f455a84e20834cec8b84aa88ef263b56/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:41.147214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045a782-833b-4250-91d2-31534df0326f admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.182109 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714de4a8-8ba1-4c93-a220-b540c72f8574 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.207664 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045a782-833b-4250-91d2-31534df0326f admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.212585 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b0628-ea72-4930-a2c6-0dc892e5667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.215965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b0628-ea72-4930-a2c6-0dc892e5667b admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.215965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b0628-ea72-4930-a2c6-0dc892e5667b admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.215965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b0628-ea72-4930-a2c6-0dc892e5667b admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.215965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b0628-ea72-4930-a2c6-0dc892e5667b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.216353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b0628-ea72-4930-a2c6-0dc892e5667b admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.226524 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 803/1580] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:41.227303 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b0628-ea72-4930-a2c6-0dc892e5667b admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.237852 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b0628-ea72-4930-a2c6-0dc892e5667b admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.242117 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d658a5-4f29-4025-8573-8a1bf526f05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.242416 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550ce68-0617-44cf-bdc0-5f6b1b6cdc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.242793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d658a5-4f29-4025-8573-8a1bf526f05f admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.243046 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550ce68-0617-44cf-bdc0-5f6b1b6cdc25 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.243147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d658a5-4f29-4025-8573-8a1bf526f05f admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.243326 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550ce68-0617-44cf-bdc0-5f6b1b6cdc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.243424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d658a5-4f29-4025-8573-8a1bf526f05f admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.243634 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550ce68-0617-44cf-bdc0-5f6b1b6cdc25 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.244086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d658a5-4f29-4025-8573-8a1bf526f05f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.244301 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550ce68-0617-44cf-bdc0-5f6b1b6cdc25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.246058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d658a5-4f29-4025-8573-8a1bf526f05f admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.246194 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550ce68-0617-44cf-bdc0-5f6b1b6cdc25 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.344887 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 778/1581] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:50:41 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:41.346041 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d658a5-4f29-4025-8573-8a1bf526f05f admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.347995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:41.352679 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 804/1582] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:50:41 2022] POST /identity/v3/users => generated 297 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:41.353684 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550ce68-0617-44cf-bdc0-5f6b1b6cdc25 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.356649 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d658a5-4f29-4025-8573-8a1bf526f05f admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.361872 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc05d4-294e-4e47-9855-73e034f48784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.362532 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc05d4-294e-4e47-9855-73e034f48784 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.362818 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc05d4-294e-4e47-9855-73e034f48784 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.363099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc05d4-294e-4e47-9855-73e034f48784 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.363893 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc05d4-294e-4e47-9855-73e034f48784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.363994 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550ce68-0617-44cf-bdc0-5f6b1b6cdc25 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.365904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc05d4-294e-4e47-9855-73e034f48784 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.368566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7567b-620e-4be8-b729-1611d91460d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.369215 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7567b-620e-4be8-b729-1611d91460d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.369496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7567b-620e-4be8-b729-1611d91460d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.369772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7567b-620e-4be8-b729-1611d91460d5 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.370485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7567b-620e-4be8-b729-1611d91460d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.372497 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7567b-620e-4be8-b729-1611d91460d5 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.454627 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 805/1583] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:50:41 2022] POST /identity/v3/users => generated 302 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:41.455307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 779/1584] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:50:41 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:41.458450 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7567b-620e-4be8-b729-1611d91460d5 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.459073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7abef-f3cc-4fb5-8e26-8d0191e50137 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.459370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7abef-f3cc-4fb5-8e26-8d0191e50137 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.459680 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e7abef-f3cc-4fb5-8e26-8d0191e50137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.469762 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7567b-620e-4be8-b729-1611d91460d5 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.476864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a69dce-5eb3-4018-9e36-1bc1aa71d407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.476864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a69dce-5eb3-4018-9e36-1bc1aa71d407 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.476864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a69dce-5eb3-4018-9e36-1bc1aa71d407 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.476864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a69dce-5eb3-4018-9e36-1bc1aa71d407 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.477223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a69dce-5eb3-4018-9e36-1bc1aa71d407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.477303 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-52e7abef-f3cc-4fb5-8e26-8d0191e50137 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:41.478044 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a69dce-5eb3-4018-9e36-1bc1aa71d407 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.478161 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-52e7abef-f3cc-4fb5-8e26-8d0191e50137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:41.486410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 780/1585] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:41.487656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e7c01-e9f2-4110-a787-5b60e7959982 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.487957 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e7c01-e9f2-4110-a787-5b60e7959982 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.488233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e7c01-e9f2-4110-a787-5b60e7959982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.493767 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 806/1586] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:41.494679 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a69dce-5eb3-4018-9e36-1bc1aa71d407 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.503983 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a69dce-5eb3-4018-9e36-1bc1aa71d407 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.508497 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe6a87-9a70-4800-a569-240b2a5a6b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.509138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe6a87-9a70-4800-a569-240b2a5a6b19 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.509416 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe6a87-9a70-4800-a569-240b2a5a6b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.509686 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe6a87-9a70-4800-a569-240b2a5a6b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.510290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-bc0e7c01-e9f2-4110-a787-5b60e7959982 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:41.510421 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe6a87-9a70-4800-a569-240b2a5a6b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.511666 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-bc0e7c01-e9f2-4110-a787-5b60e7959982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:41.512007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe6a87-9a70-4800-a569-240b2a5a6b19 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.521070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 781/1587] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:41.521985 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e7c01-e9f2-4110-a787-5b60e7959982 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.522270 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 807/1588] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:41.523079 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe6a87-9a70-4800-a569-240b2a5a6b19 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.534522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e7c01-e9f2-4110-a787-5b60e7959982 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.536130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe6a87-9a70-4800-a569-240b2a5a6b19 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.539299 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c297b-5992-49ef-8e92-36b6d03b9262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.540038 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c297b-5992-49ef-8e92-36b6d03b9262 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.540327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c297b-5992-49ef-8e92-36b6d03b9262 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.540611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c297b-5992-49ef-8e92-36b6d03b9262 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.541074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2573d-476f-48f2-a3c9-8ed354a64e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.541347 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c297b-5992-49ef-8e92-36b6d03b9262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.541728 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2573d-476f-48f2-a3c9-8ed354a64e86 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.542008 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2573d-476f-48f2-a3c9-8ed354a64e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.542281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c2573d-476f-48f2-a3c9-8ed354a64e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.543001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2573d-476f-48f2-a3c9-8ed354a64e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.543191 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c297b-5992-49ef-8e92-36b6d03b9262 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.544600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c2573d-476f-48f2-a3c9-8ed354a64e86 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.554287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 782/1589] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:41.554939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c297b-5992-49ef-8e92-36b6d03b9262 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.556732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 808/1590] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:41.557726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2573d-476f-48f2-a3c9-8ed354a64e86 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.564545 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c297b-5992-49ef-8e92-36b6d03b9262 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.569227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8086b-9574-427f-a2eb-ccbaeb5f3d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.569799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c2573d-476f-48f2-a3c9-8ed354a64e86 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.569982 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8086b-9574-427f-a2eb-ccbaeb5f3d37 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.570285 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8086b-9574-427f-a2eb-ccbaeb5f3d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.570555 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f8086b-9574-427f-a2eb-ccbaeb5f3d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.571297 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8086b-9574-427f-a2eb-ccbaeb5f3d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.572899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f8086b-9574-427f-a2eb-ccbaeb5f3d37 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.574837 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a59d25-05cf-4d7e-a5ac-1a69ebc4aa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.575591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a59d25-05cf-4d7e-a5ac-1a69ebc4aa02 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.575882 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a59d25-05cf-4d7e-a5ac-1a69ebc4aa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.576160 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a59d25-05cf-4d7e-a5ac-1a69ebc4aa02 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.576882 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a59d25-05cf-4d7e-a5ac-1a69ebc4aa02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.578495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a59d25-05cf-4d7e-a5ac-1a69ebc4aa02 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.583385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 783/1591] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:41.584036 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8086b-9574-427f-a2eb-ccbaeb5f3d37 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.594397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 809/1592] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:41.594397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a59d25-05cf-4d7e-a5ac-1a69ebc4aa02 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.602064 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a59d25-05cf-4d7e-a5ac-1a69ebc4aa02 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.606920 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48503d-9bb7-4bf7-8fef-5edb1544798a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.607573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48503d-9bb7-4bf7-8fef-5edb1544798a admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.607863 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48503d-9bb7-4bf7-8fef-5edb1544798a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.608138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48503d-9bb7-4bf7-8fef-5edb1544798a admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.608875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48503d-9bb7-4bf7-8fef-5edb1544798a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.611006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b48503d-9bb7-4bf7-8fef-5edb1544798a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.621042 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 810/1593] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:41.621784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48503d-9bb7-4bf7-8fef-5edb1544798a admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.631216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48503d-9bb7-4bf7-8fef-5edb1544798a admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.635847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69391173-16a2-45f6-87b8-da79cfa5af11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.636838 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69391173-16a2-45f6-87b8-da79cfa5af11 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.637119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69391173-16a2-45f6-87b8-da79cfa5af11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.637394 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69391173-16a2-45f6-87b8-da79cfa5af11 admin admin] PATH_INFO: `/v3/projects/3f3cbfa562e2469298db2c1f810d767b/users/98c0d19387594287b31a8976870b53a6/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.638895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:41.643836 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f8086b-9574-427f-a2eb-ccbaeb5f3d37 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.655426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171469d-0557-4398-aa1c-7e91704aea0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.655426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171469d-0557-4398-aa1c-7e91704aea0c service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.655426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171469d-0557-4398-aa1c-7e91704aea0c service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.655426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171469d-0557-4398-aa1c-7e91704aea0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.656559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69391173-16a2-45f6-87b8-da79cfa5af11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3cbfa562e2469298db2c1f810d767b, user_id=98c0d19387594287b31a8976870b53a6, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.656559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69391173-16a2-45f6-87b8-da79cfa5af11 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.658173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171469d-0557-4398-aa1c-7e91704aea0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.659643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171469d-0557-4398-aa1c-7e91704aea0c service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.669062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 784/1594] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:50:41.669840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171469d-0557-4398-aa1c-7e91704aea0c service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.678788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171469d-0557-4398-aa1c-7e91704aea0c service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.682516 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aed480-c848-4b90-b60d-5883887ca929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.683136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aed480-c848-4b90-b60d-5883887ca929 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.683423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aed480-c848-4b90-b60d-5883887ca929 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.683736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aed480-c848-4b90-b60d-5883887ca929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.692856 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aed480-c848-4b90-b60d-5883887ca929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.700351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aed480-c848-4b90-b60d-5883887ca929 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.703623 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 785/1595] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:50:41.704387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aed480-c848-4b90-b60d-5883887ca929 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.713175 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aed480-c848-4b90-b60d-5883887ca929 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.717887 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf4776-8196-43dd-a627-643d8cf19592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.719060 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4776-8196-43dd-a627-643d8cf19592 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.730307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4776-8196-43dd-a627-643d8cf19592 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.730307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4776-8196-43dd-a627-643d8cf19592 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.730307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf4776-8196-43dd-a627-643d8cf19592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.730307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf4776-8196-43dd-a627-643d8cf19592 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.732246 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 786/1596] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:41.733054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf4776-8196-43dd-a627-643d8cf19592 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.742817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf4776-8196-43dd-a627-643d8cf19592 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.747284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a5d0c-d355-4294-a92c-46f1a8a4d71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.747924 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a5d0c-d355-4294-a92c-46f1a8a4d71a admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.748214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a5d0c-d355-4294-a92c-46f1a8a4d71a admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.748555 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a5d0c-d355-4294-a92c-46f1a8a4d71a admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.749258 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a5d0c-d355-4294-a92c-46f1a8a4d71a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.750970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a5d0c-d355-4294-a92c-46f1a8a4d71a admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.756899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 811/1597] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:50:41 2022] PUT /identity/v3/projects/3f3cbfa562e2469298db2c1f810d767b/users/98c0d19387594287b31a8976870b53a6/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:41.757995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69391173-16a2-45f6-87b8-da79cfa5af11 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.764870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 787/1598] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:41.764870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a5d0c-d355-4294-a92c-46f1a8a4d71a admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.785845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a5d0c-d355-4294-a92c-46f1a8a4d71a admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.830817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69391173-16a2-45f6-87b8-da79cfa5af11 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.837557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae689de-e0ca-430c-9660-77132b888c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.838674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae689de-e0ca-430c-9660-77132b888c52 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.839090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae689de-e0ca-430c-9660-77132b888c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.839387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae689de-e0ca-430c-9660-77132b888c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.840605 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae689de-e0ca-430c-9660-77132b888c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.849693 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae689de-e0ca-430c-9660-77132b888c52 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.849937 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33665645-bed9-4d4c-b930-037e9065dabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.849937 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33665645-bed9-4d4c-b930-037e9065dabd admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.849937 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33665645-bed9-4d4c-b930-037e9065dabd admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.849937 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33665645-bed9-4d4c-b930-037e9065dabd admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.850255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33665645-bed9-4d4c-b930-037e9065dabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.850255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33665645-bed9-4d4c-b930-037e9065dabd admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.858852 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 812/1599] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:41.858852 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae689de-e0ca-430c-9660-77132b888c52 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.862749 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 788/1600] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:41.863678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33665645-bed9-4d4c-b930-037e9065dabd admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:41.870331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae689de-e0ca-430c-9660-77132b888c52 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.873442 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33665645-bed9-4d4c-b930-037e9065dabd admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:41.876443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f016f-493a-4bc1-97e3-523a458bffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.877720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f016f-493a-4bc1-97e3-523a458bffa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.884079 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f016f-493a-4bc1-97e3-523a458bffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.884200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d45887-965d-4706-9b45-e3d9854ea99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:41.884313 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f016f-493a-4bc1-97e3-523a458bffa1 admin admin] PATH_INFO: `/v3/projects/856a7585f5494ac88071e74b5c726b28/users/bcd6e81cae8042b6a4a90b6851ab583d/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.884422 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d45887-965d-4706-9b45-e3d9854ea99b admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:41.884422 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d45887-965d-4706-9b45-e3d9854ea99b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:41.884422 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d45887-965d-4706-9b45-e3d9854ea99b admin admin] PATH_INFO: `/v3/projects/e261e06be6d94e129de3957985cb0ecd/users/798c13c87b814d1182c6df3b29ec5986/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:41.895687 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d45887-965d-4706-9b45-e3d9854ea99b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e261e06be6d94e129de3957985cb0ecd, user_id=798c13c87b814d1182c6df3b29ec5986, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.898065 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d45887-965d-4706-9b45-e3d9854ea99b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:41.899467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f016f-493a-4bc1-97e3-523a458bffa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=856a7585f5494ac88071e74b5c726b28, user_id=bcd6e81cae8042b6a4a90b6851ab583d, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:41.903326 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f016f-493a-4bc1-97e3-523a458bffa1 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:42.002503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 789/1601] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:50:41 2022] PUT /identity/v3/projects/e261e06be6d94e129de3957985cb0ecd/users/798c13c87b814d1182c6df3b29ec5986/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:42.013394 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 813/1602] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:50:41 2022] PUT /identity/v3/projects/856a7585f5494ac88071e74b5c726b28/users/bcd6e81cae8042b6a4a90b6851ab583d/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:42.013795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bd3b7-5611-4a8e-b3ef-13b289fbe524 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:42.013795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bd3b7-5611-4a8e-b3ef-13b289fbe524 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:42.014005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f016f-493a-4bc1-97e3-523a458bffa1 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:42.014097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bd3b7-5611-4a8e-b3ef-13b289fbe524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:42.030478 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-798bd3b7-5611-4a8e-b3ef-13b289fbe524 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:42.032747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-798bd3b7-5611-4a8e-b3ef-13b289fbe524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:42.075967 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:42.106807 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f016f-493a-4bc1-97e3-523a458bffa1 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:42.107794 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 790/1603] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:42.108853 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bd3b7-5611-4a8e-b3ef-13b289fbe524 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:42.115193 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362679e-420c-442a-b7b5-a0b495ece36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:42.116239 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362679e-420c-442a-b7b5-a0b495ece36a admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:42.116706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362679e-420c-442a-b7b5-a0b495ece36a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:42.117054 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362679e-420c-442a-b7b5-a0b495ece36a admin admin] PATH_INFO: `/v3/projects/7279325b304d4011a77435f338b63ca3/users/89794cd59f4d44318aff08fe38de3dc5/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:42.131946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bd3b7-5611-4a8e-b3ef-13b289fbe524 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:42.135060 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e0b58-8f5b-4077-a069-683739b045e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:42.135164 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362679e-420c-442a-b7b5-a0b495ece36a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7279325b304d4011a77435f338b63ca3, user_id=89794cd59f4d44318aff08fe38de3dc5, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:42.136149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e0b58-8f5b-4077-a069-683739b045e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:42.136435 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e0b58-8f5b-4077-a069-683739b045e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:42.136712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e0b58-8f5b-4077-a069-683739b045e2 admin admin] PATH_INFO: `/v3/projects/f6be979097124e59bcbea6a185c053c3/users/bc02a75bffa84aac9b48249a7ee84583/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:42.141456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362679e-420c-442a-b7b5-a0b495ece36a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:42.153391 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e0b58-8f5b-4077-a069-683739b045e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6be979097124e59bcbea6a185c053c3, user_id=bc02a75bffa84aac9b48249a7ee84583, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:42.156694 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e0b58-8f5b-4077-a069-683739b045e2 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:42.244644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 791/1604] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:50:42 2022] PUT /identity/v3/projects/f6be979097124e59bcbea6a185c053c3/users/bc02a75bffa84aac9b48249a7ee84583/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:42.246571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e0b58-8f5b-4077-a069-683739b045e2 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:42.247619 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 814/1605] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:50:42 2022] PUT /identity/v3/projects/7279325b304d4011a77435f338b63ca3/users/89794cd59f4d44318aff08fe38de3dc5/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:42.248492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c908ea-24db-449d-8ed3-eeb83b131c79 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:42.248853 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c908ea-24db-449d-8ed3-eeb83b131c79 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:42.249219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c908ea-24db-449d-8ed3-eeb83b131c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:42.255234 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:42.269553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-f2c908ea-24db-449d-8ed3-eeb83b131c79 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:42.271257 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f2c908ea-24db-449d-8ed3-eeb83b131c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:42.326842 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e0b58-8f5b-4077-a069-683739b045e2 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:42.362476 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 815/1606] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:42.366790 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604bfc8-b368-4b1a-842a-32830cbdd3ac None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:42.366790 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604bfc8-b368-4b1a-842a-32830cbdd3ac None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:42.366790 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604bfc8-b368-4b1a-842a-32830cbdd3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:42.405154 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-1604bfc8-b368-4b1a-842a-32830cbdd3ac None None] MFA Rules not processed for user `bcd6e81cae8042b6a4a90b6851ab583d`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:42.408150 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-1604bfc8-b368-4b1a-842a-32830cbdd3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:42.411881 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547e2e8-1df2-4320-9ab1-9fbf19cc5aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:42.412804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547e2e8-1df2-4320-9ab1-9fbf19cc5aab admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:42.413090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547e2e8-1df2-4320-9ab1-9fbf19cc5aab admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:42.413418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547e2e8-1df2-4320-9ab1-9fbf19cc5aab admin admin] PATH_INFO: `/v3/projects/334dedef62434192bea5a914b3827557/users/80d6b085f81c43d4b5eae6e63570decd/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:42.432179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547e2e8-1df2-4320-9ab1-9fbf19cc5aab admin admin] RBAC: Authorizing `identity:create_grant(project_id=334dedef62434192bea5a914b3827557, user_id=80d6b085f81c43d4b5eae6e63570decd, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:42.436679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547e2e8-1df2-4320-9ab1-9fbf19cc5aab admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:42.489616 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 816/1607] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:42.493592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c996b46-2b48-468c-81ed-aae86036e428 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:42.493592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c996b46-2b48-468c-81ed-aae86036e428 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:42.493592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c996b46-2b48-468c-81ed-aae86036e428 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:42.494591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 817/1608] 10.222.0.36 () {54 vars in 964 bytes} [Mon Jun 27 18:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:50:42.495803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a521929-a2c2-4af7-9a0b-d1b006b9fb9a None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:42.496038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a521929-a2c2-4af7-9a0b-d1b006b9fb9a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:42.496316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a521929-a2c2-4af7-9a0b-d1b006b9fb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:42.521704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-6a521929-a2c2-4af7-9a0b-d1b006b9fb9a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:42.522980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-6a521929-a2c2-4af7-9a0b-d1b006b9fb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:42.532905 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 792/1609] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:50:42 2022] PUT /identity/v3/projects/334dedef62434192bea5a914b3827557/users/80d6b085f81c43d4b5eae6e63570decd/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:42.534446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d162292-c132-4c10-b578-3513f5159cb8 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:42.534733 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d162292-c132-4c10-b578-3513f5159cb8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:42.535009 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d162292-c132-4c10-b578-3513f5159cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:42.555237 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-7d162292-c132-4c10-b578-3513f5159cb8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:42.556490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-7d162292-c132-4c10-b578-3513f5159cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:42.613750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:42.636999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 793/1610] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:42.636999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d162292-c132-4c10-b578-3513f5159cb8 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:42.643616 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 818/1611] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:42.643616 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0754f6-31d8-4d39-a66d-bf33feb7943a None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:42.643616 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0754f6-31d8-4d39-a66d-bf33feb7943a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:42.643616 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0754f6-31d8-4d39-a66d-bf33feb7943a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:42.645406 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d162292-c132-4c10-b578-3513f5159cb8 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:42.650946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4aac77-5e94-480c-be6b-2ded1f29a7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:42.652492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4aac77-5e94-480c-be6b-2ded1f29a7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:42.652792 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4aac77-5e94-480c-be6b-2ded1f29a7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:42.653053 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4aac77-5e94-480c-be6b-2ded1f29a7b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:42.653753 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4aac77-5e94-480c-be6b-2ded1f29a7b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:42.656269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4aac77-5e94-480c-be6b-2ded1f29a7b0 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:42.679928 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-6c0754f6-31d8-4d39-a66d-bf33feb7943a None None] MFA Rules not processed for user `80d6b085f81c43d4b5eae6e63570decd`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:42.681816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-6c0754f6-31d8-4d39-a66d-bf33feb7943a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:42.750287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 819/1612] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:42.751844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f07713-8073-486a-8137-9c1f2140b884 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:42.752137 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f07713-8073-486a-8137-9c1f2140b884 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:42.752413 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f07713-8073-486a-8137-9c1f2140b884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:42.762108 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 794/1613] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:50:42 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:42.762108 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4aac77-5e94-480c-be6b-2ded1f29a7b0 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:42.784969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:42.817665 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-33f07713-8073-486a-8137-9c1f2140b884 None None] MFA Rules not processed for user `1e684ee875464138abc4e89060902100`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:42.819881 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-33f07713-8073-486a-8137-9c1f2140b884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:42.835299 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4aac77-5e94-480c-be6b-2ded1f29a7b0 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:42.839931 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feee0db-35fc-4715-856b-e546b2ab1806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:42.841103 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feee0db-35fc-4715-856b-e546b2ab1806 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:42.841938 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feee0db-35fc-4715-856b-e546b2ab1806 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:42.842515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feee0db-35fc-4715-856b-e546b2ab1806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:42.894478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 820/1614] 10.222.0.36 () {58 vars in 1061 bytes} [Mon Jun 27 18:50:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:42.900481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f07713-8073-486a-8137-9c1f2140b884 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:42.912416 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feee0db-35fc-4715-856b-e546b2ab1806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:42.914056 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feee0db-35fc-4715-856b-e546b2ab1806 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:42.924511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 795/1615] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:50:42.925906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9b28f-9410-4147-a537-3b15b5010f12 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:42.926202 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9b28f-9410-4147-a537-3b15b5010f12 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:42.926483 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9b28f-9410-4147-a537-3b15b5010f12 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:42.928383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 796/1616] 10.222.0.36 () {54 vars in 961 bytes} [Mon Jun 27 18:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:50:42.929107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9b28f-9410-4147-a537-3b15b5010f12 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:42.940867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9b28f-9410-4147-a537-3b15b5010f12 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:42.944865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932084b3-af5f-4e8c-b9a0-4e5e9c174b0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:42.945560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932084b3-af5f-4e8c-b9a0-4e5e9c174b0c service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:42.945862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932084b3-af5f-4e8c-b9a0-4e5e9c174b0c service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:42.946132 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932084b3-af5f-4e8c-b9a0-4e5e9c174b0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:42.956414 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932084b3-af5f-4e8c-b9a0-4e5e9c174b0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:42.958009 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932084b3-af5f-4e8c-b9a0-4e5e9c174b0c service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:42.973356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 797/1617] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:50:42.974266 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932084b3-af5f-4e8c-b9a0-4e5e9c174b0c service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:42.982808 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932084b3-af5f-4e8c-b9a0-4e5e9c174b0c service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:42.987955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf1035-831a-4b67-b1fe-d8c6f8c690d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:42.988796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf1035-831a-4b67-b1fe-d8c6f8c690d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:42.989148 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf1035-831a-4b67-b1fe-d8c6f8c690d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:42.989604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf1035-831a-4b67-b1fe-d8c6f8c690d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:42.994552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f07713-8073-486a-8137-9c1f2140b884 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:42.999656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf1035-831a-4b67-b1fe-d8c6f8c690d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:43.001657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf1035-831a-4b67-b1fe-d8c6f8c690d8 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:43.001775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764686f-ebc9-4526-80a6-af398020f5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:43.002565 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764686f-ebc9-4526-80a6-af398020f5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:43.003010 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764686f-ebc9-4526-80a6-af398020f5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:43.003432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764686f-ebc9-4526-80a6-af398020f5f4 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:43.004306 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764686f-ebc9-4526-80a6-af398020f5f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:43.007114 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764686f-ebc9-4526-80a6-af398020f5f4 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:43.011169 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 798/1618] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:50:43.012018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf1035-831a-4b67-b1fe-d8c6f8c690d8 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:43.021212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf1035-831a-4b67-b1fe-d8c6f8c690d8 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:43.025286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf24e6-a017-4fe7-bdf7-817af7ba68cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:43.025929 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf24e6-a017-4fe7-bdf7-817af7ba68cd service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:43.030219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf24e6-a017-4fe7-bdf7-817af7ba68cd service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:43.030219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf24e6-a017-4fe7-bdf7-817af7ba68cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:43.036415 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf24e6-a017-4fe7-bdf7-817af7ba68cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:43.037841 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf24e6-a017-4fe7-bdf7-817af7ba68cd service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:43.048226 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 799/1619] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:50:43.049736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e76e0-8bae-401b-abb6-02e88fe5058e None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:43.050062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e76e0-8bae-401b-abb6-02e88fe5058e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:43.050249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e76e0-8bae-401b-abb6-02e88fe5058e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:43.069413 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-5e6e76e0-8bae-401b-abb6-02e88fe5058e None None] MFA Rules not processed for user `da1746d29f9e4e8b8626ad4b11931cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:43.070009 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5e6e76e0-8bae-401b-abb6-02e88fe5058e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:43.141876 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 821/1620] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:50:42 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:43.144039 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764686f-ebc9-4526-80a6-af398020f5f4 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:43.159823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:43.168930 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764686f-ebc9-4526-80a6-af398020f5f4 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:43.180939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b223f30-fd3f-4174-aee4-1b94c7790f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:43.182843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b223f30-fd3f-4174-aee4-1b94c7790f26 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:43.183218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 800/1621] 10.222.0.36 () {58 vars in 1058 bytes} [Mon Jun 27 18:50:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:43.184515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e76e0-8bae-401b-abb6-02e88fe5058e None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:43.197139 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e76e0-8bae-401b-abb6-02e88fe5058e None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:43.198404 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b223f30-fd3f-4174-aee4-1b94c7790f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:43.198404 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b223f30-fd3f-4174-aee4-1b94c7790f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:43.200406 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b223f30-fd3f-4174-aee4-1b94c7790f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:43.206941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b223f30-fd3f-4174-aee4-1b94c7790f26 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:43.220294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 822/1622] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:50:43.223219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b223f30-fd3f-4174-aee4-1b94c7790f26 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:43.223353 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a0bbd-33bc-4f30-a318-ea2696b5d7ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:43.223596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a0bbd-33bc-4f30-a318-ea2696b5d7ee service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:43.227305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a0bbd-33bc-4f30-a318-ea2696b5d7ee service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:43.227305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a0bbd-33bc-4f30-a318-ea2696b5d7ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:43.246211 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b223f30-fd3f-4174-aee4-1b94c7790f26 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:43.262341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01534336-ee3d-4a5c-bc7a-c204c6066f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:43.262341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01534336-ee3d-4a5c-bc7a-c204c6066f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:43.262341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01534336-ee3d-4a5c-bc7a-c204c6066f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:43.262341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01534336-ee3d-4a5c-bc7a-c204c6066f32 admin admin] PATH_INFO: `/v3/projects/dff5857878cf467e966d9c037f5b93fd/users/19170a1a45344b3a81b915766246d49f/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:43.274614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01534336-ee3d-4a5c-bc7a-c204c6066f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff5857878cf467e966d9c037f5b93fd, user_id=19170a1a45344b3a81b915766246d49f, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:43.277726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01534336-ee3d-4a5c-bc7a-c204c6066f32 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:43.308588 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a0bbd-33bc-4f30-a318-ea2696b5d7ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:43.311942 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a0bbd-33bc-4f30-a318-ea2696b5d7ee service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:43.326188 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 801/1623] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:50:43.381353 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 823/1624] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:50:43 2022] PUT /identity/v3/projects/dff5857878cf467e966d9c037f5b93fd/users/19170a1a45344b3a81b915766246d49f/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:43.387598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a0bbd-33bc-4f30-a318-ea2696b5d7ee service nova] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:43.401712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a0bbd-33bc-4f30-a318-ea2696b5d7ee service nova] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:43.498287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a86089-bb40-46c9-9900-aaf2b7f89aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:43.499280 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a86089-bb40-46c9-9900-aaf2b7f89aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:43.499637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a86089-bb40-46c9-9900-aaf2b7f89aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:43.500278 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a86089-bb40-46c9-9900-aaf2b7f89aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:43.501134 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a86089-bb40-46c9-9900-aaf2b7f89aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:43.502770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a86089-bb40-46c9-9900-aaf2b7f89aa2 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:43.507642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:43.525561 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 802/1625] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:43.526692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01534336-ee3d-4a5c-bc7a-c204c6066f32 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:43.554882 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01534336-ee3d-4a5c-bc7a-c204c6066f32 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:43.561084 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2c455-3bfc-4265-96f6-c527814c7736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:43.562813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2c455-3bfc-4265-96f6-c527814c7736 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:43.563254 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2c455-3bfc-4265-96f6-c527814c7736 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:43.563805 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f2c455-3bfc-4265-96f6-c527814c7736 admin admin] PATH_INFO: `/v3/projects/dff5857878cf467e966d9c037f5b93fd/users/19170a1a45344b3a81b915766246d49f/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:43.566409 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2c455-3bfc-4265-96f6-c527814c7736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff5857878cf467e966d9c037f5b93fd, user_id=19170a1a45344b3a81b915766246d49f, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:43.570513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f2c455-3bfc-4265-96f6-c527814c7736 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:43.586370 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 824/1626] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:50:43 2022] PUT /identity/v3/projects/dff5857878cf467e966d9c037f5b93fd/users/19170a1a45344b3a81b915766246d49f/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:43.601437 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e94e3-ff1b-49f7-b85b-704bfd681bdf None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:43.601901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e94e3-ff1b-49f7-b85b-704bfd681bdf None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:43.602212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e94e3-ff1b-49f7-b85b-704bfd681bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:43.638191 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-589e94e3-ff1b-49f7-b85b-704bfd681bdf None None] MFA Rules not processed for user `19170a1a45344b3a81b915766246d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:43.639624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-589e94e3-ff1b-49f7-b85b-704bfd681bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:43.752383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 803/1627] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:43.767608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2c455-3bfc-4265-96f6-c527814c7736 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:43.844584 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f2c455-3bfc-4265-96f6-c527814c7736 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:43.849895 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee42d7-8a6d-4b89-8344-e9372157f515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:43.850799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee42d7-8a6d-4b89-8344-e9372157f515 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:43.851311 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee42d7-8a6d-4b89-8344-e9372157f515 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:43.852232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee42d7-8a6d-4b89-8344-e9372157f515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:43.871558 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee42d7-8a6d-4b89-8344-e9372157f515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:43.874385 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee42d7-8a6d-4b89-8344-e9372157f515 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:43.889396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 825/1628] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:50:44.139954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07713e5b-d410-4416-a3b0-9ce63c3a30c5 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:44.140599 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07713e5b-d410-4416-a3b0-9ce63c3a30c5 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:44.141068 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07713e5b-d410-4416-a3b0-9ce63c3a30c5 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:44.143175 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 804/1629] 10.222.0.36 () {54 vars in 961 bytes} [Mon Jun 27 18:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:50:44.157518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8694c9-d30a-443f-9da8-495c6504c3d9 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:44.158875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8694c9-d30a-443f-9da8-495c6504c3d9 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:44.158875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8694c9-d30a-443f-9da8-495c6504c3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:44.193360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-5c8694c9-d30a-443f-9da8-495c6504c3d9 None None] MFA Rules not processed for user `da1746d29f9e4e8b8626ad4b11931cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:44.193360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-5c8694c9-d30a-443f-9da8-495c6504c3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:44.201562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07713e5b-d410-4416-a3b0-9ce63c3a30c5 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:44.219120 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07713e5b-d410-4416-a3b0-9ce63c3a30c5 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:44.229136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a321a-6234-4253-9603-ce201eae5309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:44.229470 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a321a-6234-4253-9603-ce201eae5309 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:44.229755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a321a-6234-4253-9603-ce201eae5309 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:44.230027 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a321a-6234-4253-9603-ce201eae5309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:44.282514 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 826/1630] 10.222.0.36 () {58 vars in 1058 bytes} [Mon Jun 27 18:50:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:44.288511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab623fc-364c-4dc6-887e-4f1e3c2930d6 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:44.289615 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab623fc-364c-4dc6-887e-4f1e3c2930d6 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:44.289615 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab623fc-364c-4dc6-887e-4f1e3c2930d6 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:44.290872 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 827/1631] 10.222.0.36 () {54 vars in 912 bytes} [Mon Jun 27 18:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 27 18:50:44.307424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:44.310684 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3ef1b-d47d-4139-908e-c118ab5424b5 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:44.310981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3ef1b-d47d-4139-908e-c118ab5424b5 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:44.311260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc3ef1b-d47d-4139-908e-c118ab5424b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:44.356145 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-dcc3ef1b-d47d-4139-908e-c118ab5424b5 None None] MFA Rules not processed for user `da1746d29f9e4e8b8626ad4b11931cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:44.363025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-dcc3ef1b-d47d-4139-908e-c118ab5424b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:44.376352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a321a-6234-4253-9603-ce201eae5309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:44.380305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a321a-6234-4253-9603-ce201eae5309 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:44.389862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 828/1632] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jun 27 18:50:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:44.404420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3ef1b-d47d-4139-908e-c118ab5424b5 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:44.414139 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 805/1633] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:50:44.439097 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc3ef1b-d47d-4139-908e-c118ab5424b5 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:44.451150 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e499840-cb55-41e9-aa42-6fbc079b9615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:44.454328 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e499840-cb55-41e9-aa42-6fbc079b9615 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:44.454328 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e499840-cb55-41e9-aa42-6fbc079b9615 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:44.454591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e499840-cb55-41e9-aa42-6fbc079b9615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:44.529618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e499840-cb55-41e9-aa42-6fbc079b9615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:44.535959 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e499840-cb55-41e9-aa42-6fbc079b9615 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:44.567619 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 829/1634] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:50:44.716422 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96c119-a151-451a-b2a9-9e549f608a03 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:44.717030 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96c119-a151-451a-b2a9-9e549f608a03 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:44.717030 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f96c119-a151-451a-b2a9-9e549f608a03 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:44.719172 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 806/1635] 10.222.0.36 () {54 vars in 912 bytes} [Mon Jun 27 18:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:50:44.724725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c77399-3d96-42ae-9c58-e48d8dfef5e7 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:44.725273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c77399-3d96-42ae-9c58-e48d8dfef5e7 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:44.725775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c77399-3d96-42ae-9c58-e48d8dfef5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:44.751934 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-38c77399-3d96-42ae-9c58-e48d8dfef5e7 None None] MFA Rules not processed for user `da1746d29f9e4e8b8626ad4b11931cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:44.753517 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-38c77399-3d96-42ae-9c58-e48d8dfef5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:44.766038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 830/1636] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jun 27 18:50:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:50:44.780528 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96c119-a151-451a-b2a9-9e549f608a03 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:44.800090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f96c119-a151-451a-b2a9-9e549f608a03 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:44.804910 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b75fe-879b-4314-9684-310f3302cdf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:44.805814 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b75fe-879b-4314-9684-310f3302cdf2 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:44.806163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b75fe-879b-4314-9684-310f3302cdf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:44.807263 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b75fe-879b-4314-9684-310f3302cdf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:44.823474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b75fe-879b-4314-9684-310f3302cdf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:44.825233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b75fe-879b-4314-9684-310f3302cdf2 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:44.840170 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 807/1637] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:50:44.998286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c77399-3d96-42ae-9c58-e48d8dfef5e7 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:45.041448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:45.102174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c77399-3d96-42ae-9c58-e48d8dfef5e7 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:45.109396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58079c-4c6b-4ebb-a7aa-57d7ad335e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:45.110311 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58079c-4c6b-4ebb-a7aa-57d7ad335e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:45.110593 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58079c-4c6b-4ebb-a7aa-57d7ad335e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:45.110933 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58079c-4c6b-4ebb-a7aa-57d7ad335e09 admin admin] PATH_INFO: `/v3/users/80d6b085f81c43d4b5eae6e63570decd` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:45.112938 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58079c-4c6b-4ebb-a7aa-57d7ad335e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80d6b085f81c43d4b5eae6e63570decd)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:45.115284 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58079c-4c6b-4ebb-a7aa-57d7ad335e09 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:45.377821 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-fc58079c-4c6b-4ebb-a7aa-57d7ad335e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80d6b085f81c43d4b5eae6e63570decd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:45.449361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869927e-2c9e-42e1-a8a5-a062d422d6c6 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:45.449691 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869927e-2c9e-42e1-a8a5-a062d422d6c6 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:45.449982 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869927e-2c9e-42e1-a8a5-a062d422d6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:45.540076 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-fc58079c-4c6b-4ebb-a7aa-57d7ad335e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80d6b085f81c43d4b5eae6e63570decd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:45.540076 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-fc58079c-4c6b-4ebb-a7aa-57d7ad335e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80d6b085f81c43d4b5eae6e63570decd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:45.553422 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-fc58079c-4c6b-4ebb-a7aa-57d7ad335e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80d6b085f81c43d4b5eae6e63570decd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:45.554560 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-fc58079c-4c6b-4ebb-a7aa-57d7ad335e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80d6b085f81c43d4b5eae6e63570decd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:45.561739 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-6869927e-2c9e-42e1-a8a5-a062d422d6c6 None None] MFA Rules not processed for user `bc02a75bffa84aac9b48249a7ee84583`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:45.567337 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-6869927e-2c9e-42e1-a8a5-a062d422d6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:45.569247 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 831/1638] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:50:44 2022] DELETE /identity/v3/users/80d6b085f81c43d4b5eae6e63570decd => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:45.573552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6e388-4c3b-40c4-842e-2be4dd1b2c5b None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:45.573844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6e388-4c3b-40c4-842e-2be4dd1b2c5b None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:45.574128 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c6e388-4c3b-40c4-842e-2be4dd1b2c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:45.614813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-16c6e388-4c3b-40c4-842e-2be4dd1b2c5b None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:45.621375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-16c6e388-4c3b-40c4-842e-2be4dd1b2c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:45.717209 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 808/1639] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:45.723199 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869927e-2c9e-42e1-a8a5-a062d422d6c6 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:45.725131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-6869927e-2c9e-42e1-a8a5-a062d422d6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:45.746505 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 832/1640] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:50:45.827543 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6e388-4c3b-40c4-842e-2be4dd1b2c5b None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:45.829979 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-16c6e388-4c3b-40c4-842e-2be4dd1b2c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:45.840052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869927e-2c9e-42e1-a8a5-a062d422d6c6 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:45.850102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f455da-9f15-4b1d-aebb-6608c6e5256e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:45.850792 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f455da-9f15-4b1d-aebb-6608c6e5256e admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:45.851083 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f455da-9f15-4b1d-aebb-6608c6e5256e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:45.851366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f455da-9f15-4b1d-aebb-6608c6e5256e admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:45.852107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f455da-9f15-4b1d-aebb-6608c6e5256e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:45.854341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f455da-9f15-4b1d-aebb-6608c6e5256e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:45.960130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c6e388-4c3b-40c4-842e-2be4dd1b2c5b None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:45.968705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 809/1641] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:50:45 2022] POST /identity/v3/projects => generated 405 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:45.971804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f455da-9f15-4b1d-aebb-6608c6e5256e admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:45.992968 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:46.049097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:46.084548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2de2b7-93bd-476b-b92e-1d6d9c5f03f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:46.089044 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2de2b7-93bd-476b-b92e-1d6d9c5f03f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:46.089044 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2de2b7-93bd-476b-b92e-1d6d9c5f03f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:46.089044 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2de2b7-93bd-476b-b92e-1d6d9c5f03f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:46.112792 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f455da-9f15-4b1d-aebb-6608c6e5256e admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:46.559009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2de2b7-93bd-476b-b92e-1d6d9c5f03f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:46.561570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7b9e0-7ac9-43f5-9abd-2fde0ece4936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:46.563587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2de2b7-93bd-476b-b92e-1d6d9c5f03f0 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:46.565780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7b9e0-7ac9-43f5-9abd-2fde0ece4936 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:46.565780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7b9e0-7ac9-43f5-9abd-2fde0ece4936 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:46.565780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7b9e0-7ac9-43f5-9abd-2fde0ece4936 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:46.565780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7b9e0-7ac9-43f5-9abd-2fde0ece4936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:46.565780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7b9e0-7ac9-43f5-9abd-2fde0ece4936 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:46.567648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 833/1642] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:50:46.568452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 810/1643] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:50:45 2022] POST /identity/v3/users => generated 309 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:46.568722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2de2b7-93bd-476b-b92e-1d6d9c5f03f0 service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:46.568722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2de2b7-93bd-476b-b92e-1d6d9c5f03f0 service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:46.568722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805318e-1346-482f-b41a-4bf4ded7f0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:46.568722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805318e-1346-482f-b41a-4bf4ded7f0cc admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:46.569238 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805318e-1346-482f-b41a-4bf4ded7f0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:46.569238 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805318e-1346-482f-b41a-4bf4ded7f0cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:46.569238 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805318e-1346-482f-b41a-4bf4ded7f0cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:46.569238 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805318e-1346-482f-b41a-4bf4ded7f0cc admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:46.569238 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 834/1644] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:46.569867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7b9e0-7ac9-43f5-9abd-2fde0ece4936 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:46.569867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7b9e0-7ac9-43f5-9abd-2fde0ece4936 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:46.569867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e377fac-6626-4ff6-87fb-acc593bb5f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:46.569867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e377fac-6626-4ff6-87fb-acc593bb5f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:46.570375 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e377fac-6626-4ff6-87fb-acc593bb5f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:46.570375 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e377fac-6626-4ff6-87fb-acc593bb5f3d admin admin] PATH_INFO: `/v3/projects/1779af0f226d4ce1ba679e25f9ca1d1a/users/161ee18ead0145e39f18740644f2d4a0/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:46.570375 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e377fac-6626-4ff6-87fb-acc593bb5f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1779af0f226d4ce1ba679e25f9ca1d1a, user_id=161ee18ead0145e39f18740644f2d4a0, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:46.570375 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e377fac-6626-4ff6-87fb-acc593bb5f3d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:46.656361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 811/1645] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:50:46 2022] PUT /identity/v3/projects/1779af0f226d4ce1ba679e25f9ca1d1a/users/161ee18ead0145e39f18740644f2d4a0/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:46.660390 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805318e-1346-482f-b41a-4bf4ded7f0cc admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:46.677053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805318e-1346-482f-b41a-4bf4ded7f0cc admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:46.800013 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b3a6d-a438-4b25-a543-6e675dff450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:46.800707 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b3a6d-a438-4b25-a543-6e675dff450f admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:46.800992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b3a6d-a438-4b25-a543-6e675dff450f admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:46.801277 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b3a6d-a438-4b25-a543-6e675dff450f admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:46.802116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b3a6d-a438-4b25-a543-6e675dff450f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:46.803802 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b3a6d-a438-4b25-a543-6e675dff450f admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:46.816455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 835/1646] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:46.820668 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e377fac-6626-4ff6-87fb-acc593bb5f3d admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:46.842804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e377fac-6626-4ff6-87fb-acc593bb5f3d admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:46.849449 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f53da0-8d17-4c9a-b734-53e0d443ea84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:46.850481 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53da0-8d17-4c9a-b734-53e0d443ea84 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:46.850880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53da0-8d17-4c9a-b734-53e0d443ea84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:46.851269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f53da0-8d17-4c9a-b734-53e0d443ea84 admin admin] PATH_INFO: `/v3/projects/1779af0f226d4ce1ba679e25f9ca1d1a/users/161ee18ead0145e39f18740644f2d4a0/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:46.856233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f53da0-8d17-4c9a-b734-53e0d443ea84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1779af0f226d4ce1ba679e25f9ca1d1a, user_id=161ee18ead0145e39f18740644f2d4a0, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:46.861230 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f53da0-8d17-4c9a-b734-53e0d443ea84 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:46.877550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 812/1647] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:50:46 2022] PUT /identity/v3/projects/1779af0f226d4ce1ba679e25f9ca1d1a/users/161ee18ead0145e39f18740644f2d4a0/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:47.921510 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b3a6d-a438-4b25-a543-6e675dff450f admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:47.925163 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-469b3a6d-a438-4b25-a543-6e675dff450f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:47.946237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b3a6d-a438-4b25-a543-6e675dff450f admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:48.023713 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279e8a2-daba-4721-9e81-e22e84090b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:48.024955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279e8a2-daba-4721-9e81-e22e84090b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:48.025242 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279e8a2-daba-4721-9e81-e22e84090b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:48.025517 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279e8a2-daba-4721-9e81-e22e84090b95 admin admin] PATH_INFO: `/v3/projects/334dedef62434192bea5a914b3827557` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:48.031337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279e8a2-daba-4721-9e81-e22e84090b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=334dedef62434192bea5a914b3827557)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:48.031337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: WARNING py.warnings [None req-f279e8a2-daba-4721-9e81-e22e84090b95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:50:48.031337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: warnings.warn(msg) Jun 27 18:50:48.031337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: Jun 27 18:50:48.031337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279e8a2-daba-4721-9e81-e22e84090b95 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:48.687648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:48.723725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f279e8a2-daba-4721-9e81-e22e84090b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '334dedef62434192bea5a914b3827557', 'request_id': 'req-f279e8a2-daba-4721-9e81-e22e84090b95'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:48.764246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f279e8a2-daba-4721-9e81-e22e84090b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '334dedef62434192bea5a914b3827557', 'request_id': 'req-f279e8a2-daba-4721-9e81-e22e84090b95'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:48.917844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f279e8a2-daba-4721-9e81-e22e84090b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '334dedef62434192bea5a914b3827557', 'request_id': 'req-f279e8a2-daba-4721-9e81-e22e84090b95'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:48.938182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f279e8a2-daba-4721-9e81-e22e84090b95 admin admin] The token cache is being invalidate because project 334dedef62434192bea5a914b3827557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:50:48.938861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f279e8a2-daba-4721-9e81-e22e84090b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:48.940009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f279e8a2-daba-4721-9e81-e22e84090b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:48.951330 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 836/1648] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:50:47 2022] DELETE /identity/v3/projects/334dedef62434192bea5a914b3827557 => generated 0 bytes in 1022 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:48.951420 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd05b7-a1a8-46e7-812c-3a7b21e560ca None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:48.951420 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd05b7-a1a8-46e7-812c-3a7b21e560ca None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:48.951420 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd05b7-a1a8-46e7-812c-3a7b21e560ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:48.982651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-e8bd05b7-a1a8-46e7-812c-3a7b21e560ca None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:48.985004 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e8bd05b7-a1a8-46e7-812c-3a7b21e560ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:49.080366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 813/1649] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:49.088147 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df733527-7639-4c9d-a4b8-620ba1bbf102 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:49.089069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df733527-7639-4c9d-a4b8-620ba1bbf102 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:49.089492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df733527-7639-4c9d-a4b8-620ba1bbf102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:49.113808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-df733527-7639-4c9d-a4b8-620ba1bbf102 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:49.115439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-df733527-7639-4c9d-a4b8-620ba1bbf102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:49.125317 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 837/1650] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:49.129778 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd05b7-a1a8-46e7-812c-3a7b21e560ca None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:49.141162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd05b7-a1a8-46e7-812c-3a7b21e560ca None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:49.146962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7db65-3bc5-496e-8804-2751d4acdd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:49.147662 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7db65-3bc5-496e-8804-2751d4acdd43 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:49.147948 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7db65-3bc5-496e-8804-2751d4acdd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:49.148224 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7db65-3bc5-496e-8804-2751d4acdd43 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:49.148965 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7db65-3bc5-496e-8804-2751d4acdd43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:50:49.149322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7db65-3bc5-496e-8804-2751d4acdd43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:49.150971 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab7db65-3bc5-496e-8804-2751d4acdd43 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:49.172098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df733527-7639-4c9d-a4b8-620ba1bbf102 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:49.177849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 814/1651] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:50:49.183053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df733527-7639-4c9d-a4b8-620ba1bbf102 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:49.190593 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0e12a-8f62-4d86-b331-4b432ae1fa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:49.191567 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0e12a-8f62-4d86-b331-4b432ae1fa90 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:49.192004 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0e12a-8f62-4d86-b331-4b432ae1fa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:49.192429 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0e12a-8f62-4d86-b331-4b432ae1fa90 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:49.193273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0e12a-8f62-4d86-b331-4b432ae1fa90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:49.195636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0e12a-8f62-4d86-b331-4b432ae1fa90 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:49.324444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7db65-3bc5-496e-8804-2751d4acdd43 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:49.325782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 838/1652] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:50:49 2022] POST /identity/v3/projects => generated 401 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:49.341259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7db65-3bc5-496e-8804-2751d4acdd43 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:49.495423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ce3ff-c15e-4484-9612-fc186eb3c534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:49.498273 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ce3ff-c15e-4484-9612-fc186eb3c534 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:49.500760 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ce3ff-c15e-4484-9612-fc186eb3c534 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:49.501245 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ce3ff-c15e-4484-9612-fc186eb3c534 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:49.502267 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ce3ff-c15e-4484-9612-fc186eb3c534 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:49.513637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19ce3ff-c15e-4484-9612-fc186eb3c534 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:49.629819 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 815/1653] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:50:49 2022] POST /identity/v3/users => generated 301 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:49.631140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0e12a-8f62-4d86-b331-4b432ae1fa90 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:49.647330 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0e12a-8f62-4d86-b331-4b432ae1fa90 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:49.656149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6101a9-face-482e-9c78-4b1d4e484bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:49.657727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6101a9-face-482e-9c78-4b1d4e484bfc admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:49.662124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6101a9-face-482e-9c78-4b1d4e484bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:49.662124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6101a9-face-482e-9c78-4b1d4e484bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:49.662124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6101a9-face-482e-9c78-4b1d4e484bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:49.664920 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6101a9-face-482e-9c78-4b1d4e484bfc admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:49.693688 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ce3ff-c15e-4484-9612-fc186eb3c534 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:49.695630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 839/1654] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:49.699676 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:49.708428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ce3ff-c15e-4484-9612-fc186eb3c534 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:49.714189 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16295bc5-a82f-455a-b351-543c1cbfdf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:49.715879 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16295bc5-a82f-455a-b351-543c1cbfdf14 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:49.716329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16295bc5-a82f-455a-b351-543c1cbfdf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:49.718783 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16295bc5-a82f-455a-b351-543c1cbfdf14 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:49.720370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16295bc5-a82f-455a-b351-543c1cbfdf14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:49.723963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16295bc5-a82f-455a-b351-543c1cbfdf14 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:49.758844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6101a9-face-482e-9c78-4b1d4e484bfc admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:49.771315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 816/1655] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:49.772460 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6101a9-face-482e-9c78-4b1d4e484bfc admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:49.787675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa0788-5bfe-42ea-bcde-ac1581da8084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:49.788799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa0788-5bfe-42ea-bcde-ac1581da8084 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:49.789260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa0788-5bfe-42ea-bcde-ac1581da8084 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:49.789551 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa0788-5bfe-42ea-bcde-ac1581da8084 admin admin] PATH_INFO: `/v3/projects/85998c4732394d29b08aead1ab6d1b37/users/b34e1d0775d74d1ea4cfa9c98baff621/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:49.814850 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa0788-5bfe-42ea-bcde-ac1581da8084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85998c4732394d29b08aead1ab6d1b37, user_id=b34e1d0775d74d1ea4cfa9c98baff621, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:49.828916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa0788-5bfe-42ea-bcde-ac1581da8084 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:49.929035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fc23b-82d4-45c3-a7d9-ba033e0d36e0 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:49.929375 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fc23b-82d4-45c3-a7d9-ba033e0d36e0 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:49.929660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227fc23b-82d4-45c3-a7d9-ba033e0d36e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:49.951836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 840/1656] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:50:49 2022] PUT /identity/v3/projects/85998c4732394d29b08aead1ab6d1b37/users/b34e1d0775d74d1ea4cfa9c98baff621/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:49.957602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d10f84-72df-4d73-b0ad-d49335392af9 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:49.957602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d10f84-72df-4d73-b0ad-d49335392af9 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:49.957785 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d10f84-72df-4d73-b0ad-d49335392af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:49.980570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-227fc23b-82d4-45c3-a7d9-ba033e0d36e0 None None] MFA Rules not processed for user `161ee18ead0145e39f18740644f2d4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:49.981852 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-227fc23b-82d4-45c3-a7d9-ba033e0d36e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:50.009559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-b5d10f84-72df-4d73-b0ad-d49335392af9 None None] MFA Rules not processed for user `b34e1d0775d74d1ea4cfa9c98baff621`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:50.013042 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b5d10f84-72df-4d73-b0ad-d49335392af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:50.141009 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 817/1657] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:49 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:50.234361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fc23b-82d4-45c3-a7d9-ba033e0d36e0 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:50.234822 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 841/1658] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:49 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:50.350822 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227fc23b-82d4-45c3-a7d9-ba033e0d36e0 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:50.357330 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd6aa3-29ec-491b-b612-5e03d89a83bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:50.358904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd6aa3-29ec-491b-b612-5e03d89a83bf admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:50.359360 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd6aa3-29ec-491b-b612-5e03d89a83bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:50.359827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd6aa3-29ec-491b-b612-5e03d89a83bf admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:50.360706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd6aa3-29ec-491b-b612-5e03d89a83bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:50.363062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd6aa3-29ec-491b-b612-5e03d89a83bf admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:50.512745 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d10f84-72df-4d73-b0ad-d49335392af9 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:50.518620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 818/1659] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:50:50 2022] POST /identity/v3/projects => generated 403 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:50:50.535399 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d10f84-72df-4d73-b0ad-d49335392af9 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:50.653527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:50.725613 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aadd30-eb43-4a04-832b-25c5ad35af85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:50.726614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aadd30-eb43-4a04-832b-25c5ad35af85 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:50.727675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aadd30-eb43-4a04-832b-25c5ad35af85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:50.728889 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aadd30-eb43-4a04-832b-25c5ad35af85 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:50.733760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aadd30-eb43-4a04-832b-25c5ad35af85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:50.737862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aadd30-eb43-4a04-832b-25c5ad35af85 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:50.892342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 842/1660] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:50:50 2022] POST /identity/v3/users => generated 308 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:50.895674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd6aa3-29ec-491b-b612-5e03d89a83bf admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:50.917988 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd6aa3-29ec-491b-b612-5e03d89a83bf admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:50.933235 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8ffe7-88a0-4163-9315-7032581bbee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:50.933981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8ffe7-88a0-4163-9315-7032581bbee8 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:50.934235 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8ffe7-88a0-4163-9315-7032581bbee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:50.934518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8ffe7-88a0-4163-9315-7032581bbee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:50.935273 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8ffe7-88a0-4163-9315-7032581bbee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:50.939025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad8ffe7-88a0-4163-9315-7032581bbee8 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:50.970212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 819/1661] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:50.971804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aadd30-eb43-4a04-832b-25c5ad35af85 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:50.990044 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aadd30-eb43-4a04-832b-25c5ad35af85 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:51.004593 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedf39e-d7fd-4bc7-8ff9-620ea3275de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:51.005436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedf39e-d7fd-4bc7-8ff9-620ea3275de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:51.005704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedf39e-d7fd-4bc7-8ff9-620ea3275de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:51.005995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aedf39e-d7fd-4bc7-8ff9-620ea3275de3 admin admin] PATH_INFO: `/v3/projects/908abde13bbd48f2aa2309846b1d83bd/users/77ee6e70f8e7423faac63fb4b51b89a1/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:51.075842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedf39e-d7fd-4bc7-8ff9-620ea3275de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908abde13bbd48f2aa2309846b1d83bd, user_id=77ee6e70f8e7423faac63fb4b51b89a1, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:51.079375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aedf39e-d7fd-4bc7-8ff9-620ea3275de3 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:51.226845 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 843/1662] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:50:50 2022] PUT /identity/v3/projects/908abde13bbd48f2aa2309846b1d83bd/users/77ee6e70f8e7423faac63fb4b51b89a1/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:51.229939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8ffe7-88a0-4163-9315-7032581bbee8 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:51.250393 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad8ffe7-88a0-4163-9315-7032581bbee8 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:51.341777 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:51.403715 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac312324-dae9-41d8-888d-0d7f63f78e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:51.404917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac312324-dae9-41d8-888d-0d7f63f78e61 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:51.405620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac312324-dae9-41d8-888d-0d7f63f78e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:51.406144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac312324-dae9-41d8-888d-0d7f63f78e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:51.410412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac312324-dae9-41d8-888d-0d7f63f78e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:51.430629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac312324-dae9-41d8-888d-0d7f63f78e61 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:51.506542 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 820/1663] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:51.510776 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedf39e-d7fd-4bc7-8ff9-620ea3275de3 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:51.578811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aedf39e-d7fd-4bc7-8ff9-620ea3275de3 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:51.588001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cec570-afce-4180-b62d-99b394f3d480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:51.590980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cec570-afce-4180-b62d-99b394f3d480 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:51.590980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cec570-afce-4180-b62d-99b394f3d480 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:51.595141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cec570-afce-4180-b62d-99b394f3d480 admin admin] PATH_INFO: `/v3/projects/908abde13bbd48f2aa2309846b1d83bd/users/77ee6e70f8e7423faac63fb4b51b89a1/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:51.604858 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cec570-afce-4180-b62d-99b394f3d480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908abde13bbd48f2aa2309846b1d83bd, user_id=77ee6e70f8e7423faac63fb4b51b89a1, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:51.616045 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cec570-afce-4180-b62d-99b394f3d480 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:51.662302 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 844/1664] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:50:51 2022] PUT /identity/v3/projects/908abde13bbd48f2aa2309846b1d83bd/users/77ee6e70f8e7423faac63fb4b51b89a1/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:51.673983 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9037ab-003a-430f-9dac-11c923f2b8c8 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:51.674562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9037ab-003a-430f-9dac-11c923f2b8c8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:51.675341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9037ab-003a-430f-9dac-11c923f2b8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:51.802027 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-ca9037ab-003a-430f-9dac-11c923f2b8c8 None None] MFA Rules not processed for user `77ee6e70f8e7423faac63fb4b51b89a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:51.803326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ca9037ab-003a-430f-9dac-11c923f2b8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:52.037498 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 821/1665] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:51 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:52.052879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cec570-afce-4180-b62d-99b394f3d480 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:52.054738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-12cec570-afce-4180-b62d-99b394f3d480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:52.243795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cec570-afce-4180-b62d-99b394f3d480 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:52.252377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008bba9-1059-40b5-b832-f503f92de91b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:52.257340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008bba9-1059-40b5-b832-f503f92de91b service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:52.257917 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008bba9-1059-40b5-b832-f503f92de91b service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:52.258431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008bba9-1059-40b5-b832-f503f92de91b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:52.285243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008bba9-1059-40b5-b832-f503f92de91b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:52.286818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008bba9-1059-40b5-b832-f503f92de91b service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:52.328529 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 845/1666] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:52 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:50:52.416654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9037ab-003a-430f-9dac-11c923f2b8c8 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:52.561144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9037ab-003a-430f-9dac-11c923f2b8c8 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:52.601042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d4cb4-c69f-46fd-8527-ea7360bf1bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:52.604591 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d4cb4-c69f-46fd-8527-ea7360bf1bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:52.605090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d4cb4-c69f-46fd-8527-ea7360bf1bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:52.605539 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d4cb4-c69f-46fd-8527-ea7360bf1bc5 admin admin] PATH_INFO: `/v3/users/b34e1d0775d74d1ea4cfa9c98baff621` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:52.607046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d4cb4-c69f-46fd-8527-ea7360bf1bc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b34e1d0775d74d1ea4cfa9c98baff621)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:52.608310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: WARNING py.warnings [None req-8a9d4cb4-c69f-46fd-8527-ea7360bf1bc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 27 18:50:52.608310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: warnings.warn(msg) Jun 27 18:50:52.608310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: Jun 27 18:50:52.613662 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d4cb4-c69f-46fd-8527-ea7360bf1bc5 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:53.025012 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8a9d4cb4-c69f-46fd-8527-ea7360bf1bc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b34e1d0775d74d1ea4cfa9c98baff621'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:53.124801 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8a9d4cb4-c69f-46fd-8527-ea7360bf1bc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b34e1d0775d74d1ea4cfa9c98baff621'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:53.200085 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8a9d4cb4-c69f-46fd-8527-ea7360bf1bc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b34e1d0775d74d1ea4cfa9c98baff621'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:53.206259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8a9d4cb4-c69f-46fd-8527-ea7360bf1bc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b34e1d0775d74d1ea4cfa9c98baff621'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:53.222138 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:53.235892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22628f9-6abd-42fa-9493-d023a0d439c1 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:53.236416 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22628f9-6abd-42fa-9493-d023a0d439c1 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:53.236501 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22628f9-6abd-42fa-9493-d023a0d439c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:53.263199 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8a9d4cb4-c69f-46fd-8527-ea7360bf1bc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b34e1d0775d74d1ea4cfa9c98baff621'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:53.282607 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 822/1667] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:50:52 2022] DELETE /identity/v3/users/b34e1d0775d74d1ea4cfa9c98baff621 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:53.287421 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f39e70-08eb-4245-b828-330a8447dd76 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:53.287421 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f39e70-08eb-4245-b828-330a8447dd76 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:53.292124 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f39e70-08eb-4245-b828-330a8447dd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:53.328600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-c22628f9-6abd-42fa-9493-d023a0d439c1 None None] MFA Rules not processed for user `ded25521da0d425ea95e7763d7161ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:53.328600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-c22628f9-6abd-42fa-9493-d023a0d439c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:53.331023 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-59f39e70-08eb-4245-b828-330a8447dd76 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:53.332282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-59f39e70-08eb-4245-b828-330a8447dd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:53.492646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 823/1668] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:53.504440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f39e70-08eb-4245-b828-330a8447dd76 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:53.505978 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-59f39e70-08eb-4245-b828-330a8447dd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:53.549534 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 846/1669] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:53.572160 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22628f9-6abd-42fa-9493-d023a0d439c1 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:53.572160 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-c22628f9-6abd-42fa-9493-d023a0d439c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:53.665659 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:53.686339 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f39e70-08eb-4245-b828-330a8447dd76 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:53.699819 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f823f03-d2aa-4e85-897e-175667d73b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:53.700654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f823f03-d2aa-4e85-897e-175667d73b22 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:53.700949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f823f03-d2aa-4e85-897e-175667d73b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:53.702849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f823f03-d2aa-4e85-897e-175667d73b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:53.733908 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f823f03-d2aa-4e85-897e-175667d73b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:53.735761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f823f03-d2aa-4e85-897e-175667d73b22 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:53.757066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 824/1670] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:50:53.795318 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22628f9-6abd-42fa-9493-d023a0d439c1 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:53.802186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5cfc6-73bd-417c-844e-3171bb556c16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:53.802892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5cfc6-73bd-417c-844e-3171bb556c16 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:53.803224 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5cfc6-73bd-417c-844e-3171bb556c16 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:53.803467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5cfc6-73bd-417c-844e-3171bb556c16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:53.814262 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5cfc6-73bd-417c-844e-3171bb556c16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:53.815983 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5cfc6-73bd-417c-844e-3171bb556c16 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:53.842158 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 847/1671] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:50:53.898962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fe8f1-c745-4468-b1c8-c33e84a1e87b None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:53.903208 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fe8f1-c745-4468-b1c8-c33e84a1e87b None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:53.903208 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fe8f1-c745-4468-b1c8-c33e84a1e87b None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:53.903208 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 825/1672] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jun 27 18:50:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:50:53.969412 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e82e5-3728-43f0-9953-281f2c1b6fb1 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:53.969755 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e82e5-3728-43f0-9953-281f2c1b6fb1 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:53.970069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e82e5-3728-43f0-9953-281f2c1b6fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:53.999617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-2d0e82e5-3728-43f0-9953-281f2c1b6fb1 None None] MFA Rules not processed for user `af6ef16884604753972c916f74271f42`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:54.001793 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2d0e82e5-3728-43f0-9953-281f2c1b6fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:54.213011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 848/1673] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jun 27 18:50:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:54.293605 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd78d07-6751-45c6-a5b1-7824a11ae361 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:54.293897 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd78d07-6751-45c6-a5b1-7824a11ae361 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:54.294380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd78d07-6751-45c6-a5b1-7824a11ae361 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:54.296321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 826/1674] 10.222.0.36 () {54 vars in 960 bytes} [Mon Jun 27 18:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:50:54.304621 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf0b4a-13ab-4505-a119-f765c9953018 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:54.304621 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf0b4a-13ab-4505-a119-f765c9953018 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:54.304621 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf0b4a-13ab-4505-a119-f765c9953018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:54.333432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-9fdf0b4a-13ab-4505-a119-f765c9953018 None None] MFA Rules not processed for user `af6ef16884604753972c916f74271f42`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:54.334713 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9fdf0b4a-13ab-4505-a119-f765c9953018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:54.378861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd78d07-6751-45c6-a5b1-7824a11ae361 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:54.380788 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 849/1675] 10.222.0.36 () {58 vars in 1057 bytes} [Mon Jun 27 18:50:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:50:54.403440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd78d07-6751-45c6-a5b1-7824a11ae361 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:54.421957 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576786c-026a-4c8b-8e32-86942478c594 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af6ef16884604753972c916f74271f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:54.423080 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576786c-026a-4c8b-8e32-86942478c594 service placement] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:54.423560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576786c-026a-4c8b-8e32-86942478c594 service placement] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:54.424070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576786c-026a-4c8b-8e32-86942478c594 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:54.438675 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576786c-026a-4c8b-8e32-86942478c594 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:54.440463 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576786c-026a-4c8b-8e32-86942478c594 service placement] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:54.482488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 827/1676] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:50:54.892202 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf0b4a-13ab-4505-a119-f765c9953018 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:54.893935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9fdf0b4a-13ab-4505-a119-f765c9953018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:54.916960 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf0b4a-13ab-4505-a119-f765c9953018 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:54.927927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d84de1-dc75-4e7a-8671-7c24db587027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:54.929024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84de1-dc75-4e7a-8671-7c24db587027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:54.929367 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84de1-dc75-4e7a-8671-7c24db587027 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:54.929697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d84de1-dc75-4e7a-8671-7c24db587027 admin admin] PATH_INFO: `/v3/projects/85998c4732394d29b08aead1ab6d1b37` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:54.932110 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d84de1-dc75-4e7a-8671-7c24db587027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85998c4732394d29b08aead1ab6d1b37)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:54.936397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d84de1-dc75-4e7a-8671-7c24db587027 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:55.117848 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-c3d84de1-dc75-4e7a-8671-7c24db587027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85998c4732394d29b08aead1ab6d1b37', 'request_id': 'req-c3d84de1-dc75-4e7a-8671-7c24db587027'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:55.136409 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-c3d84de1-dc75-4e7a-8671-7c24db587027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85998c4732394d29b08aead1ab6d1b37', 'request_id': 'req-c3d84de1-dc75-4e7a-8671-7c24db587027'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:55.237830 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-c3d84de1-dc75-4e7a-8671-7c24db587027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85998c4732394d29b08aead1ab6d1b37', 'request_id': 'req-c3d84de1-dc75-4e7a-8671-7c24db587027'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:55.258670 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-c3d84de1-dc75-4e7a-8671-7c24db587027 admin admin] The token cache is being invalidate because project 85998c4732394d29b08aead1ab6d1b37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:50:55.259591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-c3d84de1-dc75-4e7a-8671-7c24db587027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:55.261474 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-c3d84de1-dc75-4e7a-8671-7c24db587027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:55.270677 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576786c-026a-4c8b-8e32-86942478c594 service placement] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:55.280939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 850/1677] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:50:54 2022] DELETE /identity/v3/projects/85998c4732394d29b08aead1ab6d1b37 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:55.290258 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576786c-026a-4c8b-8e32-86942478c594 service placement] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:55.433333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc8a8b-1f57-4a82-b517-a524c414055e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:55.433333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc8a8b-1f57-4a82-b517-a524c414055e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:55.433333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc8a8b-1f57-4a82-b517-a524c414055e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:55.433333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc8a8b-1f57-4a82-b517-a524c414055e admin admin] PATH_INFO: `/v3/users/77ee6e70f8e7423faac63fb4b51b89a1` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:55.433648 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc8a8b-1f57-4a82-b517-a524c414055e admin admin] RBAC: Authorizing `identity:delete_user(user_id=77ee6e70f8e7423faac63fb4b51b89a1)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:55.433648 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc8a8b-1f57-4a82-b517-a524c414055e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:55.465489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:55.665601 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-9edc8a8b-1f57-4a82-b517-a524c414055e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77ee6e70f8e7423faac63fb4b51b89a1'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:55.740388 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-9edc8a8b-1f57-4a82-b517-a524c414055e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77ee6e70f8e7423faac63fb4b51b89a1'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:55.760896 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-9edc8a8b-1f57-4a82-b517-a524c414055e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77ee6e70f8e7423faac63fb4b51b89a1'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:55.762345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-9edc8a8b-1f57-4a82-b517-a524c414055e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77ee6e70f8e7423faac63fb4b51b89a1'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:55.779773 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-9edc8a8b-1f57-4a82-b517-a524c414055e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77ee6e70f8e7423faac63fb4b51b89a1'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:55.794839 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 828/1678] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:50:55 2022] DELETE /identity/v3/users/77ee6e70f8e7423faac63fb4b51b89a1 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:55.839382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b734099-8a6c-430c-8dc1-c00a36b67f31 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:55.840515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b734099-8a6c-430c-8dc1-c00a36b67f31 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:55.841934 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b734099-8a6c-430c-8dc1-c00a36b67f31 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:55.844032 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 851/1679] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jun 27 18:50:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:50:55.850916 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b8b72-7963-445d-8f82-8b1ba5916493 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:55.851173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b8b72-7963-445d-8f82-8b1ba5916493 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:55.851390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b8b72-7963-445d-8f82-8b1ba5916493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:55.939691 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-bb5b8b72-7963-445d-8f82-8b1ba5916493 None None] MFA Rules not processed for user `af6ef16884604753972c916f74271f42`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:55.942731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-bb5b8b72-7963-445d-8f82-8b1ba5916493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:56.107289 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b734099-8a6c-430c-8dc1-c00a36b67f31 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:56.109605 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9b734099-8a6c-430c-8dc1-c00a36b67f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:56.114306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 829/1680] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jun 27 18:50:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:56.144635 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b8b72-7963-445d-8f82-8b1ba5916493 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:56.146586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-bb5b8b72-7963-445d-8f82-8b1ba5916493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:56.168526 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b8b72-7963-445d-8f82-8b1ba5916493 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:56.181598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ec570-6428-4be5-aca5-cdd7f3ed396a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af6ef16884604753972c916f74271f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:56.183672 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ec570-6428-4be5-aca5-cdd7f3ed396a service placement] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:56.184190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ec570-6428-4be5-aca5-cdd7f3ed396a service placement] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:56.184884 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9ec570-6428-4be5-aca5-cdd7f3ed396a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:56.192482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:56.225551 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ec570-6428-4be5-aca5-cdd7f3ed396a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:56.232581 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9ec570-6428-4be5-aca5-cdd7f3ed396a service placement] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:56.273001 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 830/1681] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:50:56.361653 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b734099-8a6c-430c-8dc1-c00a36b67f31 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:56.372548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f213bc6-81fb-48b6-9bd5-93b74b1a0602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:56.374401 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f213bc6-81fb-48b6-9bd5-93b74b1a0602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:56.374857 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f213bc6-81fb-48b6-9bd5-93b74b1a0602 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:56.375322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f213bc6-81fb-48b6-9bd5-93b74b1a0602 admin admin] PATH_INFO: `/v3/users/bc02a75bffa84aac9b48249a7ee84583` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:56.380856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f213bc6-81fb-48b6-9bd5-93b74b1a0602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc02a75bffa84aac9b48249a7ee84583)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:56.383561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f213bc6-81fb-48b6-9bd5-93b74b1a0602 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:56.650295 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-0f213bc6-81fb-48b6-9bd5-93b74b1a0602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc02a75bffa84aac9b48249a7ee84583'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:56.777051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-0f213bc6-81fb-48b6-9bd5-93b74b1a0602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc02a75bffa84aac9b48249a7ee84583'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:56.800167 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-0f213bc6-81fb-48b6-9bd5-93b74b1a0602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc02a75bffa84aac9b48249a7ee84583'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:56.816190 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-0f213bc6-81fb-48b6-9bd5-93b74b1a0602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc02a75bffa84aac9b48249a7ee84583'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:56.817107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-0f213bc6-81fb-48b6-9bd5-93b74b1a0602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc02a75bffa84aac9b48249a7ee84583'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:56.828327 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 852/1682] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:50:56 2022] DELETE /identity/v3/users/bc02a75bffa84aac9b48249a7ee84583 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:56.833374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ec570-6428-4be5-aca5-cdd7f3ed396a service placement] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:56.835359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-2b9ec570-6428-4be5-aca5-cdd7f3ed396a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:56.863504 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9ec570-6428-4be5-aca5-cdd7f3ed396a service placement] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:57.006621 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f83669-8d70-40cc-9620-f59f91244b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:57.007560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f83669-8d70-40cc-9620-f59f91244b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:57.012330 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f83669-8d70-40cc-9620-f59f91244b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:57.012638 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f83669-8d70-40cc-9620-f59f91244b09 admin admin] PATH_INFO: `/v3/projects/908abde13bbd48f2aa2309846b1d83bd` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:57.014689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f83669-8d70-40cc-9620-f59f91244b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=908abde13bbd48f2aa2309846b1d83bd)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:57.017409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f83669-8d70-40cc-9620-f59f91244b09 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:57.180082 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:57.213033 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-88f83669-8d70-40cc-9620-f59f91244b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908abde13bbd48f2aa2309846b1d83bd', 'request_id': 'req-88f83669-8d70-40cc-9620-f59f91244b09'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:57.296152 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-88f83669-8d70-40cc-9620-f59f91244b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908abde13bbd48f2aa2309846b1d83bd', 'request_id': 'req-88f83669-8d70-40cc-9620-f59f91244b09'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:57.307066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-88f83669-8d70-40cc-9620-f59f91244b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908abde13bbd48f2aa2309846b1d83bd', 'request_id': 'req-88f83669-8d70-40cc-9620-f59f91244b09'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:57.345873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-88f83669-8d70-40cc-9620-f59f91244b09 admin admin] The token cache is being invalidate because project 908abde13bbd48f2aa2309846b1d83bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:50:57.346594 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-88f83669-8d70-40cc-9620-f59f91244b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:57.359382 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-88f83669-8d70-40cc-9620-f59f91244b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:57.369917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 831/1683] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:50:56 2022] DELETE /identity/v3/projects/908abde13bbd48f2aa2309846b1d83bd => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:57.372483 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d96a9a-845b-421f-8aa4-0c530a5826a8 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:57.373388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d96a9a-845b-421f-8aa4-0c530a5826a8 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:57.374123 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d96a9a-845b-421f-8aa4-0c530a5826a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:57.407587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-08d96a9a-845b-421f-8aa4-0c530a5826a8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:57.410423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-08d96a9a-845b-421f-8aa4-0c530a5826a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:57.603735 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 853/1684] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:57.613074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a8c92-59e0-409a-86db-ffe69a9cf9fd None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:57.613391 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a8c92-59e0-409a-86db-ffe69a9cf9fd None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:57.613801 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a8c92-59e0-409a-86db-ffe69a9cf9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:57.654032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-f15a8c92-59e0-409a-86db-ffe69a9cf9fd None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:57.656823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-f15a8c92-59e0-409a-86db-ffe69a9cf9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:57.688132 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 832/1685] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:57.689324 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d96a9a-845b-421f-8aa4-0c530a5826a8 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:57.703420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d96a9a-845b-421f-8aa4-0c530a5826a8 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:57.719962 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3617d-8292-4194-95f6-198b68ea0e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:57.720974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3617d-8292-4194-95f6-198b68ea0e52 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:57.723085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3617d-8292-4194-95f6-198b68ea0e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:57.726246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3617d-8292-4194-95f6-198b68ea0e52 admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:57.729722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3617d-8292-4194-95f6-198b68ea0e52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:50:57.730045 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3617d-8292-4194-95f6-198b68ea0e52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:57.731744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3617d-8292-4194-95f6-198b68ea0e52 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:57.756134 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 854/1686] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:50:57.759959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a8c92-59e0-409a-86db-ffe69a9cf9fd None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:57.770571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a8c92-59e0-409a-86db-ffe69a9cf9fd None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:57.775750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633952b-8fb2-4320-a47c-3e497b933f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:57.776426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633952b-8fb2-4320-a47c-3e497b933f75 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:57.776711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633952b-8fb2-4320-a47c-3e497b933f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:57.776987 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633952b-8fb2-4320-a47c-3e497b933f75 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:57.777761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633952b-8fb2-4320-a47c-3e497b933f75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:57.780331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633952b-8fb2-4320-a47c-3e497b933f75 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:57.824715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3617d-8292-4194-95f6-198b68ea0e52 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:57.829493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-01e3617d-8292-4194-95f6-198b68ea0e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:57.871216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3617d-8292-4194-95f6-198b68ea0e52 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:57.890166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:57.891422 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:57.891947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:57.892706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d admin admin] PATH_INFO: `/v3/projects/f6be979097124e59bcbea6a185c053c3` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:57.895160 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6be979097124e59bcbea6a185c053c3)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:57.903927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:57.907899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 833/1687] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:50:57 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:50:57.909264 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633952b-8fb2-4320-a47c-3e497b933f75 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:57.914836 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5633952b-8fb2-4320-a47c-3e497b933f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:58.079170 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633952b-8fb2-4320-a47c-3e497b933f75 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:58.097038 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b88b9-3df4-493e-8cb4-da6bff4bad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:58.097949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b88b9-3df4-493e-8cb4-da6bff4bad7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:58.098237 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b88b9-3df4-493e-8cb4-da6bff4bad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:58.098518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b88b9-3df4-493e-8cb4-da6bff4bad7e admin admin] PATH_INFO: `/v3/users/bcd6e81cae8042b6a4a90b6851ab583d` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:58.099822 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b88b9-3df4-493e-8cb4-da6bff4bad7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd6e81cae8042b6a4a90b6851ab583d)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:58.101768 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b88b9-3df4-493e-8cb4-da6bff4bad7e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:58.113168 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:58.136168 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6be979097124e59bcbea6a185c053c3', 'request_id': 'req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:58.162895 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6be979097124e59bcbea6a185c053c3', 'request_id': 'req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:58.264501 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6be979097124e59bcbea6a185c053c3', 'request_id': 'req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:58.277444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d admin admin] The token cache is being invalidate because project f6be979097124e59bcbea6a185c053c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:50:58.277741 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:58.278433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:58.284007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 855/1688] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:50:57 2022] DELETE /identity/v3/projects/f6be979097124e59bcbea6a185c053c3 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:58.284007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:58.284007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:58.334053 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0e6b88b9-3df4-493e-8cb4-da6bff4bad7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd6e81cae8042b6a4a90b6851ab583d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:58.425989 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0e6b88b9-3df4-493e-8cb4-da6bff4bad7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd6e81cae8042b6a4a90b6851ab583d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:58.456058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1b27a-9011-4c20-bb6d-7cae1d29152d admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:58.457131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0e6b88b9-3df4-493e-8cb4-da6bff4bad7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd6e81cae8042b6a4a90b6851ab583d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:58.458132 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0e6b88b9-3df4-493e-8cb4-da6bff4bad7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd6e81cae8042b6a4a90b6851ab583d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:58.467064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0e6b88b9-3df4-493e-8cb4-da6bff4bad7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd6e81cae8042b6a4a90b6851ab583d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:58.478434 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316d708-a86b-4aad-845c-3555ad119e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:58.479794 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316d708-a86b-4aad-845c-3555ad119e67 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:58.480256 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316d708-a86b-4aad-845c-3555ad119e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:58.480678 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316d708-a86b-4aad-845c-3555ad119e67 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:58.481711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316d708-a86b-4aad-845c-3555ad119e67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:58.484436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316d708-a86b-4aad-845c-3555ad119e67 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:58.491725 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 834/1689] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:50:57 2022] DELETE /identity/v3/users/bcd6e81cae8042b6a4a90b6851ab583d => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:58.495320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b88b9-3df4-493e-8cb4-da6bff4bad7e admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:58.500339 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0e6b88b9-3df4-493e-8cb4-da6bff4bad7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:58.587316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 856/1690] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:50:58 2022] POST /identity/v3/users => generated 289 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:50:58.594091 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489204d6-0e0b-4972-8bd7-bebfaa191a41 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:58.594406 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489204d6-0e0b-4972-8bd7-bebfaa191a41 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:58.595685 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489204d6-0e0b-4972-8bd7-bebfaa191a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:58.631614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-489204d6-0e0b-4972-8bd7-bebfaa191a41 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:58.633986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-489204d6-0e0b-4972-8bd7-bebfaa191a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:58.665884 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 857/1691] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:58.676748 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489204d6-0e0b-4972-8bd7-bebfaa191a41 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:58.678122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b88b9-3df4-493e-8cb4-da6bff4bad7e admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:58.681845 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-489204d6-0e0b-4972-8bd7-bebfaa191a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:58.685417 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8d6c9-e71a-4323-9f93-b2b0893ad1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:58.686646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8d6c9-e71a-4323-9f93-b2b0893ad1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:58.687072 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8d6c9-e71a-4323-9f93-b2b0893ad1af admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:58.687820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8d6c9-e71a-4323-9f93-b2b0893ad1af admin admin] PATH_INFO: `/v3/users/161ee18ead0145e39f18740644f2d4a0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:58.690221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8d6c9-e71a-4323-9f93-b2b0893ad1af admin admin] RBAC: Authorizing `identity:delete_user(user_id=161ee18ead0145e39f18740644f2d4a0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:58.693110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8d6c9-e71a-4323-9f93-b2b0893ad1af admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:58.729835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489204d6-0e0b-4972-8bd7-bebfaa191a41 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:58.743503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f194a5-00ef-4992-a228-decef23279e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:58.744781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f194a5-00ef-4992-a228-decef23279e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:58.745223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f194a5-00ef-4992-a228-decef23279e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:58.745642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f194a5-00ef-4992-a228-decef23279e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:58.746529 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f194a5-00ef-4992-a228-decef23279e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:58.751870 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f194a5-00ef-4992-a228-decef23279e2 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:58.779205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 858/1692] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:58.781731 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ce32c-ad2e-4534-9108-5e2ca88a5e79 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:58.783267 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ce32c-ad2e-4534-9108-5e2ca88a5e79 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:58.783791 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ce32c-ad2e-4534-9108-5e2ca88a5e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:58.843097 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-e54ce32c-ad2e-4534-9108-5e2ca88a5e79 None None] MFA Rules not processed for user `f455a84e20834cec8b84aa88ef263b56`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:58.844666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e54ce32c-ad2e-4534-9108-5e2ca88a5e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:58.992070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ebe8d6c9-e71a-4323-9f93-b2b0893ad1af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '161ee18ead0145e39f18740644f2d4a0'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:59.034616 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 859/1693] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:59.035801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ce32c-ad2e-4534-9108-5e2ca88a5e79 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:59.037791 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e54ce32c-ad2e-4534-9108-5e2ca88a5e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:59.092367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ebe8d6c9-e71a-4323-9f93-b2b0893ad1af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '161ee18ead0145e39f18740644f2d4a0'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:59.113424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ebe8d6c9-e71a-4323-9f93-b2b0893ad1af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '161ee18ead0145e39f18740644f2d4a0'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:59.114425 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ebe8d6c9-e71a-4323-9f93-b2b0893ad1af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '161ee18ead0145e39f18740644f2d4a0'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:59.135962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ebe8d6c9-e71a-4323-9f93-b2b0893ad1af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '161ee18ead0145e39f18740644f2d4a0'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:50:59.146276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ce32c-ad2e-4534-9108-5e2ca88a5e79 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:59.148005 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 835/1694] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:50:58 2022] DELETE /identity/v3/users/161ee18ead0145e39f18740644f2d4a0 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:59.149448 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8d6c9-e71a-4323-9f93-b2b0893ad1af admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:59.169910 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:59.169910 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ebe8d6c9-e71a-4323-9f93-b2b0893ad1af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:59.347262 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a9e0a-9b60-43b9-ba08-ad1a5b87d226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:59.354403 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a9e0a-9b60-43b9-ba08-ad1a5b87d226 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:59.356823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a9e0a-9b60-43b9-ba08-ad1a5b87d226 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:59.357135 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a9e0a-9b60-43b9-ba08-ad1a5b87d226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:59.366573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-0c8a9e0a-9b60-43b9-ba08-ad1a5b87d226 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:59.383165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8d6c9-e71a-4323-9f93-b2b0893ad1af admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:59.392097 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a9e0a-9b60-43b9-ba08-ad1a5b87d226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:59.393855 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a9e0a-9b60-43b9-ba08-ad1a5b87d226 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:59.397882 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b42b62-31c5-4ec1-85e6-0349271f1b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:59.398681 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b42b62-31c5-4ec1-85e6-0349271f1b83 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:59.398979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b42b62-31c5-4ec1-85e6-0349271f1b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:59.401327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b42b62-31c5-4ec1-85e6-0349271f1b83 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:59.401327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b42b62-31c5-4ec1-85e6-0349271f1b83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:59.407339 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b42b62-31c5-4ec1-85e6-0349271f1b83 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:59.420036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 860/1695] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:50:59.422532 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d4878-e061-4e21-8409-a04971e0f3ec None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:59.423084 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d4878-e061-4e21-8409-a04971e0f3ec None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:59.423614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528d4878-e061-4e21-8409-a04971e0f3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:59.441904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 836/1696] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:50:59.451145 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b42b62-31c5-4ec1-85e6-0349271f1b83 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:59.455659 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-528d4878-e061-4e21-8409-a04971e0f3ec None None] MFA Rules not processed for user `ded25521da0d425ea95e7763d7161ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:59.457991 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-528d4878-e061-4e21-8409-a04971e0f3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:59.458617 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-93b42b62-31c5-4ec1-85e6-0349271f1b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:59.553137 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 861/1697] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:50:59.555050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d4878-e061-4e21-8409-a04971e0f3ec None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:50:59.583021 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528d4878-e061-4e21-8409-a04971e0f3ec None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:59.605975 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1f5175-814c-4cab-91a1-adc85e8ddd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:59.607037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f5175-814c-4cab-91a1-adc85e8ddd84 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:59.607381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f5175-814c-4cab-91a1-adc85e8ddd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:59.609521 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1f5175-814c-4cab-91a1-adc85e8ddd84 admin admin] PATH_INFO: `/v3/projects/d1270ad4943145589f2945c399c8752f/users/6b847ce9ab7d4e18be2ce17710e75768/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:59.648800 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f5175-814c-4cab-91a1-adc85e8ddd84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1270ad4943145589f2945c399c8752f, user_id=6b847ce9ab7d4e18be2ce17710e75768, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:59.651828 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1f5175-814c-4cab-91a1-adc85e8ddd84 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:59.659788 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:50:59.718108 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b42b62-31c5-4ec1-85e6-0349271f1b83 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:50:59.740477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d766b2-f47d-43f8-89bc-9243268188f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:50:59.741338 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d766b2-f47d-43f8-89bc-9243268188f1 service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:59.741788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d766b2-f47d-43f8-89bc-9243268188f1 service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:59.742240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d766b2-f47d-43f8-89bc-9243268188f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:59.744438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-82d766b2-f47d-43f8-89bc-9243268188f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:59.771252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 862/1698] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:50:59 2022] PUT /identity/v3/projects/d1270ad4943145589f2945c399c8752f/users/6b847ce9ab7d4e18be2ce17710e75768/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:50:59.781908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63d3b5-c01e-4fb1-abaf-ee2e99a4e40a None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:50:59.783169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63d3b5-c01e-4fb1-abaf-ee2e99a4e40a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:50:59.783169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd63d3b5-c01e-4fb1-abaf-ee2e99a4e40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:50:59.853746 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-dd63d3b5-c01e-4fb1-abaf-ee2e99a4e40a None None] MFA Rules not processed for user `6b847ce9ab7d4e18be2ce17710e75768`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:50:59.858642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-dd63d3b5-c01e-4fb1-abaf-ee2e99a4e40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:50:59.882230 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d766b2-f47d-43f8-89bc-9243268188f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:50:59.886598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d766b2-f47d-43f8-89bc-9243268188f1 service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:50:59.943198 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 837/1699] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:50:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:00.048414 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d766b2-f47d-43f8-89bc-9243268188f1 service nova] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:00.050097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-82d766b2-f47d-43f8-89bc-9243268188f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:00.088967 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d766b2-f47d-43f8-89bc-9243268188f1 service nova] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:00.172765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 863/1700] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:50:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:00.174178 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63d3b5-c01e-4fb1-abaf-ee2e99a4e40a None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:00.397961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2011f8-6423-4020-a6f8-e4dceb8f240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:00.397961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2011f8-6423-4020-a6f8-e4dceb8f240a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:00.397961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2011f8-6423-4020-a6f8-e4dceb8f240a admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:00.397961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2011f8-6423-4020-a6f8-e4dceb8f240a admin admin] PATH_INFO: `/v3/projects/1779af0f226d4ce1ba679e25f9ca1d1a` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:00.405765 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2011f8-6423-4020-a6f8-e4dceb8f240a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1779af0f226d4ce1ba679e25f9ca1d1a)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:00.407758 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2011f8-6423-4020-a6f8-e4dceb8f240a admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:00.464681 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd63d3b5-c01e-4fb1-abaf-ee2e99a4e40a None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:00.471108 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d48a2-27b3-49b9-99df-21e9042b8ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:00.472263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d48a2-27b3-49b9-99df-21e9042b8ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:00.472703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d48a2-27b3-49b9-99df-21e9042b8ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:00.473129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2d48a2-27b3-49b9-99df-21e9042b8ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:00.474200 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d48a2-27b3-49b9-99df-21e9042b8ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:00.477436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2d48a2-27b3-49b9-99df-21e9042b8ea2 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:00.630437 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 864/1701] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:00 2022] POST /identity/v3/projects => generated 373 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:00.634091 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d48a2-27b3-49b9-99df-21e9042b8ea2 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:00.643212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ae2011f8-6423-4020-a6f8-e4dceb8f240a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1779af0f226d4ce1ba679e25f9ca1d1a', 'request_id': 'req-ae2011f8-6423-4020-a6f8-e4dceb8f240a'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:00.729880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ae2011f8-6423-4020-a6f8-e4dceb8f240a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1779af0f226d4ce1ba679e25f9ca1d1a', 'request_id': 'req-ae2011f8-6423-4020-a6f8-e4dceb8f240a'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:00.740247 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ae2011f8-6423-4020-a6f8-e4dceb8f240a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1779af0f226d4ce1ba679e25f9ca1d1a', 'request_id': 'req-ae2011f8-6423-4020-a6f8-e4dceb8f240a'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:00.790108 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ae2011f8-6423-4020-a6f8-e4dceb8f240a admin admin] The token cache is being invalidate because project 1779af0f226d4ce1ba679e25f9ca1d1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:00.790406 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ae2011f8-6423-4020-a6f8-e4dceb8f240a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:00.794432 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ae2011f8-6423-4020-a6f8-e4dceb8f240a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:00.800190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 838/1702] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:00 2022] DELETE /identity/v3/projects/1779af0f226d4ce1ba679e25f9ca1d1a => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:00.802445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:00.804774 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82252607-b62f-43a7-ba43-515548023dbc None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:00.805063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82252607-b62f-43a7-ba43-515548023dbc None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:00.806714 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82252607-b62f-43a7-ba43-515548023dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:00.835897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2d48a2-27b3-49b9-99df-21e9042b8ea2 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:00.846681 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8e438-0225-4ba2-9d77-9a0852a9c836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:00.847445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8e438-0225-4ba2-9d77-9a0852a9c836 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:00.847823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8e438-0225-4ba2-9d77-9a0852a9c836 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:00.848105 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8e438-0225-4ba2-9d77-9a0852a9c836 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:00.866014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8e438-0225-4ba2-9d77-9a0852a9c836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:00.866014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8e438-0225-4ba2-9d77-9a0852a9c836 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:00.882691 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-82252607-b62f-43a7-ba43-515548023dbc None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:00.885007 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-82252607-b62f-43a7-ba43-515548023dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:00.903815 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 839/1703] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:00.907640 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315e0b1-a855-4188-8514-942a85320f38 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:00.908123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315e0b1-a855-4188-8514-942a85320f38 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:00.908624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315e0b1-a855-4188-8514-942a85320f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:00.962810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 865/1704] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:00 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:51:00.967012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8e438-0225-4ba2-9d77-9a0852a9c836 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:00.970183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-1cf8e438-0225-4ba2-9d77-9a0852a9c836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:00.974376 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-5315e0b1-a855-4188-8514-942a85320f38 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:00.975681 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5315e0b1-a855-4188-8514-942a85320f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:01.004316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 840/1705] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:01.019995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315e0b1-a855-4188-8514-942a85320f38 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:01.023734 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8e438-0225-4ba2-9d77-9a0852a9c836 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:01.038323 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650d603-b752-4ee2-9c68-432dd6f751c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:01.039089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650d603-b752-4ee2-9c68-432dd6f751c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:01.039376 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650d603-b752-4ee2-9c68-432dd6f751c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:01.039747 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650d603-b752-4ee2-9c68-432dd6f751c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:01.040536 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650d603-b752-4ee2-9c68-432dd6f751c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:01.046457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5315e0b1-a855-4188-8514-942a85320f38 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:01.048188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f650d603-b752-4ee2-9c68-432dd6f751c5 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:01.065387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c896bc0-8db9-4d44-8031-73d79d5ffe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:01.069309 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c896bc0-8db9-4d44-8031-73d79d5ffe39 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:01.069604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c896bc0-8db9-4d44-8031-73d79d5ffe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:01.069952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c896bc0-8db9-4d44-8031-73d79d5ffe39 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:01.070776 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c896bc0-8db9-4d44-8031-73d79d5ffe39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:51:01.071028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c896bc0-8db9-4d44-8031-73d79d5ffe39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:01.072715 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c896bc0-8db9-4d44-8031-73d79d5ffe39 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:01.079253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 866/1706] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:01.084391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650d603-b752-4ee2-9c68-432dd6f751c5 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:01.111041 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650d603-b752-4ee2-9c68-432dd6f751c5 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:01.111967 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 841/1707] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:51:01.116325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c896bc0-8db9-4d44-8031-73d79d5ffe39 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:01.128580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e691f4-37ee-4f5d-9943-f22ff5f66a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:01.129915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e691f4-37ee-4f5d-9943-f22ff5f66a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:01.129915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e691f4-37ee-4f5d-9943-f22ff5f66a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:01.130129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e691f4-37ee-4f5d-9943-f22ff5f66a46 admin admin] PATH_INFO: `/v3/projects/d83874c476474ff6a995cc93466d33e2/users/148912b9202f4ab3860ac5a0e5ad7b4f/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:01.136029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c896bc0-8db9-4d44-8031-73d79d5ffe39 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:01.149978 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8074e-8ac2-48e6-b302-028330dfcdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:01.150658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8074e-8ac2-48e6-b302-028330dfcdae admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:01.150947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8074e-8ac2-48e6-b302-028330dfcdae admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:01.151230 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8074e-8ac2-48e6-b302-028330dfcdae admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:01.152753 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8074e-8ac2-48e6-b302-028330dfcdae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:01.161785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8074e-8ac2-48e6-b302-028330dfcdae admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:01.166665 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e691f4-37ee-4f5d-9943-f22ff5f66a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83874c476474ff6a995cc93466d33e2, user_id=148912b9202f4ab3860ac5a0e5ad7b4f, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:01.175751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e691f4-37ee-4f5d-9943-f22ff5f66a46 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:01.265043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 867/1708] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:01 2022] PUT /identity/v3/projects/d83874c476474ff6a995cc93466d33e2/users/148912b9202f4ab3860ac5a0e5ad7b4f/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:01.266241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e691f4-37ee-4f5d-9943-f22ff5f66a46 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:01.308578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 842/1709] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:01 2022] POST /identity/v3/projects => generated 357 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:01.314815 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8074e-8ac2-48e6-b302-028330dfcdae admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:01.464069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e691f4-37ee-4f5d-9943-f22ff5f66a46 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:01.526672 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8074e-8ac2-48e6-b302-028330dfcdae admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:01.550681 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c651b-5da0-428a-8dea-05ff563c852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:01.550681 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c651b-5da0-428a-8dea-05ff563c852b admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:01.550681 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c651b-5da0-428a-8dea-05ff563c852b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:01.550681 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c651b-5da0-428a-8dea-05ff563c852b admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:01.551385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c651b-5da0-428a-8dea-05ff563c852b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:01.557926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c651b-5da0-428a-8dea-05ff563c852b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:01.648415 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95937233-3214-4412-913f-df5c1761b815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:01.649204 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95937233-3214-4412-913f-df5c1761b815 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:01.649785 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95937233-3214-4412-913f-df5c1761b815 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:01.650139 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95937233-3214-4412-913f-df5c1761b815 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:01.651038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95937233-3214-4412-913f-df5c1761b815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:01.657779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95937233-3214-4412-913f-df5c1761b815 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:01.692546 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 843/1710] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:01 2022] POST /identity/v3/users => generated 279 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:01.705485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c651b-5da0-428a-8dea-05ff563c852b admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:01.706227 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 868/1711] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:01.707212 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95937233-3214-4412-913f-df5c1761b815 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:01.724247 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c651b-5da0-428a-8dea-05ff563c852b admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:01.736751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95937233-3214-4412-913f-df5c1761b815 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:01.737046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b10ed3-4a7f-4a7d-b4fa-5e679fdf9767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:01.737946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b10ed3-4a7f-4a7d-b4fa-5e679fdf9767 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:01.738389 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b10ed3-4a7f-4a7d-b4fa-5e679fdf9767 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:01.738990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b10ed3-4a7f-4a7d-b4fa-5e679fdf9767 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:01.739922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b10ed3-4a7f-4a7d-b4fa-5e679fdf9767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:01.741766 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b10ed3-4a7f-4a7d-b4fa-5e679fdf9767 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:01.752756 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bae4c8-bb43-4d1f-863c-c378aab8148d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:01.754025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bae4c8-bb43-4d1f-863c-c378aab8148d admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:01.754536 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bae4c8-bb43-4d1f-863c-c378aab8148d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:01.755028 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bae4c8-bb43-4d1f-863c-c378aab8148d admin admin] PATH_INFO: `/v3/projects/d83874c476474ff6a995cc93466d33e2/users/148912b9202f4ab3860ac5a0e5ad7b4f/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:01.760935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bae4c8-bb43-4d1f-863c-c378aab8148d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d83874c476474ff6a995cc93466d33e2, user_id=148912b9202f4ab3860ac5a0e5ad7b4f, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:01.768495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bae4c8-bb43-4d1f-863c-c378aab8148d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:01.783884 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 869/1712] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:01 2022] PUT /identity/v3/projects/d83874c476474ff6a995cc93466d33e2/users/148912b9202f4ab3860ac5a0e5ad7b4f/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:01.792535 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:01.793523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 844/1713] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:01.794571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bae4c8-bb43-4d1f-863c-c378aab8148d admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:01.799378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a0091-cca0-4f22-b3fb-73c02501c6e9 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:01.799711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a0091-cca0-4f22-b3fb-73c02501c6e9 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:01.799997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a0091-cca0-4f22-b3fb-73c02501c6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:01.903971 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-105a0091-cca0-4f22-b3fb-73c02501c6e9 None None] MFA Rules not processed for user `148912b9202f4ab3860ac5a0e5ad7b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:01.913581 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-105a0091-cca0-4f22-b3fb-73c02501c6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:01.957997 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bae4c8-bb43-4d1f-863c-c378aab8148d admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:01.975616 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721b9a4-a07e-4493-ae2e-6c7871c45f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:01.976327 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721b9a4-a07e-4493-ae2e-6c7871c45f5e admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:01.977691 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721b9a4-a07e-4493-ae2e-6c7871c45f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:01.977988 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7721b9a4-a07e-4493-ae2e-6c7871c45f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:01.979008 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721b9a4-a07e-4493-ae2e-6c7871c45f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:01.980791 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7721b9a4-a07e-4493-ae2e-6c7871c45f5e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:02.001272 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 870/1714] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:02.006029 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721b9a4-a07e-4493-ae2e-6c7871c45f5e admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:02.027187 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7721b9a4-a07e-4493-ae2e-6c7871c45f5e admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:02.037038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8554f46-3672-48bc-831d-0fc0ee152229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:02.037958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554f46-3672-48bc-831d-0fc0ee152229 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:02.038241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554f46-3672-48bc-831d-0fc0ee152229 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:02.039141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8554f46-3672-48bc-831d-0fc0ee152229 admin admin] PATH_INFO: `/v3/projects/0783c6a382174f8286339f6b1044f2f6/users/396a369cba2c48c39d3dd3616bd0f53b/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:02.061963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:02.074015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8554f46-3672-48bc-831d-0fc0ee152229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0783c6a382174f8286339f6b1044f2f6, user_id=396a369cba2c48c39d3dd3616bd0f53b, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:02.083595 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8554f46-3672-48bc-831d-0fc0ee152229 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:02.141316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 845/1715] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:02.147085 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc25ac-b1e4-4cc4-9e9f-cf15c89f94bf None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:02.148832 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc25ac-b1e4-4cc4-9e9f-cf15c89f94bf None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:02.154404 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc25ac-b1e4-4cc4-9e9f-cf15c89f94bf None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:02.154404 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 846/1716] 10.222.0.36 () {54 vars in 912 bytes} [Mon Jun 27 18:51:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:51:02.156366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc25ac-b1e4-4cc4-9e9f-cf15c89f94bf None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:02.163206 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-85dc25ac-b1e4-4cc4-9e9f-cf15c89f94bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:02.182528 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 871/1717] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:02 2022] PUT /identity/v3/projects/0783c6a382174f8286339f6b1044f2f6/users/396a369cba2c48c39d3dd3616bd0f53b/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:02.183932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804a89d-3ff6-4592-ab6a-eadb7af60d3c None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:02.184351 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804a89d-3ff6-4592-ab6a-eadb7af60d3c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:02.184634 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804a89d-3ff6-4592-ab6a-eadb7af60d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:02.213697 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:02.226223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-7804a89d-3ff6-4592-ab6a-eadb7af60d3c None None] MFA Rules not processed for user `1e684ee875464138abc4e89060902100`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:02.227473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-7804a89d-3ff6-4592-ab6a-eadb7af60d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:02.286678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc25ac-b1e4-4cc4-9e9f-cf15c89f94bf None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:02.299107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215271db-93e5-4e20-b9d1-0ab3079376da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:02.300921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215271db-93e5-4e20-b9d1-0ab3079376da service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:02.300921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215271db-93e5-4e20-b9d1-0ab3079376da service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:02.300921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215271db-93e5-4e20-b9d1-0ab3079376da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:02.308668 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-215271db-93e5-4e20-b9d1-0ab3079376da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:02.364759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 872/1718] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jun 27 18:51:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:02.366464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d125e-5004-4ed3-8ef4-0bc7207bbbb0 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:02.366579 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d125e-5004-4ed3-8ef4-0bc7207bbbb0 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:02.371035 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d125e-5004-4ed3-8ef4-0bc7207bbbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:02.430513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-5c7d125e-5004-4ed3-8ef4-0bc7207bbbb0 None None] MFA Rules not processed for user `396a369cba2c48c39d3dd3616bd0f53b`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:02.431818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-5c7d125e-5004-4ed3-8ef4-0bc7207bbbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:02.437375 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215271db-93e5-4e20-b9d1-0ab3079376da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:02.438988 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215271db-93e5-4e20-b9d1-0ab3079376da service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:02.471198 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 847/1719] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:02.472803 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215271db-93e5-4e20-b9d1-0ab3079376da service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:02.476155 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-215271db-93e5-4e20-b9d1-0ab3079376da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:02.521791 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215271db-93e5-4e20-b9d1-0ab3079376da service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:02.540636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a90200-2af4-4dee-9479-ac3e81054d70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:02.541253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a90200-2af4-4dee-9479-ac3e81054d70 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:02.541500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a90200-2af4-4dee-9479-ac3e81054d70 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:02.541771 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a90200-2af4-4dee-9479-ac3e81054d70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:02.557643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a90200-2af4-4dee-9479-ac3e81054d70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:02.562035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a90200-2af4-4dee-9479-ac3e81054d70 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:02.583261 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 848/1720] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:02.585107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a90200-2af4-4dee-9479-ac3e81054d70 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:02.589618 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-a2a90200-2af4-4dee-9479-ac3e81054d70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:02.650787 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 873/1721] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:02 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:02.655842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d125e-5004-4ed3-8ef4-0bc7207bbbb0 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:02.773385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a90200-2af4-4dee-9479-ac3e81054d70 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:02.793906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c98de-f211-451b-affd-facf631586e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:02.794770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c98de-f211-451b-affd-facf631586e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:02.795088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c98de-f211-451b-affd-facf631586e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:02.795447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c98de-f211-451b-affd-facf631586e3 admin admin] PATH_INFO: `/v3/projects/856a7585f5494ac88071e74b5c726b28` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:02.802278 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c98de-f211-451b-affd-facf631586e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=856a7585f5494ac88071e74b5c726b28)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:02.808066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c98de-f211-451b-affd-facf631586e3 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:02.873005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d125e-5004-4ed3-8ef4-0bc7207bbbb0 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:02.884369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65e829-7f2a-4eae-8742-1ebcbb8709f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:02.885060 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65e829-7f2a-4eae-8742-1ebcbb8709f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:02.885350 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65e829-7f2a-4eae-8742-1ebcbb8709f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:02.885916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65e829-7f2a-4eae-8742-1ebcbb8709f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:02.886489 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65e829-7f2a-4eae-8742-1ebcbb8709f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:02.895612 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65e829-7f2a-4eae-8742-1ebcbb8709f9 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:03.048151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 874/1722] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:02 2022] POST /identity/v3/projects => generated 357 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:03.049301 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65e829-7f2a-4eae-8742-1ebcbb8709f9 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:03.081733 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2f4c98de-f211-451b-affd-facf631586e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856a7585f5494ac88071e74b5c726b28', 'request_id': 'req-2f4c98de-f211-451b-affd-facf631586e3'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:03.118120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:03.204099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2f4c98de-f211-451b-affd-facf631586e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856a7585f5494ac88071e74b5c726b28', 'request_id': 'req-2f4c98de-f211-451b-affd-facf631586e3'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:03.215212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2f4c98de-f211-451b-affd-facf631586e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856a7585f5494ac88071e74b5c726b28', 'request_id': 'req-2f4c98de-f211-451b-affd-facf631586e3'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:03.250860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2f4c98de-f211-451b-affd-facf631586e3 admin admin] The token cache is being invalidate because project 856a7585f5494ac88071e74b5c726b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:03.251159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2f4c98de-f211-451b-affd-facf631586e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:03.254175 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2f4c98de-f211-451b-affd-facf631586e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:03.258335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 849/1723] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:02 2022] DELETE /identity/v3/projects/856a7585f5494ac88071e74b5c726b28 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:03.263490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c98de-f211-451b-affd-facf631586e3 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:03.271799 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-2f4c98de-f211-451b-affd-facf631586e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:03.318725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65e829-7f2a-4eae-8742-1ebcbb8709f9 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:03.328979 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a0ad9-9840-443a-94f8-76d994879900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:03.330148 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a0ad9-9840-443a-94f8-76d994879900 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:03.330626 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a0ad9-9840-443a-94f8-76d994879900 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:03.333109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a0ad9-9840-443a-94f8-76d994879900 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:03.334528 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a0ad9-9840-443a-94f8-76d994879900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:03.339170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a0ad9-9840-443a-94f8-76d994879900 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:03.469290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 875/1724] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:03 2022] POST /identity/v3/users => generated 285 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:03.473951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a0ad9-9840-443a-94f8-76d994879900 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:03.477843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-af9a0ad9-9840-443a-94f8-76d994879900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:03.510319 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a0ad9-9840-443a-94f8-76d994879900 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:03.520683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8743af-bb25-47ac-8885-7de3f1264413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:03.522233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8743af-bb25-47ac-8885-7de3f1264413 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:03.523197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8743af-bb25-47ac-8885-7de3f1264413 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:03.523656 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8743af-bb25-47ac-8885-7de3f1264413 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:03.524815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8743af-bb25-47ac-8885-7de3f1264413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:03.532793 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8743af-bb25-47ac-8885-7de3f1264413 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:03.559171 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 876/1725] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:03.564213 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8743af-bb25-47ac-8885-7de3f1264413 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:03.620459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8743af-bb25-47ac-8885-7de3f1264413 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:03.637692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7ef61-95b8-40cd-b10e-b58facbab9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:03.638622 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ef61-95b8-40cd-b10e-b58facbab9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:03.638943 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ef61-95b8-40cd-b10e-b58facbab9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:03.639227 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7ef61-95b8-40cd-b10e-b58facbab9f7 admin admin] PATH_INFO: `/v3/projects/b276f44279c44dfc8c6d19d249a7456c/users/32bd7455cd9c4afeb4d403b941e774da/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:03.677557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7ef61-95b8-40cd-b10e-b58facbab9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b276f44279c44dfc8c6d19d249a7456c, user_id=32bd7455cd9c4afeb4d403b941e774da, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:03.680290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7ef61-95b8-40cd-b10e-b58facbab9f7 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:03.721278 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:03.737189 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c98de-f211-451b-affd-facf631586e3 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:03.754351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ebc0a-45dd-48d0-8ccc-269f47853088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:03.755258 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ebc0a-45dd-48d0-8ccc-269f47853088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:03.755565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ebc0a-45dd-48d0-8ccc-269f47853088 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:03.755880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ebc0a-45dd-48d0-8ccc-269f47853088 admin admin] PATH_INFO: `/v3/users/19170a1a45344b3a81b915766246d49f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:03.758499 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ebc0a-45dd-48d0-8ccc-269f47853088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19170a1a45344b3a81b915766246d49f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:03.760480 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2ebc0a-45dd-48d0-8ccc-269f47853088 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:03.799956 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 877/1726] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:03 2022] PUT /identity/v3/projects/b276f44279c44dfc8c6d19d249a7456c/users/32bd7455cd9c4afeb4d403b941e774da/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:03.801654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295191df-3c33-4e63-b2ce-b2d40cfd6b49 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:03.802105 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295191df-3c33-4e63-b2ce-b2d40cfd6b49 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:03.805864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295191df-3c33-4e63-b2ce-b2d40cfd6b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:03.921159 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-295191df-3c33-4e63-b2ce-b2d40cfd6b49 None None] MFA Rules not processed for user `89794cd59f4d44318aff08fe38de3dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:03.922659 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-295191df-3c33-4e63-b2ce-b2d40cfd6b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:04.037905 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-3b2ebc0a-45dd-48d0-8ccc-269f47853088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19170a1a45344b3a81b915766246d49f'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:04.077530 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 878/1727] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:04.078761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295191df-3c33-4e63-b2ce-b2d40cfd6b49 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:04.140799 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-3b2ebc0a-45dd-48d0-8ccc-269f47853088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19170a1a45344b3a81b915766246d49f'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:04.162737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-3b2ebc0a-45dd-48d0-8ccc-269f47853088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19170a1a45344b3a81b915766246d49f'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:04.164934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-3b2ebc0a-45dd-48d0-8ccc-269f47853088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19170a1a45344b3a81b915766246d49f'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:04.186671 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-3b2ebc0a-45dd-48d0-8ccc-269f47853088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19170a1a45344b3a81b915766246d49f'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:04.208165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 850/1728] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:03 2022] DELETE /identity/v3/users/19170a1a45344b3a81b915766246d49f => generated 0 bytes in 945 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:04.210190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e2807-3ded-473b-9d6a-41690787dbf8 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:04.210643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e2807-3ded-473b-9d6a-41690787dbf8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:04.211174 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e2807-3ded-473b-9d6a-41690787dbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:04.236859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295191df-3c33-4e63-b2ce-b2d40cfd6b49 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:04.239045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-828e2807-3ded-473b-9d6a-41690787dbf8 None None] MFA Rules not processed for user `89794cd59f4d44318aff08fe38de3dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:04.240511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-828e2807-3ded-473b-9d6a-41690787dbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:04.408299 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e08ac-3f87-4369-ab37-b51cf79ebd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:04.410507 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e08ac-3f87-4369-ab37-b51cf79ebd70 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:04.410797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e08ac-3f87-4369-ab37-b51cf79ebd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:04.415567 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e08ac-3f87-4369-ab37-b51cf79ebd70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:04.416170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e08ac-3f87-4369-ab37-b51cf79ebd70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:04.423023 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 851/1729] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:04.428657 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e08ac-3f87-4369-ab37-b51cf79ebd70 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:04.435457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e2807-3ded-473b-9d6a-41690787dbf8 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:04.438097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-828e2807-3ded-473b-9d6a-41690787dbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:04.479643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 879/1730] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:04.484663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e08ac-3f87-4369-ab37-b51cf79ebd70 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:04.487428 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-566e08ac-3f87-4369-ab37-b51cf79ebd70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:04.544429 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e08ac-3f87-4369-ab37-b51cf79ebd70 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:04.566730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53330f-1fc5-4cda-ad28-74e77a13a81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:04.567686 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53330f-1fc5-4cda-ad28-74e77a13a81f admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:04.567970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53330f-1fc5-4cda-ad28-74e77a13a81f admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:04.568249 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53330f-1fc5-4cda-ad28-74e77a13a81f admin admin] PATH_INFO: `/v3/projects/b276f44279c44dfc8c6d19d249a7456c/users/32bd7455cd9c4afeb4d403b941e774da/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:04.577054 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53330f-1fc5-4cda-ad28-74e77a13a81f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b276f44279c44dfc8c6d19d249a7456c, user_id=32bd7455cd9c4afeb4d403b941e774da, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:04.579776 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53330f-1fc5-4cda-ad28-74e77a13a81f admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:04.625279 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 880/1731] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:04 2022] PUT /identity/v3/projects/b276f44279c44dfc8c6d19d249a7456c/users/32bd7455cd9c4afeb4d403b941e774da/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:04.629023 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53330f-1fc5-4cda-ad28-74e77a13a81f admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:04.638129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-4d53330f-1fc5-4cda-ad28-74e77a13a81f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:04.663757 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e2807-3ded-473b-9d6a-41690787dbf8 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:04.890206 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53330f-1fc5-4cda-ad28-74e77a13a81f admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:04.904369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:04.905979 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3d701-d82a-4267-adab-98eea71a69a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af6ef16884604753972c916f74271f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:04.906741 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d701-d82a-4267-adab-98eea71a69a1 service placement] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:04.907088 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d701-d82a-4267-adab-98eea71a69a1 service placement] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:04.908249 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d701-d82a-4267-adab-98eea71a69a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:04.911475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ffc3d701-d82a-4267-adab-98eea71a69a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:04.920757 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15f354-ddab-45fd-aabd-42797aaaee0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:04.922605 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15f354-ddab-45fd-aabd-42797aaaee0f service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:04.924497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15f354-ddab-45fd-aabd-42797aaaee0f service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:04.925597 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15f354-ddab-45fd-aabd-42797aaaee0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:04.932828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ab15f354-ddab-45fd-aabd-42797aaaee0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:04.968365 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3d701-d82a-4267-adab-98eea71a69a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:04.970024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3d701-d82a-4267-adab-98eea71a69a1 service placement] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:05.000040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 881/1732] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:05.012217 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f114e-95d1-46b5-b005-ae5c7c922e2a None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:05.012646 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f114e-95d1-46b5-b005-ae5c7c922e2a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:05.012945 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f114e-95d1-46b5-b005-ae5c7c922e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:05.119296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-319f114e-95d1-46b5-b005-ae5c7c922e2a None None] MFA Rules not processed for user `32bd7455cd9c4afeb4d403b941e774da`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:05.121881 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-319f114e-95d1-46b5-b005-ae5c7c922e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:05.258843 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15f354-ddab-45fd-aabd-42797aaaee0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:05.263397 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15f354-ddab-45fd-aabd-42797aaaee0f service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:05.309759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 852/1733] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 874 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:51:05.394171 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 882/1734] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:05 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:05.407924 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15f354-ddab-45fd-aabd-42797aaaee0f service nova] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:05.410355 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ab15f354-ddab-45fd-aabd-42797aaaee0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:05.478899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286173a0-becc-455f-a542-24f2c71aadb4 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:05.479225 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286173a0-becc-455f-a542-24f2c71aadb4 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:05.479749 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286173a0-becc-455f-a542-24f2c71aadb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:05.630111 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-286173a0-becc-455f-a542-24f2c71aadb4 None None] MFA Rules not processed for user `798c13c87b814d1182c6df3b29ec5986`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:05.630111 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-286173a0-becc-455f-a542-24f2c71aadb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:05.709425 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15f354-ddab-45fd-aabd-42797aaaee0f service nova] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:05.719906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae0b12-702a-467e-b5a2-d02be533278d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:05.720837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae0b12-702a-467e-b5a2-d02be533278d service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:05.721190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae0b12-702a-467e-b5a2-d02be533278d service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:05.721835 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae0b12-702a-467e-b5a2-d02be533278d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:05.768437 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae0b12-702a-467e-b5a2-d02be533278d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:05.800766 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae0b12-702a-467e-b5a2-d02be533278d service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:05.852199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 883/1735] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:05.883743 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 853/1736] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:05 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:05.888972 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:06.033465 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286173a0-becc-455f-a542-24f2c71aadb4 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:06.034631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-286173a0-becc-455f-a542-24f2c71aadb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:06.085763 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286173a0-becc-455f-a542-24f2c71aadb4 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:06.112763 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e95a6-fa20-4587-9774-0cb88451ca1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:06.113454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e95a6-fa20-4587-9774-0cb88451ca1f service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:06.113744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e95a6-fa20-4587-9774-0cb88451ca1f service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:06.114026 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e95a6-fa20-4587-9774-0cb88451ca1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:06.133666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e95a6-fa20-4587-9774-0cb88451ca1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:06.142585 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e95a6-fa20-4587-9774-0cb88451ca1f service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:06.168965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 884/1737] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:06.190573 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae0b12-702a-467e-b5a2-d02be533278d service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:06.193139 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-70ae0b12-702a-467e-b5a2-d02be533278d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:06.209082 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae0b12-702a-467e-b5a2-d02be533278d service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:06.214714 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbbeb1-a2dc-43b5-924d-c91a5cb89213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:06.215431 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbbeb1-a2dc-43b5-924d-c91a5cb89213 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:06.215945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbbeb1-a2dc-43b5-924d-c91a5cb89213 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:06.216935 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbbeb1-a2dc-43b5-924d-c91a5cb89213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:06.220010 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-10dbbeb1-a2dc-43b5-924d-c91a5cb89213 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:06.265470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:06.275925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e95a6-fa20-4587-9774-0cb88451ca1f service nova] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:06.277502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-061e95a6-fa20-4587-9774-0cb88451ca1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:06.373652 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbbeb1-a2dc-43b5-924d-c91a5cb89213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:06.376233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbbeb1-a2dc-43b5-924d-c91a5cb89213 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:06.391444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 854/1738] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:06 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:06.427875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e95a6-fa20-4587-9774-0cb88451ca1f service nova] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:06.440963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3abe4-abcc-4aa3-91f6-c58fb536ac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:06.442123 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3abe4-abcc-4aa3-91f6-c58fb536ac7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:06.442554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3abe4-abcc-4aa3-91f6-c58fb536ac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:06.442976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3abe4-abcc-4aa3-91f6-c58fb536ac7f admin admin] PATH_INFO: `/v3/projects/dff5857878cf467e966d9c037f5b93fd` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:06.444782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3abe4-abcc-4aa3-91f6-c58fb536ac7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dff5857878cf467e966d9c037f5b93fd)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:06.454849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3abe4-abcc-4aa3-91f6-c58fb536ac7f admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:06.653316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-daf3abe4-abcc-4aa3-91f6-c58fb536ac7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff5857878cf467e966d9c037f5b93fd', 'request_id': 'req-daf3abe4-abcc-4aa3-91f6-c58fb536ac7f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:06.662602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-daf3abe4-abcc-4aa3-91f6-c58fb536ac7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff5857878cf467e966d9c037f5b93fd', 'request_id': 'req-daf3abe4-abcc-4aa3-91f6-c58fb536ac7f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:06.770397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-daf3abe4-abcc-4aa3-91f6-c58fb536ac7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff5857878cf467e966d9c037f5b93fd', 'request_id': 'req-daf3abe4-abcc-4aa3-91f6-c58fb536ac7f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:06.790253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-daf3abe4-abcc-4aa3-91f6-c58fb536ac7f admin admin] The token cache is being invalidate because project dff5857878cf467e966d9c037f5b93fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:06.791337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-daf3abe4-abcc-4aa3-91f6-c58fb536ac7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:06.792310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-daf3abe4-abcc-4aa3-91f6-c58fb536ac7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:06.794688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 885/1739] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:06 2022] DELETE /identity/v3/projects/dff5857878cf467e966d9c037f5b93fd => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:06.801025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc404bae-932f-4e08-bcb6-897732e6c5a5 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:06.802759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc404bae-932f-4e08-bcb6-897732e6c5a5 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:06.802759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc404bae-932f-4e08-bcb6-897732e6c5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:06.837266 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-bc404bae-932f-4e08-bcb6-897732e6c5a5 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:06.839449 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-bc404bae-932f-4e08-bcb6-897732e6c5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:06.994935 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 855/1740] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:07.007713 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b4716-d469-4a8e-9d0f-655bc499cd58 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:07.008013 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b4716-d469-4a8e-9d0f-655bc499cd58 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:07.008302 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b4716-d469-4a8e-9d0f-655bc499cd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:07.085740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-1f2b4716-d469-4a8e-9d0f-655bc499cd58 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:07.093139 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-1f2b4716-d469-4a8e-9d0f-655bc499cd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:07.116867 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 886/1741] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:07.121542 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc404bae-932f-4e08-bcb6-897732e6c5a5 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:07.139940 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc404bae-932f-4e08-bcb6-897732e6c5a5 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:07.150696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fe231-eb99-4a4b-bbba-ebb0fae8b219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:07.151734 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fe231-eb99-4a4b-bbba-ebb0fae8b219 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:07.152202 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fe231-eb99-4a4b-bbba-ebb0fae8b219 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:07.156761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324fe231-eb99-4a4b-bbba-ebb0fae8b219 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:07.157779 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fe231-eb99-4a4b-bbba-ebb0fae8b219 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:51:07.160091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fe231-eb99-4a4b-bbba-ebb0fae8b219 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:07.161884 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324fe231-eb99-4a4b-bbba-ebb0fae8b219 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:07.194696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 856/1742] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:51:07.199501 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b4716-d469-4a8e-9d0f-655bc499cd58 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:07.211254 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b4716-d469-4a8e-9d0f-655bc499cd58 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:07.213156 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fe231-eb99-4a4b-bbba-ebb0fae8b219 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:07.232015 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-324fe231-eb99-4a4b-bbba-ebb0fae8b219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:07.239430 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb8259-d56b-4ed5-9326-df2e6b7d6dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:07.240183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb8259-d56b-4ed5-9326-df2e6b7d6dce admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:07.240468 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb8259-d56b-4ed5-9326-df2e6b7d6dce admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:07.240748 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bb8259-d56b-4ed5-9326-df2e6b7d6dce admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:07.241454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb8259-d56b-4ed5-9326-df2e6b7d6dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:07.247138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bb8259-d56b-4ed5-9326-df2e6b7d6dce admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:07.352103 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 887/1743] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:07 2022] POST /identity/v3/projects => generated 363 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:07.354535 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb8259-d56b-4ed5-9326-df2e6b7d6dce admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:07.412828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:07.418162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324fe231-eb99-4a4b-bbba-ebb0fae8b219 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:07.549612 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bb8259-d56b-4ed5-9326-df2e6b7d6dce admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:07.556082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52463663-b69a-4f80-97af-71358d3e9d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:07.557147 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52463663-b69a-4f80-97af-71358d3e9d48 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:07.557616 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52463663-b69a-4f80-97af-71358d3e9d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:07.558106 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52463663-b69a-4f80-97af-71358d3e9d48 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:07.558545 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df0e17-e2a3-4dcd-9ba1-1ba3266b448e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:07.559434 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df0e17-e2a3-4dcd-9ba1-1ba3266b448e service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:07.560327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df0e17-e2a3-4dcd-9ba1-1ba3266b448e service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:07.560476 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52463663-b69a-4f80-97af-71358d3e9d48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:07.562850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df0e17-e2a3-4dcd-9ba1-1ba3266b448e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:07.563413 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52463663-b69a-4f80-97af-71358d3e9d48 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:07.571741 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-68df0e17-e2a3-4dcd-9ba1-1ba3266b448e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:07.694007 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df0e17-e2a3-4dcd-9ba1-1ba3266b448e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:07.696480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 888/1744] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:07 2022] POST /identity/v3/users => generated 282 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:07.696934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df0e17-e2a3-4dcd-9ba1-1ba3266b448e service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:07.698385 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516df988-d8ca-4eed-9721-08fa7d4c5fea None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:07.698849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516df988-d8ca-4eed-9721-08fa7d4c5fea None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:07.702768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516df988-d8ca-4eed-9721-08fa7d4c5fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:07.711513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:07.757895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 857/1745] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:07.778333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df0e17-e2a3-4dcd-9ba1-1ba3266b448e service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:07.787870 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-516df988-d8ca-4eed-9721-08fa7d4c5fea None None] MFA Rules not processed for user `98c0d19387594287b31a8976870b53a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:07.789730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-516df988-d8ca-4eed-9721-08fa7d4c5fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:07.852746 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df0e17-e2a3-4dcd-9ba1-1ba3266b448e service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:07.881571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b24fc-14bd-4221-aed6-e20c7a8cd997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:07.883985 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b24fc-14bd-4221-aed6-e20c7a8cd997 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:07.885394 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b24fc-14bd-4221-aed6-e20c7a8cd997 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:07.897449 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b24fc-14bd-4221-aed6-e20c7a8cd997 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:07.900992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b24fc-14bd-4221-aed6-e20c7a8cd997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:07.915796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b24fc-14bd-4221-aed6-e20c7a8cd997 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:07.952591 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 858/1746] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:07.960420 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b24fc-14bd-4221-aed6-e20c7a8cd997 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:07.982656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b24fc-14bd-4221-aed6-e20c7a8cd997 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:07.994717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 889/1747] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:07.994917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169a313-550a-4576-9a28-76113d99f9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:07.994917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169a313-550a-4576-9a28-76113d99f9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:07.994917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169a313-550a-4576-9a28-76113d99f9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:07.994917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169a313-550a-4576-9a28-76113d99f9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:07.997333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00993a4b-46be-453d-9c8f-b95503015be6 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:07.997455 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169a313-550a-4576-9a28-76113d99f9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:07.998056 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00993a4b-46be-453d-9c8f-b95503015be6 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:07.998371 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00993a4b-46be-453d-9c8f-b95503015be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:08.007986 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169a313-550a-4576-9a28-76113d99f9c8 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:08.028600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-00993a4b-46be-453d-9c8f-b95503015be6 None None] MFA Rules not processed for user `98c0d19387594287b31a8976870b53a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:08.031520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-00993a4b-46be-453d-9c8f-b95503015be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:08.043957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 890/1748] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:08.058975 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00993a4b-46be-453d-9c8f-b95503015be6 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:08.059259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 859/1749] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:08.060829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169a313-550a-4576-9a28-76113d99f9c8 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:08.086882 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169a313-550a-4576-9a28-76113d99f9c8 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:08.099573 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbc874-5076-4fcf-aa44-42c46640c3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:08.100260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-00993a4b-46be-453d-9c8f-b95503015be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:08.100641 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbc874-5076-4fcf-aa44-42c46640c3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:08.100970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbc874-5076-4fcf-aa44-42c46640c3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:08.101364 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbc874-5076-4fcf-aa44-42c46640c3c8 admin admin] PATH_INFO: `/v3/projects/b588058807d94e80985337de5a38fb5f/users/ffdc14b5e5c54df18792519fe9bca07a/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:08.150231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbc874-5076-4fcf-aa44-42c46640c3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b588058807d94e80985337de5a38fb5f, user_id=ffdc14b5e5c54df18792519fe9bca07a, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:08.156869 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbc874-5076-4fcf-aa44-42c46640c3c8 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:08.278854 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 860/1750] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:08 2022] PUT /identity/v3/projects/b588058807d94e80985337de5a38fb5f/users/ffdc14b5e5c54df18792519fe9bca07a/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:08.291052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d304842-7481-4ad5-99eb-d92d46571abe None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:08.291349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d304842-7481-4ad5-99eb-d92d46571abe None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:08.291655 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d304842-7481-4ad5-99eb-d92d46571abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:08.392641 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-5d304842-7481-4ad5-99eb-d92d46571abe None None] MFA Rules not processed for user `89794cd59f4d44318aff08fe38de3dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:08.393892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5d304842-7481-4ad5-99eb-d92d46571abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:08.398480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00993a4b-46be-453d-9c8f-b95503015be6 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:08.707225 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 861/1751] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:08.716573 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36a5be-fdc5-48ed-9eee-90f96014de89 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:08.718005 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36a5be-fdc5-48ed-9eee-90f96014de89 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:08.718699 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36a5be-fdc5-48ed-9eee-90f96014de89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:08.737498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a484a54-a25e-4c3a-8f06-57f012146835 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:08.739441 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a484a54-a25e-4c3a-8f06-57f012146835 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:08.744345 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a484a54-a25e-4c3a-8f06-57f012146835 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:08.744345 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a484a54-a25e-4c3a-8f06-57f012146835 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:08.810981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-0f36a5be-fdc5-48ed-9eee-90f96014de89 None None] MFA Rules not processed for user `ffdc14b5e5c54df18792519fe9bca07a`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:08.812984 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0f36a5be-fdc5-48ed-9eee-90f96014de89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:08.886661 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a484a54-a25e-4c3a-8f06-57f012146835 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:08.888727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a484a54-a25e-4c3a-8f06-57f012146835 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:08.904549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 891/1752] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 846 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:08.961280 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 862/1753] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:08 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:08.963380 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a484a54-a25e-4c3a-8f06-57f012146835 service nova] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:09.128999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb4555-7049-4c6c-9e59-22a8baec8413 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:09.130092 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb4555-7049-4c6c-9e59-22a8baec8413 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:09.130630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb4555-7049-4c6c-9e59-22a8baec8413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:09.141336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a484a54-a25e-4c3a-8f06-57f012146835 service nova] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:09.159410 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe928b66-f436-4ab6-9e62-cd98f8d74617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:09.163257 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe928b66-f436-4ab6-9e62-cd98f8d74617 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:09.164678 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe928b66-f436-4ab6-9e62-cd98f8d74617 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:09.164678 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe928b66-f436-4ab6-9e62-cd98f8d74617 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:09.166734 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe928b66-f436-4ab6-9e62-cd98f8d74617 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:09.174698 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe928b66-f436-4ab6-9e62-cd98f8d74617 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:09.189438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-eacb4555-7049-4c6c-9e59-22a8baec8413 None None] MFA Rules not processed for user `f455a84e20834cec8b84aa88ef263b56`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:09.195292 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-eacb4555-7049-4c6c-9e59-22a8baec8413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:09.342547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 892/1754] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:08 2022] POST /identity/v3/projects => generated 365 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:09.351668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe928b66-f436-4ab6-9e62-cd98f8d74617 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:09.376192 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 863/1755] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:09.396386 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:09.502536 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe928b66-f436-4ab6-9e62-cd98f8d74617 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:09.520084 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076ca8a-e57e-4f7a-8a01-9803e1a7b90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:09.521077 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076ca8a-e57e-4f7a-8a01-9803e1a7b90c admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:09.521508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076ca8a-e57e-4f7a-8a01-9803e1a7b90c admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:09.521929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5076ca8a-e57e-4f7a-8a01-9803e1a7b90c admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:09.523967 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076ca8a-e57e-4f7a-8a01-9803e1a7b90c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:09.540497 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5076ca8a-e57e-4f7a-8a01-9803e1a7b90c admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:09.677344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 893/1756] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:09 2022] POST /identity/v3/users => generated 289 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:09.681485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb4555-7049-4c6c-9e59-22a8baec8413 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:09.733606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb4555-7049-4c6c-9e59-22a8baec8413 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:09.775044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43e04d-4bf5-4613-9929-cf8c23942939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:09.778908 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e04d-4bf5-4613-9929-cf8c23942939 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:09.782610 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e04d-4bf5-4613-9929-cf8c23942939 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:09.783817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43e04d-4bf5-4613-9929-cf8c23942939 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:09.785227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43e04d-4bf5-4613-9929-cf8c23942939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:09.794114 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43e04d-4bf5-4613-9929-cf8c23942939 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:09.827059 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 864/1757] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:09.830477 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076ca8a-e57e-4f7a-8a01-9803e1a7b90c admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:09.851637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5076ca8a-e57e-4f7a-8a01-9803e1a7b90c admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:09.872342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb9143-b799-48bf-bca5-54972ca49b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:09.874113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb9143-b799-48bf-bca5-54972ca49b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:09.874543 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb9143-b799-48bf-bca5-54972ca49b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:09.874954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb9143-b799-48bf-bca5-54972ca49b3a admin admin] PATH_INFO: `/v3/projects/04d7181fc9a8472ea5eca3bdbb4a0db3/users/8b4e74d9cf0b460fb5bc185ca198fd8a/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:09.965309 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb9143-b799-48bf-bca5-54972ca49b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d7181fc9a8472ea5eca3bdbb4a0db3, user_id=8b4e74d9cf0b460fb5bc185ca198fd8a, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:09.969554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb9143-b799-48bf-bca5-54972ca49b3a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:10.044485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:10.108648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 894/1758] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:09 2022] PUT /identity/v3/projects/04d7181fc9a8472ea5eca3bdbb4a0db3/users/8b4e74d9cf0b460fb5bc185ca198fd8a/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:10.112115 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43e04d-4bf5-4613-9929-cf8c23942939 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:10.136505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43e04d-4bf5-4613-9929-cf8c23942939 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:10.353320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431e372-349c-489b-b165-084ab433f3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:10.355457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431e372-349c-489b-b165-084ab433f3bb admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:10.355457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431e372-349c-489b-b165-084ab433f3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:10.355457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431e372-349c-489b-b165-084ab433f3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:10.358591 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431e372-349c-489b-b165-084ab433f3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:10.361725 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431e372-349c-489b-b165-084ab433f3bb admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:10.399696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 865/1759] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:10.403311 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb9143-b799-48bf-bca5-54972ca49b3a admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:10.424495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb9143-b799-48bf-bca5-54972ca49b3a admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:10.453094 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687d497-4a54-481d-b33f-bb199019b581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:10.454342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687d497-4a54-481d-b33f-bb199019b581 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:10.454960 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687d497-4a54-481d-b33f-bb199019b581 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:10.455258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687d497-4a54-481d-b33f-bb199019b581 admin admin] PATH_INFO: `/v3/projects/04d7181fc9a8472ea5eca3bdbb4a0db3/users/8b4e74d9cf0b460fb5bc185ca198fd8a/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:10.467337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687d497-4a54-481d-b33f-bb199019b581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d7181fc9a8472ea5eca3bdbb4a0db3, user_id=8b4e74d9cf0b460fb5bc185ca198fd8a, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:10.471000 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687d497-4a54-481d-b33f-bb199019b581 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:10.547087 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97ac5c-8859-4035-87b8-63365faa6b7c None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:10.547390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97ac5c-8859-4035-87b8-63365faa6b7c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:10.547719 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97ac5c-8859-4035-87b8-63365faa6b7c None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:10.555586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 866/1760] 10.222.0.36 () {54 vars in 912 bytes} [Mon Jun 27 18:51:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:51:10.556984 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835185b-eb9f-4e53-9d32-a5f9540dd779 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:10.556984 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835185b-eb9f-4e53-9d32-a5f9540dd779 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:10.556984 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835185b-eb9f-4e53-9d32-a5f9540dd779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:10.566349 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 895/1761] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:10 2022] PUT /identity/v3/projects/04d7181fc9a8472ea5eca3bdbb4a0db3/users/8b4e74d9cf0b460fb5bc185ca198fd8a/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:10.579087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7022e-1540-4e88-a87b-f0d2e44bef09 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:10.580316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7022e-1540-4e88-a87b-f0d2e44bef09 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:10.580612 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7022e-1540-4e88-a87b-f0d2e44bef09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:10.691933 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-f835185b-eb9f-4e53-9d32-a5f9540dd779 None None] MFA Rules not processed for user `1e684ee875464138abc4e89060902100`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:10.696810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-f835185b-eb9f-4e53-9d32-a5f9540dd779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:10.745644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-9de7022e-1540-4e88-a87b-f0d2e44bef09 None None] MFA Rules not processed for user `8b4e74d9cf0b460fb5bc185ca198fd8a`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:10.747024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9de7022e-1540-4e88-a87b-f0d2e44bef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:10.906515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:10.947033 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 867/1762] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jun 27 18:51:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:10.975064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daf3de-1a83-4837-bf3a-2542702fb7ff None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:10.975361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daf3de-1a83-4837-bf3a-2542702fb7ff None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:10.975673 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29daf3de-1a83-4837-bf3a-2542702fb7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:11.013588 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-29daf3de-1a83-4837-bf3a-2542702fb7ff None None] MFA Rules not processed for user `6e6313c444eb4a788b6559eff17959f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:11.014888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-29daf3de-1a83-4837-bf3a-2542702fb7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:11.093982 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 896/1763] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:11.095444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7022e-1540-4e88-a87b-f0d2e44bef09 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:11.097805 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9de7022e-1540-4e88-a87b-f0d2e44bef09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:11.128202 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7022e-1540-4e88-a87b-f0d2e44bef09 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:11.139251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad2c60-2173-4507-889b-171aa53f3679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:11.139251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad2c60-2173-4507-889b-171aa53f3679 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:11.139251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad2c60-2173-4507-889b-171aa53f3679 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:11.139251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ad2c60-2173-4507-889b-171aa53f3679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:11.160449 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad2c60-2173-4507-889b-171aa53f3679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:11.182028 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ad2c60-2173-4507-889b-171aa53f3679 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:11.219814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 897/1764] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:11.220699 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad2c60-2173-4507-889b-171aa53f3679 service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:11.238545 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 868/1765] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jun 27 18:51:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:11.365313 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ad2c60-2173-4507-889b-171aa53f3679 service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:11.371511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ac14c-8283-4674-b0ed-21eaedbb809f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:11.374042 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ac14c-8283-4674-b0ed-21eaedbb809f service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:11.374856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ac14c-8283-4674-b0ed-21eaedbb809f service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:11.375789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ac14c-8283-4674-b0ed-21eaedbb809f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:11.404459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ac14c-8283-4674-b0ed-21eaedbb809f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:11.404459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24ac14c-8283-4674-b0ed-21eaedbb809f service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:11.427013 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 898/1766] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:11.695872 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29daf3de-1a83-4837-bf3a-2542702fb7ff None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:11.700091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-29daf3de-1a83-4837-bf3a-2542702fb7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:11.798863 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ac14c-8283-4674-b0ed-21eaedbb809f service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:11.811291 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ac14c-8283-4674-b0ed-21eaedbb809f service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:11.823157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70750a71-4d13-49f7-9408-b7a181a0ea90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:11.824057 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70750a71-4d13-49f7-9408-b7a181a0ea90 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:11.824333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70750a71-4d13-49f7-9408-b7a181a0ea90 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:11.824761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70750a71-4d13-49f7-9408-b7a181a0ea90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:11.851111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29daf3de-1a83-4837-bf3a-2542702fb7ff None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:11.859166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3ecd9-9ca1-4710-99b3-3d7f6655b608 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94555ff897d94c90968c470d82ff9e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:11.860264 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3ecd9-9ca1-4710-99b3-3d7f6655b608 service swift] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:11.861051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3ecd9-9ca1-4710-99b3-3d7f6655b608 service swift] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:11.861496 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3ecd9-9ca1-4710-99b3-3d7f6655b608 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:11.873999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3ecd9-9ca1-4710-99b3-3d7f6655b608 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:11.876008 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3ecd9-9ca1-4710-99b3-3d7f6655b608 service swift] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:11.886530 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 869/1767] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jun 27 18:51:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 18:51:12.022475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:12.050170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70750a71-4d13-49f7-9408-b7a181a0ea90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:12.057625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70750a71-4d13-49f7-9408-b7a181a0ea90 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:12.081233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 899/1768] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:11 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:51:12.173976 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e99641-14d0-4179-bc7f-18d4832a3a3c None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:12.173976 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e99641-14d0-4179-bc7f-18d4832a3a3c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:12.174582 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e99641-14d0-4179-bc7f-18d4832a3a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:12.237805 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-e0e99641-14d0-4179-bc7f-18d4832a3a3c None None] MFA Rules not processed for user `798c13c87b814d1182c6df3b29ec5986`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:12.242492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e0e99641-14d0-4179-bc7f-18d4832a3a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:12.263578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:12.394529 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 870/1769] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:13.619445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:14.185257 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:15.515512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c80db5-da4b-423c-8a87-e01a64546bcd None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:15.516528 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c80db5-da4b-423c-8a87-e01a64546bcd None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:15.516992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c80db5-da4b-423c-8a87-e01a64546bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:15.598071 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-31c80db5-da4b-423c-8a87-e01a64546bcd None None] MFA Rules not processed for user `1e684ee875464138abc4e89060902100`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:15.601777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-31c80db5-da4b-423c-8a87-e01a64546bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:15.625683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 900/1770] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Jun 27 18:51:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:15.651302 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e99641-14d0-4179-bc7f-18d4832a3a3c None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:15.654116 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e0e99641-14d0-4179-bc7f-18d4832a3a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:15.676017 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e99641-14d0-4179-bc7f-18d4832a3a3c None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:15.683264 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d8480-5754-4353-9056-f5288f7b0135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:15.684275 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d8480-5754-4353-9056-f5288f7b0135 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:15.684810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d8480-5754-4353-9056-f5288f7b0135 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:15.685242 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d8480-5754-4353-9056-f5288f7b0135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:15.728625 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d8480-5754-4353-9056-f5288f7b0135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:15.734309 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d8480-5754-4353-9056-f5288f7b0135 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:15.765726 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 871/1771] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:16.282723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:20.967245 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973061e-884d-4ed4-a3cb-37e9b283fa0a None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:20.968002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973061e-884d-4ed4-a3cb-37e9b283fa0a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:20.968002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3973061e-884d-4ed4-a3cb-37e9b283fa0a None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:20.969275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 901/1772] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jun 27 18:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:51:20.995422 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2baf9-0efb-45af-876d-a7d87e7427e3 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:20.996032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2baf9-0efb-45af-876d-a7d87e7427e3 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:20.996132 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2baf9-0efb-45af-876d-a7d87e7427e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:21.093393 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-b6f2baf9-0efb-45af-876d-a7d87e7427e3 None None] MFA Rules not processed for user `da1746d29f9e4e8b8626ad4b11931cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:21.097609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b6f2baf9-0efb-45af-876d-a7d87e7427e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:21.154990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:21.477376 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 872/1773] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jun 27 18:51:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:22.585392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973061e-884d-4ed4-a3cb-37e9b283fa0a None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:22.588516 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-3973061e-884d-4ed4-a3cb-37e9b283fa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:22.647489 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3973061e-884d-4ed4-a3cb-37e9b283fa0a None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:22.664801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b944e0-d43e-4c8f-bca4-166c842d0005 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:22.665848 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b944e0-d43e-4c8f-bca4-166c842d0005 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:22.666700 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b944e0-d43e-4c8f-bca4-166c842d0005 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:22.668657 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b944e0-d43e-4c8f-bca4-166c842d0005 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:22.697278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b944e0-d43e-4c8f-bca4-166c842d0005 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:22.699383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b944e0-d43e-4c8f-bca4-166c842d0005 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:22.750038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 902/1774] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:23.304520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4afad5-07ef-4ab0-b5bf-9bbc62841c5e None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:23.312133 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4afad5-07ef-4ab0-b5bf-9bbc62841c5e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:23.312833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4afad5-07ef-4ab0-b5bf-9bbc62841c5e None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:23.318847 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 873/1775] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jun 27 18:51:23 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:51:23.352598 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0e340-b74f-4ac8-9dca-eb617c4733c5 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:23.353379 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0e340-b74f-4ac8-9dca-eb617c4733c5 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:23.355008 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe0e340-b74f-4ac8-9dca-eb617c4733c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:23.392051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-dbe0e340-b74f-4ac8-9dca-eb617c4733c5 None None] MFA Rules not processed for user `da1746d29f9e4e8b8626ad4b11931cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:23.399792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-dbe0e340-b74f-4ac8-9dca-eb617c4733c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:23.416823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 903/1776] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jun 27 18:51:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:24.093558 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4afad5-07ef-4ab0-b5bf-9bbc62841c5e None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:24.117529 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4afad5-07ef-4ab0-b5bf-9bbc62841c5e None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:24.126495 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc7c6c-a453-4f39-b82d-5474dc289290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:24.127878 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc7c6c-a453-4f39-b82d-5474dc289290 service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:24.128339 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc7c6c-a453-4f39-b82d-5474dc289290 service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:24.128719 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc7c6c-a453-4f39-b82d-5474dc289290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:24.152679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc7c6c-a453-4f39-b82d-5474dc289290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:24.157435 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc7c6c-a453-4f39-b82d-5474dc289290 service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:24.188771 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 874/1777] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:24.522242 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0e340-b74f-4ac8-9dca-eb617c4733c5 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:24.665511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe0e340-b74f-4ac8-9dca-eb617c4733c5 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:24.673856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359e913-7164-4adc-aafc-76978bd1953e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:24.675423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359e913-7164-4adc-aafc-76978bd1953e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:24.676010 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359e913-7164-4adc-aafc-76978bd1953e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:24.677254 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359e913-7164-4adc-aafc-76978bd1953e admin admin] PATH_INFO: `/v3/users/ffdc14b5e5c54df18792519fe9bca07a` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:24.678775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359e913-7164-4adc-aafc-76978bd1953e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffdc14b5e5c54df18792519fe9bca07a)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:24.686032 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359e913-7164-4adc-aafc-76978bd1953e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:24.989072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-c359e913-7164-4adc-aafc-76978bd1953e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffdc14b5e5c54df18792519fe9bca07a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:25.090451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-c359e913-7164-4adc-aafc-76978bd1953e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffdc14b5e5c54df18792519fe9bca07a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:25.110716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-c359e913-7164-4adc-aafc-76978bd1953e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffdc14b5e5c54df18792519fe9bca07a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:25.134419 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-c359e913-7164-4adc-aafc-76978bd1953e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffdc14b5e5c54df18792519fe9bca07a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:25.137733 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-c359e913-7164-4adc-aafc-76978bd1953e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffdc14b5e5c54df18792519fe9bca07a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:25.164100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 904/1778] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:24 2022] DELETE /identity/v3/users/ffdc14b5e5c54df18792519fe9bca07a => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:25.165285 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e303c-1da0-457a-9aa3-e6d812ee0aac None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:25.165820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e303c-1da0-457a-9aa3-e6d812ee0aac None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:25.165919 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e303c-1da0-457a-9aa3-e6d812ee0aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:25.238958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-959e303c-1da0-457a-9aa3-e6d812ee0aac None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:25.240433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-959e303c-1da0-457a-9aa3-e6d812ee0aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:25.395972 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 875/1779] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:25.464442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359e913-7164-4adc-aafc-76978bd1953e admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:25.467282 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-c359e913-7164-4adc-aafc-76978bd1953e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:25.496035 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:25.624365 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359e913-7164-4adc-aafc-76978bd1953e admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:25.639731 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cf012-2b18-4808-9528-828e8a19ba76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:25.640494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cf012-2b18-4808-9528-828e8a19ba76 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:25.640981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cf012-2b18-4808-9528-828e8a19ba76 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:25.641439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631cf012-2b18-4808-9528-828e8a19ba76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:25.670404 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cf012-2b18-4808-9528-828e8a19ba76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:25.675286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631cf012-2b18-4808-9528-828e8a19ba76 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:25.720237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 905/1780] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:28.102110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e303c-1da0-457a-9aa3-e6d812ee0aac None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:28.104542 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-959e303c-1da0-457a-9aa3-e6d812ee0aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:28.116853 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e303c-1da0-457a-9aa3-e6d812ee0aac None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:28.127637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f83e23-d71f-4ff2-a466-4f756eb2636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:28.127637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f83e23-d71f-4ff2-a466-4f756eb2636e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:28.127637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f83e23-d71f-4ff2-a466-4f756eb2636e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:28.127637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f83e23-d71f-4ff2-a466-4f756eb2636e admin admin] PATH_INFO: `/v3/projects/b588058807d94e80985337de5a38fb5f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:28.128002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f83e23-d71f-4ff2-a466-4f756eb2636e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b588058807d94e80985337de5a38fb5f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:28.129986 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f83e23-d71f-4ff2-a466-4f756eb2636e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:28.261135 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-34f83e23-d71f-4ff2-a466-4f756eb2636e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b588058807d94e80985337de5a38fb5f', 'request_id': 'req-34f83e23-d71f-4ff2-a466-4f756eb2636e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:28.399371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-34f83e23-d71f-4ff2-a466-4f756eb2636e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b588058807d94e80985337de5a38fb5f', 'request_id': 'req-34f83e23-d71f-4ff2-a466-4f756eb2636e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:28.407980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-34f83e23-d71f-4ff2-a466-4f756eb2636e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b588058807d94e80985337de5a38fb5f', 'request_id': 'req-34f83e23-d71f-4ff2-a466-4f756eb2636e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:28.422369 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-34f83e23-d71f-4ff2-a466-4f756eb2636e admin admin] The token cache is being invalidate because project b588058807d94e80985337de5a38fb5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:28.423034 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-34f83e23-d71f-4ff2-a466-4f756eb2636e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:28.424187 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-34f83e23-d71f-4ff2-a466-4f756eb2636e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:28.429456 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 876/1781] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:28 2022] DELETE /identity/v3/projects/b588058807d94e80985337de5a38fb5f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:28.430545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cf012-2b18-4808-9528-828e8a19ba76 service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:28.442738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631cf012-2b18-4808-9528-828e8a19ba76 service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:28.507017 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f83e23-d71f-4ff2-a466-4f756eb2636e admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:28.508555 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-34f83e23-d71f-4ff2-a466-4f756eb2636e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:28.540799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ef64a-2c10-42d8-bb62-eb11f72540f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:28.544842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ef64a-2c10-42d8-bb62-eb11f72540f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:28.545357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ef64a-2c10-42d8-bb62-eb11f72540f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:28.545788 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ef64a-2c10-42d8-bb62-eb11f72540f2 admin admin] PATH_INFO: `/v3/users/8b4e74d9cf0b460fb5bc185ca198fd8a` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:28.549508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ef64a-2c10-42d8-bb62-eb11f72540f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b4e74d9cf0b460fb5bc185ca198fd8a)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:28.554515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ef64a-2c10-42d8-bb62-eb11f72540f2 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:28.563999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:28.631843 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f83e23-d71f-4ff2-a466-4f756eb2636e admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:28.636813 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b7070-04e3-487c-8fee-fbaa6dcc4dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:28.638348 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b7070-04e3-487c-8fee-fbaa6dcc4dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:28.638709 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b7070-04e3-487c-8fee-fbaa6dcc4dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:28.639065 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b7070-04e3-487c-8fee-fbaa6dcc4dd4 admin admin] PATH_INFO: `/v3/users/6b847ce9ab7d4e18be2ce17710e75768` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:28.640394 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b7070-04e3-487c-8fee-fbaa6dcc4dd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b847ce9ab7d4e18be2ce17710e75768)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:28.642725 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b7070-04e3-487c-8fee-fbaa6dcc4dd4 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:28.788774 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-539ef64a-2c10-42d8-bb62-eb11f72540f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b4e74d9cf0b460fb5bc185ca198fd8a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:28.879388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-539ef64a-2c10-42d8-bb62-eb11f72540f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b4e74d9cf0b460fb5bc185ca198fd8a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:28.894571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-539ef64a-2c10-42d8-bb62-eb11f72540f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b4e74d9cf0b460fb5bc185ca198fd8a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:28.902649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-539ef64a-2c10-42d8-bb62-eb11f72540f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b4e74d9cf0b460fb5bc185ca198fd8a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:28.903709 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-539ef64a-2c10-42d8-bb62-eb11f72540f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b4e74d9cf0b460fb5bc185ca198fd8a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:28.909994 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 906/1782] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:28 2022] DELETE /identity/v3/users/8b4e74d9cf0b460fb5bc185ca198fd8a => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:28.939419 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-765b7070-04e3-487c-8fee-fbaa6dcc4dd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b847ce9ab7d4e18be2ce17710e75768'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:28.994721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-765b7070-04e3-487c-8fee-fbaa6dcc4dd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b847ce9ab7d4e18be2ce17710e75768'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:29.009459 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-765b7070-04e3-487c-8fee-fbaa6dcc4dd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b847ce9ab7d4e18be2ce17710e75768'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:29.010277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-765b7070-04e3-487c-8fee-fbaa6dcc4dd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b847ce9ab7d4e18be2ce17710e75768'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:29.031992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-765b7070-04e3-487c-8fee-fbaa6dcc4dd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b847ce9ab7d4e18be2ce17710e75768'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:29.040254 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 877/1783] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:28 2022] DELETE /identity/v3/users/6b847ce9ab7d4e18be2ce17710e75768 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:29.046062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a1a95-2c56-41d3-8e3f-93147573bd98 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:29.046362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a1a95-2c56-41d3-8e3f-93147573bd98 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:29.047273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a1a95-2c56-41d3-8e3f-93147573bd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:29.070194 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-3f1a1a95-2c56-41d3-8e3f-93147573bd98 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:29.071408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-3f1a1a95-2c56-41d3-8e3f-93147573bd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:29.104818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:29.145934 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 907/1784] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:29.172787 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b7070-04e3-487c-8fee-fbaa6dcc4dd4 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:29.174876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-765b7070-04e3-487c-8fee-fbaa6dcc4dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:29.249349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b7070-04e3-487c-8fee-fbaa6dcc4dd4 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:29.255773 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de8720b-e064-4294-89ae-48f67447f1ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:29.256952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8720b-e064-4294-89ae-48f67447f1ec service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:29.257435 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8720b-e064-4294-89ae-48f67447f1ec service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:29.258089 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de8720b-e064-4294-89ae-48f67447f1ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:29.272110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8720b-e064-4294-89ae-48f67447f1ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:29.273789 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de8720b-e064-4294-89ae-48f67447f1ec service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:29.287099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 878/1785] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:29.670227 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a1a95-2c56-41d3-8e3f-93147573bd98 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:29.672745 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-3f1a1a95-2c56-41d3-8e3f-93147573bd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:29.690378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a1a95-2c56-41d3-8e3f-93147573bd98 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:29.697341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e6a96-d040-4159-bd93-f5fce5e6ab96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:29.698939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e6a96-d040-4159-bd93-f5fce5e6ab96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:29.699214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e6a96-d040-4159-bd93-f5fce5e6ab96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:29.699948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e6a96-d040-4159-bd93-f5fce5e6ab96 admin admin] PATH_INFO: `/v3/projects/04d7181fc9a8472ea5eca3bdbb4a0db3` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:29.703826 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e6a96-d040-4159-bd93-f5fce5e6ab96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d7181fc9a8472ea5eca3bdbb4a0db3)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:29.703826 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e6a96-d040-4159-bd93-f5fce5e6ab96 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:29.808235 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-662e6a96-d040-4159-bd93-f5fce5e6ab96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d7181fc9a8472ea5eca3bdbb4a0db3', 'request_id': 'req-662e6a96-d040-4159-bd93-f5fce5e6ab96'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:29.815241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-662e6a96-d040-4159-bd93-f5fce5e6ab96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d7181fc9a8472ea5eca3bdbb4a0db3', 'request_id': 'req-662e6a96-d040-4159-bd93-f5fce5e6ab96'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:29.899164 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-662e6a96-d040-4159-bd93-f5fce5e6ab96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d7181fc9a8472ea5eca3bdbb4a0db3', 'request_id': 'req-662e6a96-d040-4159-bd93-f5fce5e6ab96'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:29.916506 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-662e6a96-d040-4159-bd93-f5fce5e6ab96 admin admin] The token cache is being invalidate because project 04d7181fc9a8472ea5eca3bdbb4a0db3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:29.916818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-662e6a96-d040-4159-bd93-f5fce5e6ab96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:29.917611 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-662e6a96-d040-4159-bd93-f5fce5e6ab96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:29.924520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 908/1786] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:29 2022] DELETE /identity/v3/projects/04d7181fc9a8472ea5eca3bdbb4a0db3 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:29.929899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51c029-74a9-4874-9568-072d99c42102 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:29.930310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51c029-74a9-4874-9568-072d99c42102 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:29.930670 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51c029-74a9-4874-9568-072d99c42102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:29.950327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-5b51c029-74a9-4874-9568-072d99c42102 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:29.952358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5b51c029-74a9-4874-9568-072d99c42102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:30.014596 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e6a96-d040-4159-bd93-f5fce5e6ab96 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:30.016783 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-662e6a96-d040-4159-bd93-f5fce5e6ab96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:30.033187 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 879/1787] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:30.041210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ddf9e-e031-4029-b111-88c243777276 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:30.041585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ddf9e-e031-4029-b111-88c243777276 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:30.041959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ddf9e-e031-4029-b111-88c243777276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:30.061243 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-fd8ddf9e-e031-4029-b111-88c243777276 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:30.062476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-fd8ddf9e-e031-4029-b111-88c243777276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:30.072953 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 880/1788] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:30.077131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ddf9e-e031-4029-b111-88c243777276 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:30.091805 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ddf9e-e031-4029-b111-88c243777276 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:30.096638 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3cbcf-d2fe-4381-9841-14d4a86bc733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:30.097387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3cbcf-d2fe-4381-9841-14d4a86bc733 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:30.098010 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3cbcf-d2fe-4381-9841-14d4a86bc733 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:30.098010 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3cbcf-d2fe-4381-9841-14d4a86bc733 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:30.098671 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3cbcf-d2fe-4381-9841-14d4a86bc733 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:51:30.098987 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3cbcf-d2fe-4381-9841-14d4a86bc733 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:30.100202 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e6a96-d040-4159-bd93-f5fce5e6ab96 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:30.100645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3cbcf-d2fe-4381-9841-14d4a86bc733 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:30.105609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0c361-6c1d-456f-bc1e-707454f94f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:30.107121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0c361-6c1d-456f-bc1e-707454f94f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:30.112590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0c361-6c1d-456f-bc1e-707454f94f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:30.112590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0c361-6c1d-456f-bc1e-707454f94f08 admin admin] PATH_INFO: `/v3/projects/d1270ad4943145589f2945c399c8752f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:30.112590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0c361-6c1d-456f-bc1e-707454f94f08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1270ad4943145589f2945c399c8752f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:30.112590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0c361-6c1d-456f-bc1e-707454f94f08 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:30.119460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 881/1789] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:51:30.120491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3cbcf-d2fe-4381-9841-14d4a86bc733 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:30.132651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3cbcf-d2fe-4381-9841-14d4a86bc733 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:30.138046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72332223-1a98-4b5b-b417-37d44d4de37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:30.138743 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72332223-1a98-4b5b-b417-37d44d4de37c admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:30.139033 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72332223-1a98-4b5b-b417-37d44d4de37c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:30.139313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72332223-1a98-4b5b-b417-37d44d4de37c admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:30.140043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72332223-1a98-4b5b-b417-37d44d4de37c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:30.142107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72332223-1a98-4b5b-b417-37d44d4de37c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:30.228113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-29f0c361-6c1d-456f-bc1e-707454f94f08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1270ad4943145589f2945c399c8752f', 'request_id': 'req-29f0c361-6c1d-456f-bc1e-707454f94f08'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:30.234035 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-29f0c361-6c1d-456f-bc1e-707454f94f08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1270ad4943145589f2945c399c8752f', 'request_id': 'req-29f0c361-6c1d-456f-bc1e-707454f94f08'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:30.246882 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 882/1790] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:30 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:30.250967 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72332223-1a98-4b5b-b417-37d44d4de37c admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:30.311643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72332223-1a98-4b5b-b417-37d44d4de37c admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:30.316519 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240be68a-9a0f-4d42-8dd7-ec0903468816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:30.317248 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240be68a-9a0f-4d42-8dd7-ec0903468816 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:30.317524 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240be68a-9a0f-4d42-8dd7-ec0903468816 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:30.317824 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240be68a-9a0f-4d42-8dd7-ec0903468816 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:30.318569 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240be68a-9a0f-4d42-8dd7-ec0903468816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:30.320601 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240be68a-9a0f-4d42-8dd7-ec0903468816 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:30.330769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-29f0c361-6c1d-456f-bc1e-707454f94f08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1270ad4943145589f2945c399c8752f', 'request_id': 'req-29f0c361-6c1d-456f-bc1e-707454f94f08'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:30.343304 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-29f0c361-6c1d-456f-bc1e-707454f94f08 admin admin] The token cache is being invalidate because project d1270ad4943145589f2945c399c8752f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:30.343632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-29f0c361-6c1d-456f-bc1e-707454f94f08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:30.344466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-29f0c361-6c1d-456f-bc1e-707454f94f08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:30.346129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 909/1791] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:30 2022] DELETE /identity/v3/projects/d1270ad4943145589f2945c399c8752f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:30.350143 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0c361-6c1d-456f-bc1e-707454f94f08 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:30.351604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-29f0c361-6c1d-456f-bc1e-707454f94f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:30.416422 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0c361-6c1d-456f-bc1e-707454f94f08 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:30.422008 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60822f4-280c-4a74-b88b-f0834aa03a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:30.422898 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60822f4-280c-4a74-b88b-f0834aa03a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:30.423185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60822f4-280c-4a74-b88b-f0834aa03a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:30.423465 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60822f4-280c-4a74-b88b-f0834aa03a50 admin admin] PATH_INFO: `/v3/users/148912b9202f4ab3860ac5a0e5ad7b4f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:30.424776 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60822f4-280c-4a74-b88b-f0834aa03a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=148912b9202f4ab3860ac5a0e5ad7b4f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:30.426763 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60822f4-280c-4a74-b88b-f0834aa03a50 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:30.534397 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 883/1792] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:30 2022] POST /identity/v3/users => generated 294 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:51:30.538131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240be68a-9a0f-4d42-8dd7-ec0903468816 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:30.539757 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-240be68a-9a0f-4d42-8dd7-ec0903468816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:30.552119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240be68a-9a0f-4d42-8dd7-ec0903468816 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:30.556645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94a91b-85ed-4cde-ac99-abb37ef222a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:30.557292 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94a91b-85ed-4cde-ac99-abb37ef222a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:30.557575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94a91b-85ed-4cde-ac99-abb37ef222a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:30.557853 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94a91b-85ed-4cde-ac99-abb37ef222a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:30.558584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94a91b-85ed-4cde-ac99-abb37ef222a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:30.560218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94a91b-85ed-4cde-ac99-abb37ef222a5 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:30.570126 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 884/1793] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:51:30.574049 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94a91b-85ed-4cde-ac99-abb37ef222a5 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:30.583350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94a91b-85ed-4cde-ac99-abb37ef222a5 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:30.588017 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c648f9e-1966-487f-bd40-f76a66a6f6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:30.588650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c648f9e-1966-487f-bd40-f76a66a6f6ef admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:30.588939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c648f9e-1966-487f-bd40-f76a66a6f6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:30.589224 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c648f9e-1966-487f-bd40-f76a66a6f6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:30.589946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c648f9e-1966-487f-bd40-f76a66a6f6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:30.592112 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c648f9e-1966-487f-bd40-f76a66a6f6ef admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:30.606887 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 885/1794] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:51:30.608496 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c648f9e-1966-487f-bd40-f76a66a6f6ef admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:30.618105 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c648f9e-1966-487f-bd40-f76a66a6f6ef admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:30.623999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c299c6d-9f35-4ff6-a48b-88daa4f9e952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:30.625120 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c299c6d-9f35-4ff6-a48b-88daa4f9e952 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:30.625551 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c299c6d-9f35-4ff6-a48b-88daa4f9e952 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:30.625990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c299c6d-9f35-4ff6-a48b-88daa4f9e952 admin admin] PATH_INFO: `/v3/projects/fb98cc9514484d15ab60981550627db6/users/fe05f08538a645b7a5369289055bb8a0/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:30.642162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c299c6d-9f35-4ff6-a48b-88daa4f9e952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb98cc9514484d15ab60981550627db6, user_id=fe05f08538a645b7a5369289055bb8a0, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:30.645051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c299c6d-9f35-4ff6-a48b-88daa4f9e952 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:30.673172 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-a60822f4-280c-4a74-b88b-f0834aa03a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148912b9202f4ab3860ac5a0e5ad7b4f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:30.722399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 886/1795] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:30 2022] PUT /identity/v3/projects/fb98cc9514484d15ab60981550627db6/users/fe05f08538a645b7a5369289055bb8a0/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:30.734302 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32471347-86cd-45d0-add4-367767e1975f None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:30.735041 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32471347-86cd-45d0-add4-367767e1975f None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:30.735041 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32471347-86cd-45d0-add4-367767e1975f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:30.738836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-a60822f4-280c-4a74-b88b-f0834aa03a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148912b9202f4ab3860ac5a0e5ad7b4f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:30.749606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:30.761358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-a60822f4-280c-4a74-b88b-f0834aa03a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148912b9202f4ab3860ac5a0e5ad7b4f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:30.769682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-a60822f4-280c-4a74-b88b-f0834aa03a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148912b9202f4ab3860ac5a0e5ad7b4f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:30.770420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-a60822f4-280c-4a74-b88b-f0834aa03a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148912b9202f4ab3860ac5a0e5ad7b4f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:30.779110 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 910/1796] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:30 2022] DELETE /identity/v3/users/148912b9202f4ab3860ac5a0e5ad7b4f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:30.797467 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-32471347-86cd-45d0-add4-367767e1975f None None] MFA Rules not processed for user `fe05f08538a645b7a5369289055bb8a0`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:30.798717 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-32471347-86cd-45d0-add4-367767e1975f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:30.862446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 887/1797] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:30.867129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60822f4-280c-4a74-b88b-f0834aa03a50 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:30.868571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a60822f4-280c-4a74-b88b-f0834aa03a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:30.932283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60822f4-280c-4a74-b88b-f0834aa03a50 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:30.938884 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d166e-c079-4b16-947f-ff2460d33870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:30.939823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d166e-c079-4b16-947f-ff2460d33870 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:30.940114 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d166e-c079-4b16-947f-ff2460d33870 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:30.940397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d166e-c079-4b16-947f-ff2460d33870 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:30.941168 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d166e-c079-4b16-947f-ff2460d33870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:30.945878 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d166e-c079-4b16-947f-ff2460d33870 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:31.048749 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 911/1798] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:30 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:31.049609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32471347-86cd-45d0-add4-367767e1975f None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:31.068390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32471347-86cd-45d0-add4-367767e1975f None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:31.159894 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257ca10-faf4-42fe-b142-75b7f40dbd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:31.161384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257ca10-faf4-42fe-b142-75b7f40dbd0a admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:31.162091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257ca10-faf4-42fe-b142-75b7f40dbd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:31.162588 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257ca10-faf4-42fe-b142-75b7f40dbd0a admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:31.163583 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257ca10-faf4-42fe-b142-75b7f40dbd0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:31.166854 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257ca10-faf4-42fe-b142-75b7f40dbd0a admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:31.260675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d166e-c079-4b16-947f-ff2460d33870 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:31.263574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-0e6d166e-c079-4b16-947f-ff2460d33870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:31.279554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d166e-c079-4b16-947f-ff2460d33870 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:31.285472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133dee54-9d4d-417b-a8a9-b5640d86426f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:31.286992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dee54-9d4d-417b-a8a9-b5640d86426f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:31.287569 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dee54-9d4d-417b-a8a9-b5640d86426f admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:31.287996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133dee54-9d4d-417b-a8a9-b5640d86426f admin admin] PATH_INFO: `/v3/projects/d83874c476474ff6a995cc93466d33e2` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:31.289472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133dee54-9d4d-417b-a8a9-b5640d86426f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d83874c476474ff6a995cc93466d33e2)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:31.291696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133dee54-9d4d-417b-a8a9-b5640d86426f admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:31.315951 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 888/1799] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:31 2022] POST /identity/v3/users => generated 299 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:51:31.320348 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257ca10-faf4-42fe-b142-75b7f40dbd0a admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:31.341810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257ca10-faf4-42fe-b142-75b7f40dbd0a admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:31.360222 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57e2cc-7bf7-4b02-94be-8bfcf3fd0dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:31.365073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57e2cc-7bf7-4b02-94be-8bfcf3fd0dba admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:31.365073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57e2cc-7bf7-4b02-94be-8bfcf3fd0dba admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:31.365073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57e2cc-7bf7-4b02-94be-8bfcf3fd0dba admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:31.365073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57e2cc-7bf7-4b02-94be-8bfcf3fd0dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:31.366558 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57e2cc-7bf7-4b02-94be-8bfcf3fd0dba admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:31.403961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 889/1800] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:31.405063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57e2cc-7bf7-4b02-94be-8bfcf3fd0dba admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:31.425672 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57e2cc-7bf7-4b02-94be-8bfcf3fd0dba admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:31.439559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-133dee54-9d4d-417b-a8a9-b5640d86426f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd83874c476474ff6a995cc93466d33e2', 'request_id': 'req-133dee54-9d4d-417b-a8a9-b5640d86426f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:31.450961 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-133dee54-9d4d-417b-a8a9-b5640d86426f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd83874c476474ff6a995cc93466d33e2', 'request_id': 'req-133dee54-9d4d-417b-a8a9-b5640d86426f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:31.537245 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e70867-61da-4bd6-b74b-21e0e956fe53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:31.538448 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e70867-61da-4bd6-b74b-21e0e956fe53 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:31.539862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e70867-61da-4bd6-b74b-21e0e956fe53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:31.540316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e70867-61da-4bd6-b74b-21e0e956fe53 admin admin] PATH_INFO: `/v3/projects/7fe06218c0754440bc8267547471a926/users/05b6d043d1e34da39749b86e9cf2bdb7/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:31.551355 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-133dee54-9d4d-417b-a8a9-b5640d86426f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd83874c476474ff6a995cc93466d33e2', 'request_id': 'req-133dee54-9d4d-417b-a8a9-b5640d86426f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:31.571817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-133dee54-9d4d-417b-a8a9-b5640d86426f admin admin] The token cache is being invalidate because project d83874c476474ff6a995cc93466d33e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:31.572449 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-133dee54-9d4d-417b-a8a9-b5640d86426f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:31.578970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e70867-61da-4bd6-b74b-21e0e956fe53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe06218c0754440bc8267547471a926, user_id=05b6d043d1e34da39749b86e9cf2bdb7, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:31.581847 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e70867-61da-4bd6-b74b-21e0e956fe53 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:31.586465 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-133dee54-9d4d-417b-a8a9-b5640d86426f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:31.592196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 912/1801] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:31 2022] DELETE /identity/v3/projects/d83874c476474ff6a995cc93466d33e2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:31.596938 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1213d62-f5ce-4a74-b7f0-30432f48ac9b None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:31.597561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1213d62-f5ce-4a74-b7f0-30432f48ac9b None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:31.598024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1213d62-f5ce-4a74-b7f0-30432f48ac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:31.623467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-b1213d62-f5ce-4a74-b7f0-30432f48ac9b None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:31.624973 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b1213d62-f5ce-4a74-b7f0-30432f48ac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:31.644626 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 913/1802] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:31.648629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46cf86-67ae-4b27-804b-9dbaed9f1e64 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:31.648629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46cf86-67ae-4b27-804b-9dbaed9f1e64 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:31.648629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d46cf86-67ae-4b27-804b-9dbaed9f1e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:31.667959 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-2d46cf86-67ae-4b27-804b-9dbaed9f1e64 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:31.669982 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2d46cf86-67ae-4b27-804b-9dbaed9f1e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:31.678361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 890/1803] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:31 2022] PUT /identity/v3/projects/7fe06218c0754440bc8267547471a926/users/05b6d043d1e34da39749b86e9cf2bdb7/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:31.683084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e70867-61da-4bd6-b74b-21e0e956fe53 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:31.685884 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d4e70867-61da-4bd6-b74b-21e0e956fe53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:31.744434 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 914/1804] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:31.748447 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46cf86-67ae-4b27-804b-9dbaed9f1e64 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:31.757797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d46cf86-67ae-4b27-804b-9dbaed9f1e64 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:31.762983 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838371b-6b68-4b1e-8bec-2fd14f9cf773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:31.763675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838371b-6b68-4b1e-8bec-2fd14f9cf773 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:31.763963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838371b-6b68-4b1e-8bec-2fd14f9cf773 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:31.764397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838371b-6b68-4b1e-8bec-2fd14f9cf773 admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:31.765157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838371b-6b68-4b1e-8bec-2fd14f9cf773 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:51:31.765467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838371b-6b68-4b1e-8bec-2fd14f9cf773 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:31.767123 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838371b-6b68-4b1e-8bec-2fd14f9cf773 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:31.777557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:31.781125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 915/1805] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:51:31.789343 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e70867-61da-4bd6-b74b-21e0e956fe53 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:31.789632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838371b-6b68-4b1e-8bec-2fd14f9cf773 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:31.789707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be75a29-ab2f-4009-9a22-b60611b692a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:31.789707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be75a29-ab2f-4009-9a22-b60611b692a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:31.789707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be75a29-ab2f-4009-9a22-b60611b692a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:31.789707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be75a29-ab2f-4009-9a22-b60611b692a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:31.790039 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be75a29-ab2f-4009-9a22-b60611b692a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:31.791694 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be75a29-ab2f-4009-9a22-b60611b692a2 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:31.795784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838371b-6b68-4b1e-8bec-2fd14f9cf773 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:31.801036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f1644-30bf-4941-b8b7-96ceef99df1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:31.801701 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f1644-30bf-4941-b8b7-96ceef99df1f admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:31.801989 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f1644-30bf-4941-b8b7-96ceef99df1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:31.802255 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f1644-30bf-4941-b8b7-96ceef99df1f admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:31.802944 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f1644-30bf-4941-b8b7-96ceef99df1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:31.804901 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f1644-30bf-4941-b8b7-96ceef99df1f admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:31.824279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 891/1806] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:31.828831 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be75a29-ab2f-4009-9a22-b60611b692a2 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:31.838975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be75a29-ab2f-4009-9a22-b60611b692a2 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:31.843665 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c343f4-70d3-4a90-92ed-20a6071e4919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:31.844554 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c343f4-70d3-4a90-92ed-20a6071e4919 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:31.844838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c343f4-70d3-4a90-92ed-20a6071e4919 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:31.845112 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c343f4-70d3-4a90-92ed-20a6071e4919 admin admin] PATH_INFO: `/v3/projects/7fe06218c0754440bc8267547471a926/users/05b6d043d1e34da39749b86e9cf2bdb7/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:31.847410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c343f4-70d3-4a90-92ed-20a6071e4919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fe06218c0754440bc8267547471a926, user_id=05b6d043d1e34da39749b86e9cf2bdb7, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:31.850106 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c343f4-70d3-4a90-92ed-20a6071e4919 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:31.870973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 892/1807] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:31 2022] PUT /identity/v3/projects/7fe06218c0754440bc8267547471a926/users/05b6d043d1e34da39749b86e9cf2bdb7/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:31.878864 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23806d-24d5-46ee-878b-fd32f6454adc None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:31.879827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23806d-24d5-46ee-878b-fd32f6454adc None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:31.880129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23806d-24d5-46ee-878b-fd32f6454adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:31.913450 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 916/1808] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:31 2022] POST /identity/v3/projects => generated 399 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:31.917155 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-1d23806d-24d5-46ee-878b-fd32f6454adc None None] MFA Rules not processed for user `05b6d043d1e34da39749b86e9cf2bdb7`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:31.917555 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f1644-30bf-4941-b8b7-96ceef99df1f admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:31.919468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-1d23806d-24d5-46ee-878b-fd32f6454adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:32.042278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f1644-30bf-4941-b8b7-96ceef99df1f admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:32.046833 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce5db0-9283-4539-b8ad-fa386cbc3a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:32.047640 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5db0-9283-4539-b8ad-fa386cbc3a74 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:32.047930 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5db0-9283-4539-b8ad-fa386cbc3a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:32.048209 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5db0-9283-4539-b8ad-fa386cbc3a74 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:32.048902 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce5db0-9283-4539-b8ad-fa386cbc3a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:32.050866 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce5db0-9283-4539-b8ad-fa386cbc3a74 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:32.051723 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 893/1809] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:32.063115 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23806d-24d5-46ee-878b-fd32f6454adc None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:32.065031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-1d23806d-24d5-46ee-878b-fd32f6454adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:32.122444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23806d-24d5-46ee-878b-fd32f6454adc None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:32.126160 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dd078-d5b8-4e72-b477-cb96cf658567 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:32.126806 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dd078-d5b8-4e72-b477-cb96cf658567 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:32.127110 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dd078-d5b8-4e72-b477-cb96cf658567 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:32.127387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3dd078-d5b8-4e72-b477-cb96cf658567 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:32.136737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3dd078-d5b8-4e72-b477-cb96cf658567 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:32.138183 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3dd078-d5b8-4e72-b477-cb96cf658567 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:32.148241 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 894/1810] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:51:32.171455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 917/1811] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:31 2022] POST /identity/v3/users => generated 300 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:32.175477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dd078-d5b8-4e72-b477-cb96cf658567 service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:32.177532 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce5db0-9283-4539-b8ad-fa386cbc3a74 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:32.185757 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3dd078-d5b8-4e72-b477-cb96cf658567 service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:32.187344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce5db0-9283-4539-b8ad-fa386cbc3a74 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:32.190547 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54528aba-05d9-46d9-81e8-565bd82838ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:32.191200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54528aba-05d9-46d9-81e8-565bd82838ec admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:32.191485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54528aba-05d9-46d9-81e8-565bd82838ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:32.191810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54528aba-05d9-46d9-81e8-565bd82838ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:32.192011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f3bc5-e367-4c8e-b311-c337db16e3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:32.192553 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54528aba-05d9-46d9-81e8-565bd82838ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:32.192862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f3bc5-e367-4c8e-b311-c337db16e3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:32.193142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f3bc5-e367-4c8e-b311-c337db16e3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:32.193429 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f3bc5-e367-4c8e-b311-c337db16e3ea admin admin] PATH_INFO: `/v3/users/fe05f08538a645b7a5369289055bb8a0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:32.194149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54528aba-05d9-46d9-81e8-565bd82838ec admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:32.194628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f3bc5-e367-4c8e-b311-c337db16e3ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe05f08538a645b7a5369289055bb8a0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:32.196574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f3bc5-e367-4c8e-b311-c337db16e3ea admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:32.206999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 895/1812] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:32.208030 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54528aba-05d9-46d9-81e8-565bd82838ec admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:32.218548 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54528aba-05d9-46d9-81e8-565bd82838ec admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:32.223247 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6cfe8-aa42-47b2-8041-1fcdccb9e7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:32.223950 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6cfe8-aa42-47b2-8041-1fcdccb9e7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:32.224238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6cfe8-aa42-47b2-8041-1fcdccb9e7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:32.224519 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab6cfe8-aa42-47b2-8041-1fcdccb9e7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:32.225282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6cfe8-aa42-47b2-8041-1fcdccb9e7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:32.226970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab6cfe8-aa42-47b2-8041-1fcdccb9e7d5 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:32.237693 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 896/1813] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:51:32.241780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6cfe8-aa42-47b2-8041-1fcdccb9e7d5 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:32.254929 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab6cfe8-aa42-47b2-8041-1fcdccb9e7d5 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:32.259681 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8fa3c-986b-4396-9845-721dd068bb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:32.260565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8fa3c-986b-4396-9845-721dd068bb2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:32.260869 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8fa3c-986b-4396-9845-721dd068bb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:32.261143 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8fa3c-986b-4396-9845-721dd068bb2f admin admin] PATH_INFO: `/v3/projects/01a805c81f6f44e69f8cb9aa39712d4b/users/9c67009f77994cc2ba5eac7ec7c73f4a/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:32.275850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8fa3c-986b-4396-9845-721dd068bb2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=01a805c81f6f44e69f8cb9aa39712d4b, user_id=9c67009f77994cc2ba5eac7ec7c73f4a, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:32.279153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8fa3c-986b-4396-9845-721dd068bb2f admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:32.353897 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 897/1814] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:32 2022] PUT /identity/v3/projects/01a805c81f6f44e69f8cb9aa39712d4b/users/9c67009f77994cc2ba5eac7ec7c73f4a/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:32.364448 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c21718-cd28-49f7-883f-847b3f0c87f2 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:32.364737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c21718-cd28-49f7-883f-847b3f0c87f2 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:32.365016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c21718-cd28-49f7-883f-847b3f0c87f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:32.390135 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-57c21718-cd28-49f7-883f-847b3f0c87f2 None None] MFA Rules not processed for user `9c67009f77994cc2ba5eac7ec7c73f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:32.391338 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-57c21718-cd28-49f7-883f-847b3f0c87f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:32.419302 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e41f3bc5-e367-4c8e-b311-c337db16e3ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe05f08538a645b7a5369289055bb8a0'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:32.464158 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 898/1815] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:32.470689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c21718-cd28-49f7-883f-847b3f0c87f2 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:32.495513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e41f3bc5-e367-4c8e-b311-c337db16e3ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe05f08538a645b7a5369289055bb8a0'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:32.533880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e41f3bc5-e367-4c8e-b311-c337db16e3ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe05f08538a645b7a5369289055bb8a0'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:32.541664 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e41f3bc5-e367-4c8e-b311-c337db16e3ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe05f08538a645b7a5369289055bb8a0'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:32.542505 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e41f3bc5-e367-4c8e-b311-c337db16e3ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe05f08538a645b7a5369289055bb8a0'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:32.551978 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 918/1816] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:32 2022] DELETE /identity/v3/users/fe05f08538a645b7a5369289055bb8a0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:32.557010 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f28e02-3c96-4116-a87a-6415c2ce6acf None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:32.557365 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f28e02-3c96-4116-a87a-6415c2ce6acf None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:32.557659 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f28e02-3c96-4116-a87a-6415c2ce6acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:32.561021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c21718-cd28-49f7-883f-847b3f0c87f2 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:32.579901 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-98f28e02-3c96-4116-a87a-6415c2ce6acf None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:32.581384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-98f28e02-3c96-4116-a87a-6415c2ce6acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:32.661713 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8e887-cfc9-4190-bfa6-c9d666ee61fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:32.662391 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8e887-cfc9-4190-bfa6-c9d666ee61fb admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:32.662682 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8e887-cfc9-4190-bfa6-c9d666ee61fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:32.662967 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d8e887-cfc9-4190-bfa6-c9d666ee61fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:32.663699 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8e887-cfc9-4190-bfa6-c9d666ee61fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:32.667982 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d8e887-cfc9-4190-bfa6-c9d666ee61fb admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:32.684494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 919/1817] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:32.686430 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f28e02-3c96-4116-a87a-6415c2ce6acf None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:32.689107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-98f28e02-3c96-4116-a87a-6415c2ce6acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:32.705784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f28e02-3c96-4116-a87a-6415c2ce6acf None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:32.712243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066102b-170f-4a4e-bf2a-2ec7306b8bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:32.713421 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066102b-170f-4a4e-bf2a-2ec7306b8bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:32.713901 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066102b-170f-4a4e-bf2a-2ec7306b8bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:32.714367 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066102b-170f-4a4e-bf2a-2ec7306b8bfd admin admin] PATH_INFO: `/v3/users/396a369cba2c48c39d3dd3616bd0f53b` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:32.716398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066102b-170f-4a4e-bf2a-2ec7306b8bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=396a369cba2c48c39d3dd3616bd0f53b)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:32.718689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f066102b-170f-4a4e-bf2a-2ec7306b8bfd admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:32.767460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 899/1818] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:32 2022] POST /identity/v3/projects => generated 401 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:51:32.767460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8e887-cfc9-4190-bfa6-c9d666ee61fb admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:32.769399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-78d8e887-cfc9-4190-bfa6-c9d666ee61fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:32.856578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d8e887-cfc9-4190-bfa6-c9d666ee61fb admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:32.861919 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea70d58-cd4c-4da9-b8a2-7971eea8893c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:32.862751 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea70d58-cd4c-4da9-b8a2-7971eea8893c service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:32.863788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea70d58-cd4c-4da9-b8a2-7971eea8893c service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:32.864255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea70d58-cd4c-4da9-b8a2-7971eea8893c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:32.950340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea70d58-cd4c-4da9-b8a2-7971eea8893c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:32.953242 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea70d58-cd4c-4da9-b8a2-7971eea8893c service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:32.956677 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f066102b-170f-4a4e-bf2a-2ec7306b8bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '396a369cba2c48c39d3dd3616bd0f53b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:32.993872 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 900/1819] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:32.996013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea70d58-cd4c-4da9-b8a2-7971eea8893c service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:32.998164 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-1ea70d58-cd4c-4da9-b8a2-7971eea8893c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:33.011155 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:33.020834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea70d58-cd4c-4da9-b8a2-7971eea8893c service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:33.024911 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a16dc2-1f61-4343-aa79-61f6a0260124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:33.026539 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a16dc2-1f61-4343-aa79-61f6a0260124 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:33.026539 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a16dc2-1f61-4343-aa79-61f6a0260124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:33.026748 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a16dc2-1f61-4343-aa79-61f6a0260124 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:33.027449 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a16dc2-1f61-4343-aa79-61f6a0260124 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:33.029672 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a16dc2-1f61-4343-aa79-61f6a0260124 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:33.041117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f066102b-170f-4a4e-bf2a-2ec7306b8bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '396a369cba2c48c39d3dd3616bd0f53b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:33.064608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f066102b-170f-4a4e-bf2a-2ec7306b8bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '396a369cba2c48c39d3dd3616bd0f53b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:33.074080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f066102b-170f-4a4e-bf2a-2ec7306b8bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '396a369cba2c48c39d3dd3616bd0f53b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:33.076654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f066102b-170f-4a4e-bf2a-2ec7306b8bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '396a369cba2c48c39d3dd3616bd0f53b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:33.090272 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 920/1820] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:32 2022] DELETE /identity/v3/users/396a369cba2c48c39d3dd3616bd0f53b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:33.094984 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e034e-4b4c-4643-a8f2-b2fd6f8e499b None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:33.096553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e034e-4b4c-4643-a8f2-b2fd6f8e499b None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:33.097205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838e034e-4b4c-4643-a8f2-b2fd6f8e499b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:33.123329 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-838e034e-4b4c-4643-a8f2-b2fd6f8e499b None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:33.125012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-838e034e-4b4c-4643-a8f2-b2fd6f8e499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:33.142751 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 901/1821] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:32 2022] POST /identity/v3/users => generated 307 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:33.144031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a16dc2-1f61-4343-aa79-61f6a0260124 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:33.148026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-31a16dc2-1f61-4343-aa79-61f6a0260124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:33.191640 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a16dc2-1f61-4343-aa79-61f6a0260124 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:33.301939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 921/1822] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:33.327982 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e034e-4b4c-4643-a8f2-b2fd6f8e499b None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:33.329580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-838e034e-4b4c-4643-a8f2-b2fd6f8e499b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:33.349254 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb748dca-9e68-4b12-8400-3f402958ef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:33.349953 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb748dca-9e68-4b12-8400-3f402958ef54 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:33.350244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb748dca-9e68-4b12-8400-3f402958ef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:33.350522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb748dca-9e68-4b12-8400-3f402958ef54 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:33.354053 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb748dca-9e68-4b12-8400-3f402958ef54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:33.360672 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb748dca-9e68-4b12-8400-3f402958ef54 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:33.386005 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 902/1823] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:51:33.388334 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb748dca-9e68-4b12-8400-3f402958ef54 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:33.407987 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb748dca-9e68-4b12-8400-3f402958ef54 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:33.420581 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838e034e-4b4c-4643-a8f2-b2fd6f8e499b None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:33.427260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a7b45-18e4-4cda-a074-03430ded71a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:33.428383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a7b45-18e4-4cda-a074-03430ded71a1 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:33.428863 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a7b45-18e4-4cda-a074-03430ded71a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:33.429330 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a7b45-18e4-4cda-a074-03430ded71a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:33.442260 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2b3b9-f402-441b-8d24-f87cf790cf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:33.443205 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2b3b9-f402-441b-8d24-f87cf790cf72 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:33.443462 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2b3b9-f402-441b-8d24-f87cf790cf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:33.443768 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2b3b9-f402-441b-8d24-f87cf790cf72 admin admin] PATH_INFO: `/v3/projects/85439cdbe20147f5af7e7b6b8cfd67f8/users/8b28cda195b047ee8184d0a09e19f997/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:33.461046 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a7b45-18e4-4cda-a074-03430ded71a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:33.463589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a7b45-18e4-4cda-a074-03430ded71a1 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:33.465776 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2b3b9-f402-441b-8d24-f87cf790cf72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85439cdbe20147f5af7e7b6b8cfd67f8, user_id=8b28cda195b047ee8184d0a09e19f997, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:33.468610 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2b3b9-f402-441b-8d24-f87cf790cf72 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:33.483860 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 922/1824] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:33.620704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 903/1825] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:33 2022] PUT /identity/v3/projects/85439cdbe20147f5af7e7b6b8cfd67f8/users/8b28cda195b047ee8184d0a09e19f997/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:33.624585 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a7b45-18e4-4cda-a074-03430ded71a1 service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:33.634547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a7b45-18e4-4cda-a074-03430ded71a1 service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:33.686258 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58c9bd-3e1b-4912-b68a-59bc19e2db25 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:33.686258 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58c9bd-3e1b-4912-b68a-59bc19e2db25 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:33.686570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58c9bd-3e1b-4912-b68a-59bc19e2db25 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:33.688219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 904/1826] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jun 27 18:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:51:33.691121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5ca4f-13ab-4df3-8848-3fa51db66493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:33.692074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5ca4f-13ab-4df3-8848-3fa51db66493 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:33.692362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5ca4f-13ab-4df3-8848-3fa51db66493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:33.692638 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5ca4f-13ab-4df3-8848-3fa51db66493 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:33.693487 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5ca4f-13ab-4df3-8848-3fa51db66493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:33.695149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5ca4f-13ab-4df3-8848-3fa51db66493 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:33.707044 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 923/1827] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:51:33.708158 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2deb-a8a2-4817-927f-3290fd0b0b54 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:33.708462 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2deb-a8a2-4817-927f-3290fd0b0b54 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:33.714585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb2deb-a8a2-4817-927f-3290fd0b0b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:33.715458 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5ca4f-13ab-4df3-8848-3fa51db66493 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:33.727988 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5ca4f-13ab-4df3-8848-3fa51db66493 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:33.735963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-39cb2deb-a8a2-4817-927f-3290fd0b0b54 None None] MFA Rules not processed for user `da1746d29f9e4e8b8626ad4b11931cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:33.735963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-39cb2deb-a8a2-4817-927f-3290fd0b0b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:33.736162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5b028-9f5b-4154-9354-7276ada603ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:33.736162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b028-9f5b-4154-9354-7276ada603ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:33.736162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b028-9f5b-4154-9354-7276ada603ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:33.736162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b028-9f5b-4154-9354-7276ada603ce admin admin] PATH_INFO: `/v3/projects/85439cdbe20147f5af7e7b6b8cfd67f8/users/8b28cda195b047ee8184d0a09e19f997/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:33.737846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5b028-9f5b-4154-9354-7276ada603ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=85439cdbe20147f5af7e7b6b8cfd67f8, user_id=8b28cda195b047ee8184d0a09e19f997, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:33.740762 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5b028-9f5b-4154-9354-7276ada603ce admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:33.759821 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:33.772069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 924/1828] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:33 2022] PUT /identity/v3/projects/85439cdbe20147f5af7e7b6b8cfd67f8/users/8b28cda195b047ee8184d0a09e19f997/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:33.773115 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5b028-9f5b-4154-9354-7276ada603ce admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:33.778304 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-5fa5b028-9f5b-4154-9354-7276ada603ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:33.859260 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 905/1829] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jun 27 18:51:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:33.861051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968131d7-5713-473b-8701-b7e073f69ba5 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:33.861479 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968131d7-5713-473b-8701-b7e073f69ba5 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:33.862416 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968131d7-5713-473b-8701-b7e073f69ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:33.876725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5b028-9f5b-4154-9354-7276ada603ce admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:33.882208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5432a-deea-48d5-83c5-cc48cf0f025a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:33.883456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5432a-deea-48d5-83c5-cc48cf0f025a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:33.883775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5432a-deea-48d5-83c5-cc48cf0f025a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:33.884741 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5432a-deea-48d5-83c5-cc48cf0f025a admin admin] PATH_INFO: `/v3/projects/fb98cc9514484d15ab60981550627db6` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:33.886065 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5432a-deea-48d5-83c5-cc48cf0f025a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb98cc9514484d15ab60981550627db6)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:33.888666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d5432a-deea-48d5-83c5-cc48cf0f025a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:33.924438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-968131d7-5713-473b-8701-b7e073f69ba5 None None] MFA Rules not processed for user `8b28cda195b047ee8184d0a09e19f997`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:33.928690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-968131d7-5713-473b-8701-b7e073f69ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:34.044031 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-a2d5432a-deea-48d5-83c5-cc48cf0f025a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb98cc9514484d15ab60981550627db6', 'request_id': 'req-a2d5432a-deea-48d5-83c5-cc48cf0f025a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:34.046209 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 906/1830] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:33 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:34.048924 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968131d7-5713-473b-8701-b7e073f69ba5 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:34.056017 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-968131d7-5713-473b-8701-b7e073f69ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:34.060704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-a2d5432a-deea-48d5-83c5-cc48cf0f025a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb98cc9514484d15ab60981550627db6', 'request_id': 'req-a2d5432a-deea-48d5-83c5-cc48cf0f025a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:34.130759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-a2d5432a-deea-48d5-83c5-cc48cf0f025a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb98cc9514484d15ab60981550627db6', 'request_id': 'req-a2d5432a-deea-48d5-83c5-cc48cf0f025a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:34.143243 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968131d7-5713-473b-8701-b7e073f69ba5 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:34.150074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-a2d5432a-deea-48d5-83c5-cc48cf0f025a admin admin] The token cache is being invalidate because project fb98cc9514484d15ab60981550627db6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:34.150320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-a2d5432a-deea-48d5-83c5-cc48cf0f025a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:34.150979 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-a2d5432a-deea-48d5-83c5-cc48cf0f025a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:34.153586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 925/1831] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:33 2022] DELETE /identity/v3/projects/fb98cc9514484d15ab60981550627db6 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:34.154494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5432a-deea-48d5-83c5-cc48cf0f025a admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:34.156756 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a2d5432a-deea-48d5-83c5-cc48cf0f025a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:34.234180 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5432a-deea-48d5-83c5-cc48cf0f025a admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:34.237935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14738f4-770c-452f-91ea-936d9e76dabe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:34.238595 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14738f4-770c-452f-91ea-936d9e76dabe service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:34.239030 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14738f4-770c-452f-91ea-936d9e76dabe service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:34.239318 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14738f4-770c-452f-91ea-936d9e76dabe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:34.241396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:34.241538 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a14738f4-770c-452f-91ea-936d9e76dabe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:34.246721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26230ffc-dcfc-4fca-b117-188ac549c997 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:34.247866 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26230ffc-dcfc-4fca-b117-188ac549c997 service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:34.248333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26230ffc-dcfc-4fca-b117-188ac549c997 service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:34.248625 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26230ffc-dcfc-4fca-b117-188ac549c997 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:34.250614 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-26230ffc-dcfc-4fca-b117-188ac549c997 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:34.264812 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26230ffc-dcfc-4fca-b117-188ac549c997 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:34.266480 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26230ffc-dcfc-4fca-b117-188ac549c997 service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:34.279083 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 907/1832] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:34.279962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26230ffc-dcfc-4fca-b117-188ac549c997 service nova] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:34.284048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-26230ffc-dcfc-4fca-b117-188ac549c997 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:34.348721 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14738f4-770c-452f-91ea-936d9e76dabe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:34.348721 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14738f4-770c-452f-91ea-936d9e76dabe service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:34.360054 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 926/1833] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:34.361058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14738f4-770c-452f-91ea-936d9e76dabe service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:34.362429 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a14738f4-770c-452f-91ea-936d9e76dabe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:34.378508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14738f4-770c-452f-91ea-936d9e76dabe service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:34.383950 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26230ffc-dcfc-4fca-b117-188ac549c997 service nova] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:34.384436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6c93c-3363-4771-bd3d-878ef416db75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:34.384561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6c93c-3363-4771-bd3d-878ef416db75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:34.385233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6c93c-3363-4771-bd3d-878ef416db75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:34.385233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c6c93c-3363-4771-bd3d-878ef416db75 admin admin] PATH_INFO: `/v3/projects/0783c6a382174f8286339f6b1044f2f6` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:34.386357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6c93c-3363-4771-bd3d-878ef416db75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0783c6a382174f8286339f6b1044f2f6)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:34.388729 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45424c-7d56-41a6-8751-2a0a73c19504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:34.389055 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c6c93c-3363-4771-bd3d-878ef416db75 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:34.389618 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45424c-7d56-41a6-8751-2a0a73c19504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:34.389906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45424c-7d56-41a6-8751-2a0a73c19504 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:34.390183 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45424c-7d56-41a6-8751-2a0a73c19504 admin admin] PATH_INFO: `/v3/users/05b6d043d1e34da39749b86e9cf2bdb7` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:34.391796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45424c-7d56-41a6-8751-2a0a73c19504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b6d043d1e34da39749b86e9cf2bdb7)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:34.394213 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45424c-7d56-41a6-8751-2a0a73c19504 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:34.705645 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-59c6c93c-3363-4771-bd3d-878ef416db75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0783c6a382174f8286339f6b1044f2f6', 'request_id': 'req-59c6c93c-3363-4771-bd3d-878ef416db75'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:34.709119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0a45424c-7d56-41a6-8751-2a0a73c19504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b6d043d1e34da39749b86e9cf2bdb7'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:34.714044 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-59c6c93c-3363-4771-bd3d-878ef416db75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0783c6a382174f8286339f6b1044f2f6', 'request_id': 'req-59c6c93c-3363-4771-bd3d-878ef416db75'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:34.784336 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0a45424c-7d56-41a6-8751-2a0a73c19504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b6d043d1e34da39749b86e9cf2bdb7'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:34.798069 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0a45424c-7d56-41a6-8751-2a0a73c19504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b6d043d1e34da39749b86e9cf2bdb7'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:34.799710 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0a45424c-7d56-41a6-8751-2a0a73c19504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b6d043d1e34da39749b86e9cf2bdb7'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:34.805793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0a45424c-7d56-41a6-8751-2a0a73c19504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b6d043d1e34da39749b86e9cf2bdb7'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:34.812444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 908/1834] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:34 2022] DELETE /identity/v3/users/05b6d043d1e34da39749b86e9cf2bdb7 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:34.813355 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45424c-7d56-41a6-8751-2a0a73c19504 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:34.814557 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0a45424c-7d56-41a6-8751-2a0a73c19504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:34.829803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-59c6c93c-3363-4771-bd3d-878ef416db75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0783c6a382174f8286339f6b1044f2f6', 'request_id': 'req-59c6c93c-3363-4771-bd3d-878ef416db75'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:34.866437 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-59c6c93c-3363-4771-bd3d-878ef416db75 admin admin] The token cache is being invalidate because project 0783c6a382174f8286339f6b1044f2f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:34.866672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-59c6c93c-3363-4771-bd3d-878ef416db75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:34.867274 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-59c6c93c-3363-4771-bd3d-878ef416db75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:34.871733 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 927/1835] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:34 2022] DELETE /identity/v3/projects/0783c6a382174f8286339f6b1044f2f6 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:34.878838 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6c93c-3363-4771-bd3d-878ef416db75 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:34.881461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-59c6c93c-3363-4771-bd3d-878ef416db75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:34.933141 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45424c-7d56-41a6-8751-2a0a73c19504 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:34.940029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc2d03-461c-4d63-a8b7-c8f553e95af1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:34.941044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc2d03-461c-4d63-a8b7-c8f553e95af1 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:34.941340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc2d03-461c-4d63-a8b7-c8f553e95af1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:34.942127 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc2d03-461c-4d63-a8b7-c8f553e95af1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:34.947331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-4dbc2d03-461c-4d63-a8b7-c8f553e95af1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:34.967230 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c6c93c-3363-4771-bd3d-878ef416db75 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:35.051163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc2d03-461c-4d63-a8b7-c8f553e95af1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:35.053234 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc2d03-461c-4d63-a8b7-c8f553e95af1 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:35.054186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e0f35-9e2e-49ac-a624-fd3dfa946083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:35.055252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e0f35-9e2e-49ac-a624-fd3dfa946083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:35.055667 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e0f35-9e2e-49ac-a624-fd3dfa946083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:35.056083 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e0f35-9e2e-49ac-a624-fd3dfa946083 admin admin] PATH_INFO: `/v3/users/32bd7455cd9c4afeb4d403b941e774da` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:35.058707 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e0f35-9e2e-49ac-a624-fd3dfa946083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32bd7455cd9c4afeb4d403b941e774da)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:35.061323 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e0f35-9e2e-49ac-a624-fd3dfa946083 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:35.063183 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 909/1836] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:35.312827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-318e0f35-9e2e-49ac-a624-fd3dfa946083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32bd7455cd9c4afeb4d403b941e774da'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:35.393997 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-318e0f35-9e2e-49ac-a624-fd3dfa946083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32bd7455cd9c4afeb4d403b941e774da'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:35.408996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-318e0f35-9e2e-49ac-a624-fd3dfa946083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32bd7455cd9c4afeb4d403b941e774da'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:35.416937 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-318e0f35-9e2e-49ac-a624-fd3dfa946083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32bd7455cd9c4afeb4d403b941e774da'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:35.417655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-318e0f35-9e2e-49ac-a624-fd3dfa946083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32bd7455cd9c4afeb4d403b941e774da'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:35.427971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 928/1837] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:34 2022] DELETE /identity/v3/users/32bd7455cd9c4afeb4d403b941e774da => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:35.651062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:35.665113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc2d03-461c-4d63-a8b7-c8f553e95af1 service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:35.666571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-4dbc2d03-461c-4d63-a8b7-c8f553e95af1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:35.684189 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc2d03-461c-4d63-a8b7-c8f553e95af1 service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:35.777851 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5092cf-69c4-4805-9f28-6b65118ba330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:35.778830 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5092cf-69c4-4805-9f28-6b65118ba330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:35.779170 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5092cf-69c4-4805-9f28-6b65118ba330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:35.779612 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5092cf-69c4-4805-9f28-6b65118ba330 admin admin] PATH_INFO: `/v3/projects/7fe06218c0754440bc8267547471a926` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:35.781037 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5092cf-69c4-4805-9f28-6b65118ba330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fe06218c0754440bc8267547471a926)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:35.793247 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5092cf-69c4-4805-9f28-6b65118ba330 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:35.858901 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:35.943216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ff5092cf-69c4-4805-9f28-6b65118ba330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fe06218c0754440bc8267547471a926', 'request_id': 'req-ff5092cf-69c4-4805-9f28-6b65118ba330'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:36.036278 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ff5092cf-69c4-4805-9f28-6b65118ba330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fe06218c0754440bc8267547471a926', 'request_id': 'req-ff5092cf-69c4-4805-9f28-6b65118ba330'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:36.049835 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ff5092cf-69c4-4805-9f28-6b65118ba330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fe06218c0754440bc8267547471a926', 'request_id': 'req-ff5092cf-69c4-4805-9f28-6b65118ba330'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:36.069804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ff5092cf-69c4-4805-9f28-6b65118ba330 admin admin] The token cache is being invalidate because project 7fe06218c0754440bc8267547471a926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:36.071332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ff5092cf-69c4-4805-9f28-6b65118ba330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:36.072476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ff5092cf-69c4-4805-9f28-6b65118ba330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:36.075501 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 910/1838] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:35 2022] DELETE /identity/v3/projects/7fe06218c0754440bc8267547471a926 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:36.080961 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3143-cf32-417a-aa66-f289c585fbcc None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:36.081969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3143-cf32-417a-aa66-f289c585fbcc None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:36.082437 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3143-cf32-417a-aa66-f289c585fbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:36.116902 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-44ca3143-cf32-417a-aa66-f289c585fbcc None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:36.118140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-44ca3143-cf32-417a-aa66-f289c585fbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:36.184545 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5092cf-69c4-4805-9f28-6b65118ba330 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:36.186341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ff5092cf-69c4-4805-9f28-6b65118ba330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:36.201628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 929/1839] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:36.213126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fbb5a-ab91-459b-a4f4-974d23ddab10 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:36.213847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fbb5a-ab91-459b-a4f4-974d23ddab10 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:36.214224 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fbb5a-ab91-459b-a4f4-974d23ddab10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:36.236708 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-e27fbb5a-ab91-459b-a4f4-974d23ddab10 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:36.238135 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e27fbb5a-ab91-459b-a4f4-974d23ddab10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:36.251583 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 930/1840] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:36.256808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fbb5a-ab91-459b-a4f4-974d23ddab10 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:36.267127 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fbb5a-ab91-459b-a4f4-974d23ddab10 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:36.272355 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc9e80-9a7c-4704-9898-dd90d04c273e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:36.273025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc9e80-9a7c-4704-9898-dd90d04c273e admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:36.273312 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc9e80-9a7c-4704-9898-dd90d04c273e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:36.273858 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc9e80-9a7c-4704-9898-dd90d04c273e admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:36.274621 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc9e80-9a7c-4704-9898-dd90d04c273e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:51:36.274925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc9e80-9a7c-4704-9898-dd90d04c273e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:36.276791 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc9e80-9a7c-4704-9898-dd90d04c273e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:36.280022 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5092cf-69c4-4805-9f28-6b65118ba330 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:36.284572 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f5add-fb63-4a6a-ac08-31c3448b1ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:36.285438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f5add-fb63-4a6a-ac08-31c3448b1ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:36.285713 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f5add-fb63-4a6a-ac08-31c3448b1ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:36.285991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f5add-fb63-4a6a-ac08-31c3448b1ea0 admin admin] PATH_INFO: `/v3/projects/b276f44279c44dfc8c6d19d249a7456c` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:36.287173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f5add-fb63-4a6a-ac08-31c3448b1ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b276f44279c44dfc8c6d19d249a7456c)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:36.290557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 931/1841] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:51:36.290715 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f5add-fb63-4a6a-ac08-31c3448b1ea0 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:36.294080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc9e80-9a7c-4704-9898-dd90d04c273e admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:36.304733 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc9e80-9a7c-4704-9898-dd90d04c273e admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:36.310265 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dc293-2a79-4d5b-9659-2d60d38fd585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:36.310919 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dc293-2a79-4d5b-9659-2d60d38fd585 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:36.311205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dc293-2a79-4d5b-9659-2d60d38fd585 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:36.311484 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dc293-2a79-4d5b-9659-2d60d38fd585 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:36.312238 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dc293-2a79-4d5b-9659-2d60d38fd585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:36.314212 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dc293-2a79-4d5b-9659-2d60d38fd585 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:36.436016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 932/1842] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:36 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:51:36.437035 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dc293-2a79-4d5b-9659-2d60d38fd585 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:36.446744 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-371f5add-fb63-4a6a-ac08-31c3448b1ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b276f44279c44dfc8c6d19d249a7456c', 'request_id': 'req-371f5add-fb63-4a6a-ac08-31c3448b1ea0'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:36.554447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-371f5add-fb63-4a6a-ac08-31c3448b1ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b276f44279c44dfc8c6d19d249a7456c', 'request_id': 'req-371f5add-fb63-4a6a-ac08-31c3448b1ea0'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:36.574949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-371f5add-fb63-4a6a-ac08-31c3448b1ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b276f44279c44dfc8c6d19d249a7456c', 'request_id': 'req-371f5add-fb63-4a6a-ac08-31c3448b1ea0'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:36.591191 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-371f5add-fb63-4a6a-ac08-31c3448b1ea0 admin admin] The token cache is being invalidate because project b276f44279c44dfc8c6d19d249a7456c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:36.592000 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-371f5add-fb63-4a6a-ac08-31c3448b1ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:36.593369 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-371f5add-fb63-4a6a-ac08-31c3448b1ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:36.597550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 911/1843] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:36 2022] DELETE /identity/v3/projects/b276f44279c44dfc8c6d19d249a7456c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:36.603559 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92940cd9-ec14-4a2f-8547-69d54358bec9 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:36.604128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92940cd9-ec14-4a2f-8547-69d54358bec9 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:36.604565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92940cd9-ec14-4a2f-8547-69d54358bec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:36.629426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-92940cd9-ec14-4a2f-8547-69d54358bec9 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:36.630875 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-92940cd9-ec14-4a2f-8547-69d54358bec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:36.646449 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dc293-2a79-4d5b-9659-2d60d38fd585 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:36.651717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8748b1-30fb-4ba4-b8de-bae08d918434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:36.653109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8748b1-30fb-4ba4-b8de-bae08d918434 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:36.653392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8748b1-30fb-4ba4-b8de-bae08d918434 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:36.655960 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8748b1-30fb-4ba4-b8de-bae08d918434 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:36.656807 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8748b1-30fb-4ba4-b8de-bae08d918434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:36.659408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8748b1-30fb-4ba4-b8de-bae08d918434 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:36.723191 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 912/1844] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:36.742576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945853d-ae7d-4a6c-8f1f-13d8ac50e493 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:36.742876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945853d-ae7d-4a6c-8f1f-13d8ac50e493 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:36.743664 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a945853d-ae7d-4a6c-8f1f-13d8ac50e493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:36.762751 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-a945853d-ae7d-4a6c-8f1f-13d8ac50e493 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:36.764039 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-a945853d-ae7d-4a6c-8f1f-13d8ac50e493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:36.772551 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 913/1845] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:36.776841 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945853d-ae7d-4a6c-8f1f-13d8ac50e493 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:36.789941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 933/1846] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:36 2022] POST /identity/v3/users => generated 290 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:36.794710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8748b1-30fb-4ba4-b8de-bae08d918434 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:36.795007 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a945853d-ae7d-4a6c-8f1f-13d8ac50e493 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:36.797833 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-3a8748b1-30fb-4ba4-b8de-bae08d918434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:36.801797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1f002-9643-4399-8634-125612043817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:36.802546 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1f002-9643-4399-8634-125612043817 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:36.803009 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1f002-9643-4399-8634-125612043817 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:36.808930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1f002-9643-4399-8634-125612043817 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:36.813993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1f002-9643-4399-8634-125612043817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:51:36.813993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1f002-9643-4399-8634-125612043817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:36.813993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1f002-9643-4399-8634-125612043817 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:36.817598 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8748b1-30fb-4ba4-b8de-bae08d918434 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:36.823234 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d43fb2-8355-4835-b08c-3adaabafcdc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:36.823993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d43fb2-8355-4835-b08c-3adaabafcdc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:36.824287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d43fb2-8355-4835-b08c-3adaabafcdc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:36.824573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d43fb2-8355-4835-b08c-3adaabafcdc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:36.825518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d43fb2-8355-4835-b08c-3adaabafcdc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:36.827153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d43fb2-8355-4835-b08c-3adaabafcdc9 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:36.833288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 914/1847] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:51:36.836901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1f002-9643-4399-8634-125612043817 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:36.847574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 934/1848] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:51:36.849322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d43fb2-8355-4835-b08c-3adaabafcdc9 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:36.850363 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1f002-9643-4399-8634-125612043817 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:36.855983 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37f580-5a6e-468c-9cfb-e52bd835b01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:36.856648 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f580-5a6e-468c-9cfb-e52bd835b01a admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:36.856930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f580-5a6e-468c-9cfb-e52bd835b01a admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:36.857237 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37f580-5a6e-468c-9cfb-e52bd835b01a admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:36.858042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37f580-5a6e-468c-9cfb-e52bd835b01a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:36.861643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37f580-5a6e-468c-9cfb-e52bd835b01a admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:36.879677 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d43fb2-8355-4835-b08c-3adaabafcdc9 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:36.884837 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c619a41-872d-4668-82ad-aa429ec54c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:36.885732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c619a41-872d-4668-82ad-aa429ec54c97 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:36.886629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c619a41-872d-4668-82ad-aa429ec54c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:36.886629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c619a41-872d-4668-82ad-aa429ec54c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:36.887069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c619a41-872d-4668-82ad-aa429ec54c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:36.888871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c619a41-872d-4668-82ad-aa429ec54c97 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:36.915553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 935/1849] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:36.920025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c619a41-872d-4668-82ad-aa429ec54c97 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:36.931281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c619a41-872d-4668-82ad-aa429ec54c97 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:36.936425 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf4808b-67fc-4bb4-ab78-2196b1b80949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:36.937609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4808b-67fc-4bb4-ab78-2196b1b80949 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:36.938157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4808b-67fc-4bb4-ab78-2196b1b80949 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:36.938570 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf4808b-67fc-4bb4-ab78-2196b1b80949 admin admin] PATH_INFO: `/v3/projects/ff939ce00da64845957463f2ce13796e/users/d1421694966249e9906ec57667e22369/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:36.955138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4808b-67fc-4bb4-ab78-2196b1b80949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff939ce00da64845957463f2ce13796e, user_id=d1421694966249e9906ec57667e22369, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:36.957761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf4808b-67fc-4bb4-ab78-2196b1b80949 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:36.975861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 915/1850] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:36 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:51:36.980143 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37f580-5a6e-468c-9cfb-e52bd835b01a admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:37.053040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37f580-5a6e-468c-9cfb-e52bd835b01a admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:37.062148 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 936/1851] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:36 2022] PUT /identity/v3/projects/ff939ce00da64845957463f2ce13796e/users/d1421694966249e9906ec57667e22369/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:37.065370 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce91e4-e3f4-43e3-bab4-d7d986fc46d6 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:37.065658 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce91e4-e3f4-43e3-bab4-d7d986fc46d6 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:37.065925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce91e4-e3f4-43e3-bab4-d7d986fc46d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:37.099879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-15ce91e4-e3f4-43e3-bab4-d7d986fc46d6 None None] MFA Rules not processed for user `d1421694966249e9906ec57667e22369`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:37.104613 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-15ce91e4-e3f4-43e3-bab4-d7d986fc46d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:37.118290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795060bf-061b-4e75-a813-dfec9c3a6fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:37.118970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795060bf-061b-4e75-a813-dfec9c3a6fbe admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:37.119287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795060bf-061b-4e75-a813-dfec9c3a6fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:37.119708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795060bf-061b-4e75-a813-dfec9c3a6fbe admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:37.120419 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795060bf-061b-4e75-a813-dfec9c3a6fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:37.122452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795060bf-061b-4e75-a813-dfec9c3a6fbe admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:37.165320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 937/1852] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:37.169788 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce91e4-e3f4-43e3-bab4-d7d986fc46d6 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:37.180123 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce91e4-e3f4-43e3-bab4-d7d986fc46d6 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:37.184730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae4c59-3788-4da8-a618-8a728dc60b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:37.185379 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae4c59-3788-4da8-a618-8a728dc60b79 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:37.185661 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae4c59-3788-4da8-a618-8a728dc60b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:37.185936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ae4c59-3788-4da8-a618-8a728dc60b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:37.186622 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae4c59-3788-4da8-a618-8a728dc60b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:37.188687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ae4c59-3788-4da8-a618-8a728dc60b79 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:37.240915 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:37.247263 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 916/1853] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:36 2022] POST /identity/v3/users => generated 284 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:51:37.251545 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795060bf-061b-4e75-a813-dfec9c3a6fbe admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:37.262301 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795060bf-061b-4e75-a813-dfec9c3a6fbe admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:37.267752 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853fac0-498a-4e18-ad9d-ab2dbef45413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:37.268528 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853fac0-498a-4e18-ad9d-ab2dbef45413 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:37.268817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853fac0-498a-4e18-ad9d-ab2dbef45413 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:37.269642 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853fac0-498a-4e18-ad9d-ab2dbef45413 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:37.270399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853fac0-498a-4e18-ad9d-ab2dbef45413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:37.272091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853fac0-498a-4e18-ad9d-ab2dbef45413 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:37.286092 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 917/1854] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:51:37.287462 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853fac0-498a-4e18-ad9d-ab2dbef45413 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:37.298206 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853fac0-498a-4e18-ad9d-ab2dbef45413 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:37.304121 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299de50-4c33-464e-b202-f1f7c2ee8994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:37.305053 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299de50-4c33-464e-b202-f1f7c2ee8994 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:37.305439 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299de50-4c33-464e-b202-f1f7c2ee8994 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:37.305820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299de50-4c33-464e-b202-f1f7c2ee8994 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:37.306836 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299de50-4c33-464e-b202-f1f7c2ee8994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:37.309463 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299de50-4c33-464e-b202-f1f7c2ee8994 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:37.324896 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 938/1855] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:37 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:51:37.329939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 918/1856] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:51:37.330077 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae4c59-3788-4da8-a618-8a728dc60b79 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:37.331772 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299de50-4c33-464e-b202-f1f7c2ee8994 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:37.345365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299de50-4c33-464e-b202-f1f7c2ee8994 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:37.411946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ae4c59-3788-4da8-a618-8a728dc60b79 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:37.417377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eca0f-5413-4733-85c7-7c0167e5c978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:37.418283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eca0f-5413-4733-85c7-7c0167e5c978 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:37.418447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b7820-0baf-42ce-8539-fac84619190b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:37.418585 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eca0f-5413-4733-85c7-7c0167e5c978 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:37.418839 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eca0f-5413-4733-85c7-7c0167e5c978 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:37.419481 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b7820-0baf-42ce-8539-fac84619190b admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:37.419685 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577eca0f-5413-4733-85c7-7c0167e5c978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:37.420011 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b7820-0baf-42ce-8539-fac84619190b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:37.420909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b7820-0baf-42ce-8539-fac84619190b admin admin] PATH_INFO: `/v3/projects/a5f07ea2be324cec82643e2f60a6e8a2/users/2b2fcad40a4842efa1d22fa12647e3b5/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:37.421732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577eca0f-5413-4733-85c7-7c0167e5c978 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:37.439500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b7820-0baf-42ce-8539-fac84619190b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f07ea2be324cec82643e2f60a6e8a2, user_id=2b2fcad40a4842efa1d22fa12647e3b5, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:37.442355 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b7820-0baf-42ce-8539-fac84619190b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:37.533780 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 939/1857] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:37 2022] POST /identity/v3/users => generated 295 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:51:37.536201 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 919/1858] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:37 2022] PUT /identity/v3/projects/a5f07ea2be324cec82643e2f60a6e8a2/users/2b2fcad40a4842efa1d22fa12647e3b5/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:37.537504 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eca0f-5413-4733-85c7-7c0167e5c978 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:37.546090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0588c4-506a-4074-9d58-6d040c415696 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:37.546383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0588c4-506a-4074-9d58-6d040c415696 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:37.546670 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0588c4-506a-4074-9d58-6d040c415696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:37.547231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eca0f-5413-4733-85c7-7c0167e5c978 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:37.573424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-fb0588c4-506a-4074-9d58-6d040c415696 None None] MFA Rules not processed for user `2b2fcad40a4842efa1d22fa12647e3b5`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:37.575341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-fb0588c4-506a-4074-9d58-6d040c415696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:37.603946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ece6a-9b96-4766-9ce0-fd5488c735a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:37.604632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ece6a-9b96-4766-9ce0-fd5488c735a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:37.604920 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ece6a-9b96-4766-9ce0-fd5488c735a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:37.605241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ece6a-9b96-4766-9ce0-fd5488c735a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:37.605976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ece6a-9b96-4766-9ce0-fd5488c735a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:37.607813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ece6a-9b96-4766-9ce0-fd5488c735a9 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:37.618763 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 940/1859] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:37.623795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ece6a-9b96-4766-9ce0-fd5488c735a9 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:37.646188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ece6a-9b96-4766-9ce0-fd5488c735a9 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:37.651443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c7edf-d88d-415b-841a-e583d1663c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:37.652503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c7edf-d88d-415b-841a-e583d1663c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:37.653016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c7edf-d88d-415b-841a-e583d1663c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:37.653401 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c7edf-d88d-415b-841a-e583d1663c6d admin admin] PATH_INFO: `/v3/projects/ec281e34337b452a95f805138833607d/users/bb5e10bc72594e71bc85146c7412b393/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:37.674513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c7edf-d88d-415b-841a-e583d1663c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec281e34337b452a95f805138833607d, user_id=bb5e10bc72594e71bc85146c7412b393, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:37.677760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c7edf-d88d-415b-841a-e583d1663c6d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:37.679563 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 920/1860] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:37.683279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0588c4-506a-4074-9d58-6d040c415696 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:37.695764 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0588c4-506a-4074-9d58-6d040c415696 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:37.701216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c78b3c-9557-4232-aa04-89585d387b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:37.702098 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c78b3c-9557-4232-aa04-89585d387b1a admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:37.702307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c78b3c-9557-4232-aa04-89585d387b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:37.702613 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c78b3c-9557-4232-aa04-89585d387b1a admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:37.703321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c78b3c-9557-4232-aa04-89585d387b1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:37.705283 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c78b3c-9557-4232-aa04-89585d387b1a admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:37.773014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 941/1861] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:37 2022] PUT /identity/v3/projects/ec281e34337b452a95f805138833607d/users/bb5e10bc72594e71bc85146c7412b393/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:37.776719 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c7edf-d88d-415b-841a-e583d1663c6d admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:37.798313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 921/1862] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:37 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:37.802320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c78b3c-9557-4232-aa04-89585d387b1a admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:37.856939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c7edf-d88d-415b-841a-e583d1663c6d admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:37.878132 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c78b3c-9557-4232-aa04-89585d387b1a admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:37.891200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fe755-73ef-4993-80e4-a2d405fbb2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:37.891200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fe755-73ef-4993-80e4-a2d405fbb2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:37.891200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fe755-73ef-4993-80e4-a2d405fbb2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:37.891200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15fe755-73ef-4993-80e4-a2d405fbb2c1 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:37.891637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15fe755-73ef-4993-80e4-a2d405fbb2c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:37.891637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15fe755-73ef-4993-80e4-a2d405fbb2c1 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:37.944597 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d3120-d52c-4b7b-a333-944641b85c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:37.945552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d3120-d52c-4b7b-a333-944641b85c67 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:37.945845 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d3120-d52c-4b7b-a333-944641b85c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:37.946123 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d3120-d52c-4b7b-a333-944641b85c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:37.947012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d3120-d52c-4b7b-a333-944641b85c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:37.948671 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056d3120-d52c-4b7b-a333-944641b85c67 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:37.959396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 942/1863] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:37.963397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d3120-d52c-4b7b-a333-944641b85c67 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:37.973813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d3120-d52c-4b7b-a333-944641b85c67 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:37.978895 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff958346-c7a8-43bc-89ae-118516a69778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:37.979878 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff958346-c7a8-43bc-89ae-118516a69778 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:37.983224 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff958346-c7a8-43bc-89ae-118516a69778 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:37.983393 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 922/1864] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:37 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:37.983502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff958346-c7a8-43bc-89ae-118516a69778 admin admin] PATH_INFO: `/v3/projects/ec281e34337b452a95f805138833607d/users/bb5e10bc72594e71bc85146c7412b393/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:37.983502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff958346-c7a8-43bc-89ae-118516a69778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec281e34337b452a95f805138833607d, user_id=bb5e10bc72594e71bc85146c7412b393, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:37.985406 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff958346-c7a8-43bc-89ae-118516a69778 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:37.986006 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fe755-73ef-4993-80e4-a2d405fbb2c1 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:37.996723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 943/1865] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:37 2022] PUT /identity/v3/projects/ec281e34337b452a95f805138833607d/users/bb5e10bc72594e71bc85146c7412b393/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:38.002926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15fe755-73ef-4993-80e4-a2d405fbb2c1 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:38.006486 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764da79-063f-408c-8ddb-c0e379d04d3f None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:38.006839 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764da79-063f-408c-8ddb-c0e379d04d3f None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:38.007400 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764da79-063f-408c-8ddb-c0e379d04d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:38.046026 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-b764da79-063f-408c-8ddb-c0e379d04d3f None None] MFA Rules not processed for user `bb5e10bc72594e71bc85146c7412b393`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:38.047780 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b764da79-063f-408c-8ddb-c0e379d04d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:38.093238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a59d8-cde3-4c37-8319-fcdd741ab4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:38.094001 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a59d8-cde3-4c37-8319-fcdd741ab4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:38.094435 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a59d8-cde3-4c37-8319-fcdd741ab4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:38.094787 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a59d8-cde3-4c37-8319-fcdd741ab4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:38.095867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a59d8-cde3-4c37-8319-fcdd741ab4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:38.097691 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a59d8-cde3-4c37-8319-fcdd741ab4d8 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:38.121918 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 923/1866] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:37 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:51:38.128176 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a59d8-cde3-4c37-8319-fcdd741ab4d8 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:38.140235 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a59d8-cde3-4c37-8319-fcdd741ab4d8 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:38.145608 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bebf11-25b7-466b-b80d-6d9c12170a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:38.146322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bebf11-25b7-466b-b80d-6d9c12170a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:38.146613 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bebf11-25b7-466b-b80d-6d9c12170a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:38.146899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bebf11-25b7-466b-b80d-6d9c12170a63 admin admin] PATH_INFO: `/v3/projects/8fa6fb054636412bba422028bd0ebf12/users/1e11c411de7b4f689451572b72b22207/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:38.159000 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 944/1867] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:38.165740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bebf11-25b7-466b-b80d-6d9c12170a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa6fb054636412bba422028bd0ebf12, user_id=1e11c411de7b4f689451572b72b22207, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:38.168729 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bebf11-25b7-466b-b80d-6d9c12170a63 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:38.176865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764da79-063f-408c-8ddb-c0e379d04d3f None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:38.180157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b764da79-063f-408c-8ddb-c0e379d04d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:38.188639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=81,keystone:INSERT=4,keystone:DELETE=15 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:38.248644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764da79-063f-408c-8ddb-c0e379d04d3f None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:38.252958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f8c74-4575-470a-9c7c-766985c333ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:38.253618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f8c74-4575-470a-9c7c-766985c333ce service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:38.253907 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f8c74-4575-470a-9c7c-766985c333ce service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:38.254223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f8c74-4575-470a-9c7c-766985c333ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:38.291397 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 924/1868] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:38 2022] PUT /identity/v3/projects/8fa6fb054636412bba422028bd0ebf12/users/1e11c411de7b4f689451572b72b22207/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:38.295185 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bebf11-25b7-466b-b80d-6d9c12170a63 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:38.414667 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bebf11-25b7-466b-b80d-6d9c12170a63 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:38.418385 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f8c74-4575-470a-9c7c-766985c333ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:38.421686 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba007a0-429f-4fb6-8262-f46044e57345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:38.422858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba007a0-429f-4fb6-8262-f46044e57345 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:38.423402 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba007a0-429f-4fb6-8262-f46044e57345 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:38.423892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba007a0-429f-4fb6-8262-f46044e57345 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:38.424946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba007a0-429f-4fb6-8262-f46044e57345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:38.425665 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f8c74-4575-470a-9c7c-766985c333ce service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:38.428187 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba007a0-429f-4fb6-8262-f46044e57345 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:38.447390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 925/1869] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:51:38.449696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba007a0-429f-4fb6-8262-f46044e57345 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:38.454657 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 945/1870] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:38 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:51:38.466843 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba007a0-429f-4fb6-8262-f46044e57345 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:38.476339 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660655f8-b13b-4245-947d-48186b37b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:38.478152 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660655f8-b13b-4245-947d-48186b37b9eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:38.480682 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660655f8-b13b-4245-947d-48186b37b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:38.481038 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660655f8-b13b-4245-947d-48186b37b9eb admin admin] PATH_INFO: `/v3/projects/8fa6fb054636412bba422028bd0ebf12/users/1e11c411de7b4f689451572b72b22207/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:38.485340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660655f8-b13b-4245-947d-48186b37b9eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fa6fb054636412bba422028bd0ebf12, user_id=1e11c411de7b4f689451572b72b22207, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:38.488385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660655f8-b13b-4245-947d-48186b37b9eb admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:38.513413 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 926/1871] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:38 2022] PUT /identity/v3/projects/8fa6fb054636412bba422028bd0ebf12/users/1e11c411de7b4f689451572b72b22207/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:38.532642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01416918-285a-4227-8d03-b1207c32a918 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:38.534427 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01416918-285a-4227-8d03-b1207c32a918 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:38.534822 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01416918-285a-4227-8d03-b1207c32a918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:38.595320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-01416918-285a-4227-8d03-b1207c32a918 None None] MFA Rules not processed for user `1e11c411de7b4f689451572b72b22207`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:38.599126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-01416918-285a-4227-8d03-b1207c32a918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:38.733913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 946/1872] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:38 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:38.764745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660655f8-b13b-4245-947d-48186b37b9eb admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:38.765450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-660655f8-b13b-4245-947d-48186b37b9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:38.858088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660655f8-b13b-4245-947d-48186b37b9eb admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:38.863025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648a089-86b3-4f51-b374-6c486e85f889 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:38.863806 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648a089-86b3-4f51-b374-6c486e85f889 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:38.864096 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648a089-86b3-4f51-b374-6c486e85f889 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:38.864374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648a089-86b3-4f51-b374-6c486e85f889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:38.879446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648a089-86b3-4f51-b374-6c486e85f889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:38.881727 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648a089-86b3-4f51-b374-6c486e85f889 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:38.903027 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 927/1873] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:38 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:38.920223 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:39.111094 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01416918-285a-4227-8d03-b1207c32a918 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:39.120659 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01416918-285a-4227-8d03-b1207c32a918 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:39.124488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c554e-4a32-4196-ba99-12a180b57c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:39.127479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c554e-4a32-4196-ba99-12a180b57c37 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:39.127479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c554e-4a32-4196-ba99-12a180b57c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:39.127479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c554e-4a32-4196-ba99-12a180b57c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:39.185212 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c554e-4a32-4196-ba99-12a180b57c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:39.186935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576c554e-4a32-4196-ba99-12a180b57c37 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:39.202744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 947/1874] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:39 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:40.925772 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:41.036170 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648a089-86b3-4f51-b374-6c486e85f889 service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:41.045646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648a089-86b3-4f51-b374-6c486e85f889 service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:41.057956 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:41.058417 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab202755-73bb-47b9-b421-2eb4e9a8f7da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:41.058417 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202755-73bb-47b9-b421-2eb4e9a8f7da service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:41.058417 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202755-73bb-47b9-b421-2eb4e9a8f7da service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:41.058417 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab202755-73bb-47b9-b421-2eb4e9a8f7da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:41.121273 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab202755-73bb-47b9-b421-2eb4e9a8f7da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:41.122634 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab202755-73bb-47b9-b421-2eb4e9a8f7da service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:41.134095 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 928/1875] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:41 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:41.849750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c554e-4a32-4196-ba99-12a180b57c37 service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:41.851487 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-576c554e-4a32-4196-ba99-12a180b57c37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:41.925684 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c554e-4a32-4196-ba99-12a180b57c37 service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:41.930316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c43b0-9d2e-4df9-9776-352141cfbc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:41.931248 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c43b0-9d2e-4df9-9776-352141cfbc81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:41.931589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c43b0-9d2e-4df9-9776-352141cfbc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:41.931869 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c43b0-9d2e-4df9-9776-352141cfbc81 admin admin] PATH_INFO: `/v3/users/9c67009f77994cc2ba5eac7ec7c73f4a` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:41.933609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c43b0-9d2e-4df9-9776-352141cfbc81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c67009f77994cc2ba5eac7ec7c73f4a)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:41.935806 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c43b0-9d2e-4df9-9776-352141cfbc81 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:41.989922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:42.131242 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bc8c43b0-9d2e-4df9-9776-352141cfbc81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c67009f77994cc2ba5eac7ec7c73f4a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:42.230357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bc8c43b0-9d2e-4df9-9776-352141cfbc81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c67009f77994cc2ba5eac7ec7c73f4a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:42.257769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bc8c43b0-9d2e-4df9-9776-352141cfbc81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c67009f77994cc2ba5eac7ec7c73f4a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:42.277701 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bc8c43b0-9d2e-4df9-9776-352141cfbc81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c67009f77994cc2ba5eac7ec7c73f4a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:42.278866 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bc8c43b0-9d2e-4df9-9776-352141cfbc81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c67009f77994cc2ba5eac7ec7c73f4a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:42.291267 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 948/1876] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:41 2022] DELETE /identity/v3/users/9c67009f77994cc2ba5eac7ec7c73f4a => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:42.292655 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa056e-1e7e-4e31-a064-cc274c6b7c6f None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:42.293176 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa056e-1e7e-4e31-a064-cc274c6b7c6f None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:42.293652 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaa056e-1e7e-4e31-a064-cc274c6b7c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:42.314268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-fdaa056e-1e7e-4e31-a064-cc274c6b7c6f None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:42.316360 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-fdaa056e-1e7e-4e31-a064-cc274c6b7c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:42.446121 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 929/1877] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:42.471892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c43b0-9d2e-4df9-9776-352141cfbc81 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:42.471892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-bc8c43b0-9d2e-4df9-9776-352141cfbc81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:42.561734 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c43b0-9d2e-4df9-9776-352141cfbc81 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:42.565446 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34dd78-8b43-4b8d-9cf6-ae8abcd106e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:42.566123 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34dd78-8b43-4b8d-9cf6-ae8abcd106e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:42.566393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34dd78-8b43-4b8d-9cf6-ae8abcd106e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:42.566676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34dd78-8b43-4b8d-9cf6-ae8abcd106e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:42.592036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34dd78-8b43-4b8d-9cf6-ae8abcd106e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:42.592036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34dd78-8b43-4b8d-9cf6-ae8abcd106e2 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:42.601322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 949/1878] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:43.360666 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa056e-1e7e-4e31-a064-cc274c6b7c6f None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:43.362916 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-fdaa056e-1e7e-4e31-a064-cc274c6b7c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:43.380495 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaa056e-1e7e-4e31-a064-cc274c6b7c6f None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:43.393505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f1d92-77e2-4922-8c87-85b4d5dca022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:43.394606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f1d92-77e2-4922-8c87-85b4d5dca022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:43.395071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f1d92-77e2-4922-8c87-85b4d5dca022 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:43.395495 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0f1d92-77e2-4922-8c87-85b4d5dca022 admin admin] PATH_INFO: `/v3/projects/01a805c81f6f44e69f8cb9aa39712d4b` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:43.396921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f1d92-77e2-4922-8c87-85b4d5dca022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01a805c81f6f44e69f8cb9aa39712d4b)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:43.399252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0f1d92-77e2-4922-8c87-85b4d5dca022 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:43.551221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0d0f1d92-77e2-4922-8c87-85b4d5dca022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01a805c81f6f44e69f8cb9aa39712d4b', 'request_id': 'req-0d0f1d92-77e2-4922-8c87-85b4d5dca022'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:43.629122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0d0f1d92-77e2-4922-8c87-85b4d5dca022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01a805c81f6f44e69f8cb9aa39712d4b', 'request_id': 'req-0d0f1d92-77e2-4922-8c87-85b4d5dca022'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:43.636412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0d0f1d92-77e2-4922-8c87-85b4d5dca022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01a805c81f6f44e69f8cb9aa39712d4b', 'request_id': 'req-0d0f1d92-77e2-4922-8c87-85b4d5dca022'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:43.641185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:43.649015 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0d0f1d92-77e2-4922-8c87-85b4d5dca022 admin admin] The token cache is being invalidate because project 01a805c81f6f44e69f8cb9aa39712d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:43.649315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0d0f1d92-77e2-4922-8c87-85b4d5dca022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:43.652242 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0d0f1d92-77e2-4922-8c87-85b4d5dca022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:43.652242 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 930/1879] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:43 2022] DELETE /identity/v3/projects/01a805c81f6f44e69f8cb9aa39712d4b => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:43.657780 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34dd78-8b43-4b8d-9cf6-ae8abcd106e2 service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:43.668188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34dd78-8b43-4b8d-9cf6-ae8abcd106e2 service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:43.734442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710be47f-9b43-4169-ae22-19d44fb0631c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:43.735333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710be47f-9b43-4169-ae22-19d44fb0631c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:43.735647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710be47f-9b43-4169-ae22-19d44fb0631c admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:43.736089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710be47f-9b43-4169-ae22-19d44fb0631c admin admin] PATH_INFO: `/v3/users/8b28cda195b047ee8184d0a09e19f997` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:43.737310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710be47f-9b43-4169-ae22-19d44fb0631c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b28cda195b047ee8184d0a09e19f997)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:43.739366 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710be47f-9b43-4169-ae22-19d44fb0631c admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:43.963837 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-710be47f-9b43-4169-ae22-19d44fb0631c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b28cda195b047ee8184d0a09e19f997'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:44.029180 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-710be47f-9b43-4169-ae22-19d44fb0631c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b28cda195b047ee8184d0a09e19f997'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:44.045808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-710be47f-9b43-4169-ae22-19d44fb0631c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b28cda195b047ee8184d0a09e19f997'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:44.053484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:44.060674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-710be47f-9b43-4169-ae22-19d44fb0631c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b28cda195b047ee8184d0a09e19f997'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:44.061421 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-710be47f-9b43-4169-ae22-19d44fb0631c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b28cda195b047ee8184d0a09e19f997'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:44.071276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 950/1880] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:43 2022] DELETE /identity/v3/users/8b28cda195b047ee8184d0a09e19f997 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:44.207522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f1d92-77e2-4922-8c87-85b4d5dca022 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:44.209107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0d0f1d92-77e2-4922-8c87-85b4d5dca022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:44.222823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0f1d92-77e2-4922-8c87-85b4d5dca022 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:44.280797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c28f3-79b4-484d-b892-912329a01271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:44.281677 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c28f3-79b4-484d-b892-912329a01271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:44.283230 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c28f3-79b4-484d-b892-912329a01271 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:44.283230 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c28f3-79b4-484d-b892-912329a01271 admin admin] PATH_INFO: `/v3/users/2b2fcad40a4842efa1d22fa12647e3b5` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:44.283399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c28f3-79b4-484d-b892-912329a01271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2fcad40a4842efa1d22fa12647e3b5)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:44.285325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c28f3-79b4-484d-b892-912329a01271 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:44.539992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-e21c28f3-79b4-484d-b892-912329a01271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2fcad40a4842efa1d22fa12647e3b5'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:44.613193 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-e21c28f3-79b4-484d-b892-912329a01271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2fcad40a4842efa1d22fa12647e3b5'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:44.644386 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-e21c28f3-79b4-484d-b892-912329a01271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2fcad40a4842efa1d22fa12647e3b5'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:44.645424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-e21c28f3-79b4-484d-b892-912329a01271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2fcad40a4842efa1d22fa12647e3b5'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:44.652964 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-e21c28f3-79b4-484d-b892-912329a01271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2fcad40a4842efa1d22fa12647e3b5'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:44.659213 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 931/1881] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:44 2022] DELETE /identity/v3/users/2b2fcad40a4842efa1d22fa12647e3b5 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:44.663632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47873f36-5de5-4b10-98cd-de8709a34c98 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:44.664129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47873f36-5de5-4b10-98cd-de8709a34c98 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:44.664244 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47873f36-5de5-4b10-98cd-de8709a34c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:44.682583 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-47873f36-5de5-4b10-98cd-de8709a34c98 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:44.684594 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-47873f36-5de5-4b10-98cd-de8709a34c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:44.745470 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c28f3-79b4-484d-b892-912329a01271 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:44.747799 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e21c28f3-79b4-484d-b892-912329a01271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:44.749036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 951/1882] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:44.758746 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47873f36-5de5-4b10-98cd-de8709a34c98 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:44.760445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-47873f36-5de5-4b10-98cd-de8709a34c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:44.765349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c28f3-79b4-484d-b892-912329a01271 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:44.771902 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556d59e-ddb4-4ef8-ad92-aef647d47245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:44.778724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556d59e-ddb4-4ef8-ad92-aef647d47245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:44.779205 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556d59e-ddb4-4ef8-ad92-aef647d47245 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:44.779490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556d59e-ddb4-4ef8-ad92-aef647d47245 admin admin] PATH_INFO: `/v3/projects/85439cdbe20147f5af7e7b6b8cfd67f8` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:44.781562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556d59e-ddb4-4ef8-ad92-aef647d47245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85439cdbe20147f5af7e7b6b8cfd67f8)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:44.783682 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556d59e-ddb4-4ef8-ad92-aef647d47245 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:44.841755 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47873f36-5de5-4b10-98cd-de8709a34c98 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:44.846556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa7b657-b3ef-4b49-aa31-94a5d928644e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:44.847433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7b657-b3ef-4b49-aa31-94a5d928644e service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:44.847920 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7b657-b3ef-4b49-aa31-94a5d928644e service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:44.848196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa7b657-b3ef-4b49-aa31-94a5d928644e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:44.867352 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7b657-b3ef-4b49-aa31-94a5d928644e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:44.868927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa7b657-b3ef-4b49-aa31-94a5d928644e service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:44.880011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 952/1883] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:44.967862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0556d59e-ddb4-4ef8-ad92-aef647d47245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85439cdbe20147f5af7e7b6b8cfd67f8', 'request_id': 'req-0556d59e-ddb4-4ef8-ad92-aef647d47245'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:45.115035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0556d59e-ddb4-4ef8-ad92-aef647d47245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85439cdbe20147f5af7e7b6b8cfd67f8', 'request_id': 'req-0556d59e-ddb4-4ef8-ad92-aef647d47245'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:45.121741 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0556d59e-ddb4-4ef8-ad92-aef647d47245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85439cdbe20147f5af7e7b6b8cfd67f8', 'request_id': 'req-0556d59e-ddb4-4ef8-ad92-aef647d47245'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:45.133341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0556d59e-ddb4-4ef8-ad92-aef647d47245 admin admin] The token cache is being invalidate because project 85439cdbe20147f5af7e7b6b8cfd67f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:45.133634 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0556d59e-ddb4-4ef8-ad92-aef647d47245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:45.134357 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0556d59e-ddb4-4ef8-ad92-aef647d47245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:45.136037 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 932/1884] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:44 2022] DELETE /identity/v3/projects/85439cdbe20147f5af7e7b6b8cfd67f8 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:45.140956 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46daea-50a0-40a7-979e-648c6580a5f7 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:45.141245 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46daea-50a0-40a7-979e-648c6580a5f7 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:45.141556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46daea-50a0-40a7-979e-648c6580a5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:45.159878 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-bd46daea-50a0-40a7-979e-648c6580a5f7 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:45.161098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-bd46daea-50a0-40a7-979e-648c6580a5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:45.244705 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 953/1885] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:45.251410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54d5d5-7223-430f-8d11-36069d7cd689 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:45.251649 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54d5d5-7223-430f-8d11-36069d7cd689 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:45.251934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f54d5d5-7223-430f-8d11-36069d7cd689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:45.271781 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-1f54d5d5-7223-430f-8d11-36069d7cd689 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:45.273052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-1f54d5d5-7223-430f-8d11-36069d7cd689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:45.282267 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 933/1886] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:45.286591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46daea-50a0-40a7-979e-648c6580a5f7 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:45.296215 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46daea-50a0-40a7-979e-648c6580a5f7 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:45.301229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73615d6-cc4d-44bf-917c-7c07d3204cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:45.301889 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73615d6-cc4d-44bf-917c-7c07d3204cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:45.302179 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73615d6-cc4d-44bf-917c-7c07d3204cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:45.302459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73615d6-cc4d-44bf-917c-7c07d3204cf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:45.303205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73615d6-cc4d-44bf-917c-7c07d3204cf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:51:45.303706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73615d6-cc4d-44bf-917c-7c07d3204cf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:45.305481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73615d6-cc4d-44bf-917c-7c07d3204cf1 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:45.317802 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 954/1887] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:51:45.322500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54d5d5-7223-430f-8d11-36069d7cd689 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:45.332594 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f54d5d5-7223-430f-8d11-36069d7cd689 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:45.341031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e2d14-ccfa-4516-bda9-42e05bfd2ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:45.341031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e2d14-ccfa-4516-bda9-42e05bfd2ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:45.341345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e2d14-ccfa-4516-bda9-42e05bfd2ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:45.341465 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e2d14-ccfa-4516-bda9-42e05bfd2ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:45.342176 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e2d14-ccfa-4516-bda9-42e05bfd2ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:45.344158 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e2d14-ccfa-4516-bda9-42e05bfd2ad2 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:45.490033 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 934/1888] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:45 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:45.494670 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73615d6-cc4d-44bf-917c-7c07d3204cf1 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:45.522466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73615d6-cc4d-44bf-917c-7c07d3204cf1 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:45.609646 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03c370-8093-4aa7-b8bd-ca8fa86dcea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:45.610478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03c370-8093-4aa7-b8bd-ca8fa86dcea5 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:45.610786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03c370-8093-4aa7-b8bd-ca8fa86dcea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:45.611129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03c370-8093-4aa7-b8bd-ca8fa86dcea5 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:45.611963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03c370-8093-4aa7-b8bd-ca8fa86dcea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:45.614147 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03c370-8093-4aa7-b8bd-ca8fa86dcea5 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:45.686419 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e2d14-ccfa-4516-bda9-42e05bfd2ad2 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:45.688426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-819e2d14-ccfa-4516-bda9-42e05bfd2ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:45.701460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e2d14-ccfa-4516-bda9-42e05bfd2ad2 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:45.706523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87b106-fffe-4a97-9ae2-f24891ca7f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:45.708056 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87b106-fffe-4a97-9ae2-f24891ca7f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:45.708056 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87b106-fffe-4a97-9ae2-f24891ca7f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:45.708056 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87b106-fffe-4a97-9ae2-f24891ca7f6f admin admin] PATH_INFO: `/v3/projects/a5f07ea2be324cec82643e2f60a6e8a2` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:45.710790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87b106-fffe-4a97-9ae2-f24891ca7f6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f07ea2be324cec82643e2f60a6e8a2)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:45.711059 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87b106-fffe-4a97-9ae2-f24891ca7f6f admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:45.746638 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 955/1889] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:45 2022] POST /identity/v3/users => generated 292 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:45.751113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03c370-8093-4aa7-b8bd-ca8fa86dcea5 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:45.762489 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03c370-8093-4aa7-b8bd-ca8fa86dcea5 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:45.767519 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a8bc7-7408-445e-9a87-12c498caadb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:45.768322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a8bc7-7408-445e-9a87-12c498caadb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:45.768720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a8bc7-7408-445e-9a87-12c498caadb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:45.769099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a8bc7-7408-445e-9a87-12c498caadb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:45.769992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a8bc7-7408-445e-9a87-12c498caadb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:45.771716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a8bc7-7408-445e-9a87-12c498caadb7 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:45.782894 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 956/1890] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:45.786794 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a8bc7-7408-445e-9a87-12c498caadb7 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:45.796694 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a8bc7-7408-445e-9a87-12c498caadb7 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:45.801917 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7b81a-898a-4467-9932-6490ee774a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:45.802574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7b81a-898a-4467-9932-6490ee774a7a admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:45.802859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7b81a-898a-4467-9932-6490ee774a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:45.803137 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7b81a-898a-4467-9932-6490ee774a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:45.803890 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7b81a-898a-4467-9932-6490ee774a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:45.805478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7b81a-898a-4467-9932-6490ee774a7a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:45.816497 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 957/1891] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:51:45.820232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7b81a-898a-4467-9932-6490ee774a7a admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:45.831077 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7b81a-898a-4467-9932-6490ee774a7a admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:45.840860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-df87b106-fffe-4a97-9ae2-f24891ca7f6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f07ea2be324cec82643e2f60a6e8a2', 'request_id': 'req-df87b106-fffe-4a97-9ae2-f24891ca7f6f'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:45.890626 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524dc03-c86d-4db7-8278-7bd1df048012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:45.891565 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524dc03-c86d-4db7-8278-7bd1df048012 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:45.891866 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524dc03-c86d-4db7-8278-7bd1df048012 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:45.892144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524dc03-c86d-4db7-8278-7bd1df048012 admin admin] PATH_INFO: `/v3/projects/10d5d157d78f40aaad5ad56143db1339/users/171974d02a28499298ddf77ea0f956ab/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:45.908107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524dc03-c86d-4db7-8278-7bd1df048012 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d5d157d78f40aaad5ad56143db1339, user_id=171974d02a28499298ddf77ea0f956ab, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:45.910815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524dc03-c86d-4db7-8278-7bd1df048012 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:45.930338 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-df87b106-fffe-4a97-9ae2-f24891ca7f6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f07ea2be324cec82643e2f60a6e8a2', 'request_id': 'req-df87b106-fffe-4a97-9ae2-f24891ca7f6f'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:45.940680 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-df87b106-fffe-4a97-9ae2-f24891ca7f6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f07ea2be324cec82643e2f60a6e8a2', 'request_id': 'req-df87b106-fffe-4a97-9ae2-f24891ca7f6f'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:45.954794 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-df87b106-fffe-4a97-9ae2-f24891ca7f6f admin admin] The token cache is being invalidate because project a5f07ea2be324cec82643e2f60a6e8a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:45.955162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-df87b106-fffe-4a97-9ae2-f24891ca7f6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:45.955947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-df87b106-fffe-4a97-9ae2-f24891ca7f6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:45.957768 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 935/1892] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:45 2022] DELETE /identity/v3/projects/a5f07ea2be324cec82643e2f60a6e8a2 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:45.965097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87b106-fffe-4a97-9ae2-f24891ca7f6f admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:45.966514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-df87b106-fffe-4a97-9ae2-f24891ca7f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:45.980856 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87b106-fffe-4a97-9ae2-f24891ca7f6f admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:45.985620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c5303-9776-492e-8c43-df3a1a1941a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:45.986503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c5303-9776-492e-8c43-df3a1a1941a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:45.986788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c5303-9776-492e-8c43-df3a1a1941a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:45.990951 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c5303-9776-492e-8c43-df3a1a1941a8 admin admin] PATH_INFO: `/v3/users/1e11c411de7b4f689451572b72b22207` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:45.990951 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c5303-9776-492e-8c43-df3a1a1941a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e11c411de7b4f689451572b72b22207)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:45.990951 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c5303-9776-492e-8c43-df3a1a1941a8 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:46.035481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 958/1893] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:45 2022] PUT /identity/v3/projects/10d5d157d78f40aaad5ad56143db1339/users/171974d02a28499298ddf77ea0f956ab/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:46.036158 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524dc03-c86d-4db7-8278-7bd1df048012 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:46.039068 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:46.039858 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9524dc03-c86d-4db7-8278-7bd1df048012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:46.135792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524dc03-c86d-4db7-8278-7bd1df048012 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:46.142688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f9b13-1875-4e34-ac0a-43695bf992fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:46.143622 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f9b13-1875-4e34-ac0a-43695bf992fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:46.144091 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f9b13-1875-4e34-ac0a-43695bf992fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:46.144364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f9b13-1875-4e34-ac0a-43695bf992fe admin admin] PATH_INFO: `/v3/users/d1421694966249e9906ec57667e22369` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:46.145921 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f9b13-1875-4e34-ac0a-43695bf992fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1421694966249e9906ec57667e22369)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:46.151235 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f9b13-1875-4e34-ac0a-43695bf992fe admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:46.214392 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-4f7c5303-9776-492e-8c43-df3a1a1941a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e11c411de7b4f689451572b72b22207'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:46.290953 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-4f7c5303-9776-492e-8c43-df3a1a1941a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e11c411de7b4f689451572b72b22207'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:46.306744 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-4f7c5303-9776-492e-8c43-df3a1a1941a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e11c411de7b4f689451572b72b22207'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:46.307788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-4f7c5303-9776-492e-8c43-df3a1a1941a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e11c411de7b4f689451572b72b22207'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:46.332993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-4f7c5303-9776-492e-8c43-df3a1a1941a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e11c411de7b4f689451572b72b22207'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:46.341203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 936/1894] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:45 2022] DELETE /identity/v3/users/1e11c411de7b4f689451572b72b22207 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:46.343195 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49a51c-85c3-4e9a-848a-57bbeeba0ea0 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:46.343801 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49a51c-85c3-4e9a-848a-57bbeeba0ea0 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:46.345161 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df49a51c-85c3-4e9a-848a-57bbeeba0ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:46.385387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-df49a51c-85c3-4e9a-848a-57bbeeba0ea0 None None] MFA Rules not processed for user `171974d02a28499298ddf77ea0f956ab`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:46.387816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-df49a51c-85c3-4e9a-848a-57bbeeba0ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:46.417089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-5b7f9b13-1875-4e34-ac0a-43695bf992fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1421694966249e9906ec57667e22369'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:46.469373 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 937/1895] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:46.474650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49a51c-85c3-4e9a-848a-57bbeeba0ea0 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:46.476275 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-df49a51c-85c3-4e9a-848a-57bbeeba0ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:46.544085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-5b7f9b13-1875-4e34-ac0a-43695bf992fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1421694966249e9906ec57667e22369'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:46.558767 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df49a51c-85c3-4e9a-848a-57bbeeba0ea0 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:46.564387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba71fc-878b-433f-a158-8a89e2a77e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:46.565518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba71fc-878b-433f-a158-8a89e2a77e93 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:46.565518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba71fc-878b-433f-a158-8a89e2a77e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:46.565770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daba71fc-878b-433f-a158-8a89e2a77e93 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:46.566565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba71fc-878b-433f-a158-8a89e2a77e93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:46.568517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daba71fc-878b-433f-a158-8a89e2a77e93 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:46.580010 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-5b7f9b13-1875-4e34-ac0a-43695bf992fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1421694966249e9906ec57667e22369'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:46.589590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-5b7f9b13-1875-4e34-ac0a-43695bf992fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1421694966249e9906ec57667e22369'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:46.590332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-5b7f9b13-1875-4e34-ac0a-43695bf992fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1421694966249e9906ec57667e22369'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:46.596557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 959/1896] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:46 2022] DELETE /identity/v3/users/d1421694966249e9906ec57667e22369 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:46.600980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a7650-0b18-41c9-8dd2-11ae67dd1e74 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:46.601542 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a7650-0b18-41c9-8dd2-11ae67dd1e74 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:46.601652 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a7650-0b18-41c9-8dd2-11ae67dd1e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:46.624153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-802a7650-0b18-41c9-8dd2-11ae67dd1e74 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:46.625364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-802a7650-0b18-41c9-8dd2-11ae67dd1e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:46.691494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 960/1897] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:46.695633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 938/1898] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:46 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:51:46.700362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a7650-0b18-41c9-8dd2-11ae67dd1e74 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:46.702156 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-802a7650-0b18-41c9-8dd2-11ae67dd1e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:46.710639 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba71fc-878b-433f-a158-8a89e2a77e93 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:46.713407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-daba71fc-878b-433f-a158-8a89e2a77e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:46.721818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a7650-0b18-41c9-8dd2-11ae67dd1e74 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:46.785232 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:46.800663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4278b8-0d46-4626-bb9e-35a28736e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:46.800663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4278b8-0d46-4626-bb9e-35a28736e754 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:46.800663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4278b8-0d46-4626-bb9e-35a28736e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:46.800663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4278b8-0d46-4626-bb9e-35a28736e754 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:46.801473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4278b8-0d46-4626-bb9e-35a28736e754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:46.802654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4278b8-0d46-4626-bb9e-35a28736e754 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:46.855860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daba71fc-878b-433f-a158-8a89e2a77e93 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:46.858653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847011ac-e48a-4c43-8526-903552b8a335 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:46.859938 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847011ac-e48a-4c43-8526-903552b8a335 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:46.859938 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847011ac-e48a-4c43-8526-903552b8a335 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:46.860132 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847011ac-e48a-4c43-8526-903552b8a335 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:46.871913 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847011ac-e48a-4c43-8526-903552b8a335 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:46.873652 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847011ac-e48a-4c43-8526-903552b8a335 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:46.888459 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 939/1899] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:51:46.910737 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 961/1900] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:46 2022] POST /identity/v3/users => generated 298 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:46.915558 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847011ac-e48a-4c43-8526-903552b8a335 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:46.927147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847011ac-e48a-4c43-8526-903552b8a335 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:46.932597 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743ce5b-82ba-4b45-89d6-b1c672056a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:46.933443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743ce5b-82ba-4b45-89d6-b1c672056a9e admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:46.934052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743ce5b-82ba-4b45-89d6-b1c672056a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:46.934444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743ce5b-82ba-4b45-89d6-b1c672056a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:46.935405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743ce5b-82ba-4b45-89d6-b1c672056a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:46.937392 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743ce5b-82ba-4b45-89d6-b1c672056a9e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:46.952806 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 940/1901] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:51:46.954206 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4278b8-0d46-4626-bb9e-35a28736e754 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:46.965706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4278b8-0d46-4626-bb9e-35a28736e754 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:46.972647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6c584-3373-4b1f-aab1-75de27911f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:46.974099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6c584-3373-4b1f-aab1-75de27911f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:46.974676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6c584-3373-4b1f-aab1-75de27911f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:46.978369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c6c584-3373-4b1f-aab1-75de27911f90 admin admin] PATH_INFO: `/v3/projects/f6025eace8db479f9d7da328f66f5c11/users/0308ad31c92b446f98128ed1b4028be4/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:47.000170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6c584-3373-4b1f-aab1-75de27911f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6025eace8db479f9d7da328f66f5c11, user_id=0308ad31c92b446f98128ed1b4028be4, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:47.013535 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c6c584-3373-4b1f-aab1-75de27911f90 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:47.132418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 962/1902] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:46 2022] PUT /identity/v3/projects/f6025eace8db479f9d7da328f66f5c11/users/0308ad31c92b446f98128ed1b4028be4/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:47.137374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743ce5b-82ba-4b45-89d6-b1c672056a9e admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:47.156066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743ce5b-82ba-4b45-89d6-b1c672056a9e admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:47.213633 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6c584-3373-4b1f-aab1-75de27911f90 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:47.216364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-08c6c584-3373-4b1f-aab1-75de27911f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:47.315046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf9b22-e21b-40cf-b5e9-4b7bad56bd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:47.315980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9b22-e21b-40cf-b5e9-4b7bad56bd3c admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:47.316797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9b22-e21b-40cf-b5e9-4b7bad56bd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:47.316797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9b22-e21b-40cf-b5e9-4b7bad56bd3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:47.317863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf9b22-e21b-40cf-b5e9-4b7bad56bd3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:47.320291 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf9b22-e21b-40cf-b5e9-4b7bad56bd3c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:47.335588 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 941/1903] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:47.342186 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf9b22-e21b-40cf-b5e9-4b7bad56bd3c admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:47.354432 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf9b22-e21b-40cf-b5e9-4b7bad56bd3c admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:47.362255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db07638b-9d29-4a8b-afce-cb6b163b4591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:47.363550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07638b-9d29-4a8b-afce-cb6b163b4591 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:47.364010 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c6c584-3373-4b1f-aab1-75de27911f90 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:47.364990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07638b-9d29-4a8b-afce-cb6b163b4591 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:47.365324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07638b-9d29-4a8b-afce-cb6b163b4591 admin admin] PATH_INFO: `/v3/projects/f6025eace8db479f9d7da328f66f5c11/users/0308ad31c92b446f98128ed1b4028be4/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:47.368266 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07638b-9d29-4a8b-afce-cb6b163b4591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6025eace8db479f9d7da328f66f5c11, user_id=0308ad31c92b446f98128ed1b4028be4, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:47.369645 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e57ed-19ad-44c3-bc80-ae2a14429b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:47.371281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e57ed-19ad-44c3-bc80-ae2a14429b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:47.371743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e57ed-19ad-44c3-bc80-ae2a14429b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:47.372657 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e57ed-19ad-44c3-bc80-ae2a14429b6a admin admin] PATH_INFO: `/v3/projects/8fa6fb054636412bba422028bd0ebf12` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:47.374121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e57ed-19ad-44c3-bc80-ae2a14429b6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fa6fb054636412bba422028bd0ebf12)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:47.374962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db07638b-9d29-4a8b-afce-cb6b163b4591 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:47.377085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e57ed-19ad-44c3-bc80-ae2a14429b6a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:47.400394 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 942/1904] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:47 2022] PUT /identity/v3/projects/f6025eace8db479f9d7da328f66f5c11/users/0308ad31c92b446f98128ed1b4028be4/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:47.422275 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba64ba-9c34-4f25-bd7b-5ff90169925c None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:47.422655 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba64ba-9c34-4f25-bd7b-5ff90169925c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:47.423044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ba64ba-9c34-4f25-bd7b-5ff90169925c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:47.478915 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-d6ba64ba-9c34-4f25-bd7b-5ff90169925c None None] MFA Rules not processed for user `0308ad31c92b446f98128ed1b4028be4`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:47.486102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d6ba64ba-9c34-4f25-bd7b-5ff90169925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:47.570589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-102e57ed-19ad-44c3-bc80-ae2a14429b6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fa6fb054636412bba422028bd0ebf12', 'request_id': 'req-102e57ed-19ad-44c3-bc80-ae2a14429b6a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:47.589916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-102e57ed-19ad-44c3-bc80-ae2a14429b6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fa6fb054636412bba422028bd0ebf12', 'request_id': 'req-102e57ed-19ad-44c3-bc80-ae2a14429b6a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:47.607522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 943/1905] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:47.619048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba64ba-9c34-4f25-bd7b-5ff90169925c None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:47.620617 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d6ba64ba-9c34-4f25-bd7b-5ff90169925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:47.698812 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ba64ba-9c34-4f25-bd7b-5ff90169925c None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:47.703194 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-102e57ed-19ad-44c3-bc80-ae2a14429b6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fa6fb054636412bba422028bd0ebf12', 'request_id': 'req-102e57ed-19ad-44c3-bc80-ae2a14429b6a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:47.717436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-102e57ed-19ad-44c3-bc80-ae2a14429b6a admin admin] The token cache is being invalidate because project 8fa6fb054636412bba422028bd0ebf12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:47.717830 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-102e57ed-19ad-44c3-bc80-ae2a14429b6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:47.718831 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-102e57ed-19ad-44c3-bc80-ae2a14429b6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:47.725852 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 963/1906] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:47 2022] DELETE /identity/v3/projects/8fa6fb054636412bba422028bd0ebf12 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:47.748357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef83889-9ae1-4891-8381-070b79c6f9af None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:47.748357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef83889-9ae1-4891-8381-070b79c6f9af None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:47.748357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef83889-9ae1-4891-8381-070b79c6f9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:47.776081 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc032e5e-cb44-449f-b265-7048c6fde151 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:47.777850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc032e5e-cb44-449f-b265-7048c6fde151 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:47.778288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc032e5e-cb44-449f-b265-7048c6fde151 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:47.778714 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc032e5e-cb44-449f-b265-7048c6fde151 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:47.781072 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-bc032e5e-cb44-449f-b265-7048c6fde151 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:47.782066 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-2ef83889-9ae1-4891-8381-070b79c6f9af None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:47.783280 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2ef83889-9ae1-4891-8381-070b79c6f9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:47.866374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 964/1907] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:47.866374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef83889-9ae1-4891-8381-070b79c6f9af None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:47.866374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2ef83889-9ae1-4891-8381-070b79c6f9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:47.871277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc032e5e-cb44-449f-b265-7048c6fde151 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:47.873055 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc032e5e-cb44-449f-b265-7048c6fde151 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:47.877798 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef83889-9ae1-4891-8381-070b79c6f9af None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:47.883621 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd9192-7f4c-44d1-8c63-b9667d845c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:47.884864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd9192-7f4c-44d1-8c63-b9667d845c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:47.885293 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd9192-7f4c-44d1-8c63-b9667d845c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:47.886619 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 944/1908] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:51:47.888137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f6126-1697-4630-8fad-27065f3bcb88 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:47.888536 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f6126-1697-4630-8fad-27065f3bcb88 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:47.889628 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f6126-1697-4630-8fad-27065f3bcb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:47.912116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd9192-7f4c-44d1-8c63-b9667d845c3d admin admin] PATH_INFO: `/v3/projects/ff939ce00da64845957463f2ce13796e` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:47.913709 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd9192-7f4c-44d1-8c63-b9667d845c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff939ce00da64845957463f2ce13796e)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:47.918321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-995f6126-1697-4630-8fad-27065f3bcb88 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:47.919401 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd9192-7f4c-44d1-8c63-b9667d845c3d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:47.919750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-995f6126-1697-4630-8fad-27065f3bcb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:47.929996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 945/1909] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:47.935596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f6126-1697-4630-8fad-27065f3bcb88 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:47.960005 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f6126-1697-4630-8fad-27065f3bcb88 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:47.968652 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbb067-5fcd-4164-a808-a88e68c47f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:47.969781 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbb067-5fcd-4164-a808-a88e68c47f5f admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:47.970371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbb067-5fcd-4164-a808-a88e68c47f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:47.970994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbb067-5fcd-4164-a808-a88e68c47f5f admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:47.972070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbb067-5fcd-4164-a808-a88e68c47f5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:51:47.972538 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbb067-5fcd-4164-a808-a88e68c47f5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:47.976387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdbb067-5fcd-4164-a808-a88e68c47f5f admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:48.004836 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 946/1910] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:51:48.005962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbb067-5fcd-4164-a808-a88e68c47f5f admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:48.018925 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdbb067-5fcd-4164-a808-a88e68c47f5f admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:48.031088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a0466-2d25-42e9-ad92-fc5b87a4f892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:48.031088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a0466-2d25-42e9-ad92-fc5b87a4f892 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:48.031088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a0466-2d25-42e9-ad92-fc5b87a4f892 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:48.031088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a0466-2d25-42e9-ad92-fc5b87a4f892 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:48.032468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a0466-2d25-42e9-ad92-fc5b87a4f892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:48.032468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a0466-2d25-42e9-ad92-fc5b87a4f892 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:48.287803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-05bd9192-7f4c-44d1-8c63-b9667d845c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff939ce00da64845957463f2ce13796e', 'request_id': 'req-05bd9192-7f4c-44d1-8c63-b9667d845c3d'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:48.294277 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-05bd9192-7f4c-44d1-8c63-b9667d845c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff939ce00da64845957463f2ce13796e', 'request_id': 'req-05bd9192-7f4c-44d1-8c63-b9667d845c3d'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:48.306407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 947/1911] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:48 2022] POST /identity/v3/projects => generated 387 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:51:48.318524 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a0466-2d25-42e9-ad92-fc5b87a4f892 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:48.318524 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-fb7a0466-2d25-42e9-ad92-fc5b87a4f892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:48.385148 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a0466-2d25-42e9-ad92-fc5b87a4f892 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:48.390544 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05224d-386c-4429-8c32-32df95cb9c71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:48.391227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05224d-386c-4429-8c32-32df95cb9c71 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:48.391515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05224d-386c-4429-8c32-32df95cb9c71 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:48.391820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05224d-386c-4429-8c32-32df95cb9c71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:48.393628 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-8d05224d-386c-4429-8c32-32df95cb9c71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:48.459745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05224d-386c-4429-8c32-32df95cb9c71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:48.461190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05224d-386c-4429-8c32-32df95cb9c71 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:48.471034 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 948/1912] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:48.471825 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05224d-386c-4429-8c32-32df95cb9c71 service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:48.538562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05224d-386c-4429-8c32-32df95cb9c71 service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:48.543293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef0527-aaa3-4504-8b9b-566a47d9ff06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:48.543985 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef0527-aaa3-4504-8b9b-566a47d9ff06 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:48.544272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef0527-aaa3-4504-8b9b-566a47d9ff06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:48.544550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef0527-aaa3-4504-8b9b-566a47d9ff06 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:48.545246 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef0527-aaa3-4504-8b9b-566a47d9ff06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:48.547165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef0527-aaa3-4504-8b9b-566a47d9ff06 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:49.393072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-05bd9192-7f4c-44d1-8c63-b9667d845c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff939ce00da64845957463f2ce13796e', 'request_id': 'req-05bd9192-7f4c-44d1-8c63-b9667d845c3d'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:49.416412 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-05bd9192-7f4c-44d1-8c63-b9667d845c3d admin admin] The token cache is being invalidate because project ff939ce00da64845957463f2ce13796e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:49.416547 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 949/1913] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:48 2022] POST /identity/v3/users => generated 294 bytes in 945 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:49.418676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-05bd9192-7f4c-44d1-8c63-b9667d845c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:49.420907 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-05bd9192-7f4c-44d1-8c63-b9667d845c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:49.421947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef0527-aaa3-4504-8b9b-566a47d9ff06 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:49.424193 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 965/1914] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:47 2022] DELETE /identity/v3/projects/ff939ce00da64845957463f2ce13796e => generated 0 bytes in 1563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:49.424330 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-f7ef0527-aaa3-4504-8b9b-566a47d9ff06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:49.429043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd9192-7f4c-44d1-8c63-b9667d845c3d admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:49.430755 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-05bd9192-7f4c-44d1-8c63-b9667d845c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:49.443252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef0527-aaa3-4504-8b9b-566a47d9ff06 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:49.452192 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f4a59-7593-4370-afd9-9310d983332c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:49.453218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f4a59-7593-4370-afd9-9310d983332c admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:49.453218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f4a59-7593-4370-afd9-9310d983332c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:49.453563 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f4a59-7593-4370-afd9-9310d983332c admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:49.454496 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f4a59-7593-4370-afd9-9310d983332c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:49.457386 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f4a59-7593-4370-afd9-9310d983332c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:49.474542 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 950/1915] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:51:49.481558 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f4a59-7593-4370-afd9-9310d983332c admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:49.498918 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f4a59-7593-4370-afd9-9310d983332c admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:49.502971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:49.511675 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8054b4d-e5d6-4cb0-903d-ed196c5933a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:49.511675 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8054b4d-e5d6-4cb0-903d-ed196c5933a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:49.511675 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8054b4d-e5d6-4cb0-903d-ed196c5933a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:49.511675 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8054b4d-e5d6-4cb0-903d-ed196c5933a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:49.512049 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8054b4d-e5d6-4cb0-903d-ed196c5933a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:49.512049 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8054b4d-e5d6-4cb0-903d-ed196c5933a6 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:49.524251 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 951/1916] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:49.528244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8054b4d-e5d6-4cb0-903d-ed196c5933a6 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:49.539470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd9192-7f4c-44d1-8c63-b9667d845c3d admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:49.539641 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8054b4d-e5d6-4cb0-903d-ed196c5933a6 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:49.544646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b773d1-2202-4deb-b8d7-f5893f40354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:49.545274 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535821e7-cdff-4ddd-a84d-cfb4da2693ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:49.545700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b773d1-2202-4deb-b8d7-f5893f40354f admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:49.546111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b773d1-2202-4deb-b8d7-f5893f40354f admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:49.546461 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b773d1-2202-4deb-b8d7-f5893f40354f admin admin] PATH_INFO: `/v3/projects/f2e00ae4336f42ee90fdb2b0e2be5ab2/users/b7c7bd391ca74f6993df69ec4c11b74b/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:49.546873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535821e7-cdff-4ddd-a84d-cfb4da2693ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:49.547317 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535821e7-cdff-4ddd-a84d-cfb4da2693ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:49.547769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535821e7-cdff-4ddd-a84d-cfb4da2693ff admin admin] PATH_INFO: `/v3/users/bb5e10bc72594e71bc85146c7412b393` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:49.549342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535821e7-cdff-4ddd-a84d-cfb4da2693ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb5e10bc72594e71bc85146c7412b393)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:49.551445 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535821e7-cdff-4ddd-a84d-cfb4da2693ff admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:49.564293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b773d1-2202-4deb-b8d7-f5893f40354f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e00ae4336f42ee90fdb2b0e2be5ab2, user_id=b7c7bd391ca74f6993df69ec4c11b74b, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:49.567580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b773d1-2202-4deb-b8d7-f5893f40354f admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:49.660806 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 952/1917] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:49 2022] PUT /identity/v3/projects/f2e00ae4336f42ee90fdb2b0e2be5ab2/users/b7c7bd391ca74f6993df69ec4c11b74b/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:49.672882 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b74984-d777-4816-af3b-07ee342ca1e1 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:49.673176 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b74984-d777-4816-af3b-07ee342ca1e1 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:49.673457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b74984-d777-4816-af3b-07ee342ca1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:49.700156 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-19b74984-d777-4816-af3b-07ee342ca1e1 None None] MFA Rules not processed for user `b7c7bd391ca74f6993df69ec4c11b74b`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:49.701391 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-19b74984-d777-4816-af3b-07ee342ca1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:49.767669 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 953/1918] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:49.772104 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b74984-d777-4816-af3b-07ee342ca1e1 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:49.792364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-535821e7-cdff-4ddd-a84d-cfb4da2693ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb5e10bc72594e71bc85146c7412b393'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:49.842025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b74984-d777-4816-af3b-07ee342ca1e1 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:49.846718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02edab-df10-47c6-9d5a-1b493e80904e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:49.847380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02edab-df10-47c6-9d5a-1b493e80904e admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:49.847701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02edab-df10-47c6-9d5a-1b493e80904e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:49.847980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02edab-df10-47c6-9d5a-1b493e80904e admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:49.849912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02edab-df10-47c6-9d5a-1b493e80904e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:49.851870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02edab-df10-47c6-9d5a-1b493e80904e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:49.884285 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-535821e7-cdff-4ddd-a84d-cfb4da2693ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb5e10bc72594e71bc85146c7412b393'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:49.897520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-535821e7-cdff-4ddd-a84d-cfb4da2693ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb5e10bc72594e71bc85146c7412b393'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:49.905188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-535821e7-cdff-4ddd-a84d-cfb4da2693ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb5e10bc72594e71bc85146c7412b393'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:49.905875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-535821e7-cdff-4ddd-a84d-cfb4da2693ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb5e10bc72594e71bc85146c7412b393'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:49.913904 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 966/1919] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:49 2022] DELETE /identity/v3/users/bb5e10bc72594e71bc85146c7412b393 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:49.914739 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535821e7-cdff-4ddd-a84d-cfb4da2693ff admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:49.916167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:49.916685 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-535821e7-cdff-4ddd-a84d-cfb4da2693ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:49.984340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535821e7-cdff-4ddd-a84d-cfb4da2693ff admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:49.992882 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f00a4b-88db-4e3f-bfab-81fbdf609cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:49.997670 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f00a4b-88db-4e3f-bfab-81fbdf609cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:49.997670 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f00a4b-88db-4e3f-bfab-81fbdf609cee admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:49.997670 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f00a4b-88db-4e3f-bfab-81fbdf609cee admin admin] PATH_INFO: `/v3/users/171974d02a28499298ddf77ea0f956ab` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:49.997963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 954/1920] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:49 2022] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:51:49.998062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f00a4b-88db-4e3f-bfab-81fbdf609cee admin admin] RBAC: Authorizing `identity:delete_user(user_id=171974d02a28499298ddf77ea0f956ab)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:49.998062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f00a4b-88db-4e3f-bfab-81fbdf609cee admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:49.999313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02edab-df10-47c6-9d5a-1b493e80904e admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:50.001190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0e02edab-df10-47c6-9d5a-1b493e80904e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:50.066190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02edab-df10-47c6-9d5a-1b493e80904e admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:50.070871 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbaa5c-ec10-4d42-b39a-c4394661c98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:50.080993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbaa5c-ec10-4d42-b39a-c4394661c98a admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:50.080993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbaa5c-ec10-4d42-b39a-c4394661c98a admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:50.080993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbaa5c-ec10-4d42-b39a-c4394661c98a admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:50.080993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbaa5c-ec10-4d42-b39a-c4394661c98a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:50.080993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbaa5c-ec10-4d42-b39a-c4394661c98a admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:50.250453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 955/1921] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:49 2022] POST /identity/v3/users => generated 299 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:50.253957 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbaa5c-ec10-4d42-b39a-c4394661c98a admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:50.256609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-44f00a4b-88db-4e3f-bfab-81fbdf609cee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '171974d02a28499298ddf77ea0f956ab'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:50.262793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbaa5c-ec10-4d42-b39a-c4394661c98a admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:50.267717 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8cae9-ce49-4d28-b152-60efe45b3800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:50.268326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8cae9-ce49-4d28-b152-60efe45b3800 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:50.268614 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8cae9-ce49-4d28-b152-60efe45b3800 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:50.268892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8cae9-ce49-4d28-b152-60efe45b3800 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:50.269627 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8cae9-ce49-4d28-b152-60efe45b3800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:50.271284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8cae9-ce49-4d28-b152-60efe45b3800 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:50.281384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 956/1922] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:50.285465 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8cae9-ce49-4d28-b152-60efe45b3800 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:50.295115 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8cae9-ce49-4d28-b152-60efe45b3800 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:50.299868 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055f73c-bf4b-47eb-a9e1-00bb60db0e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:50.300716 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f73c-bf4b-47eb-a9e1-00bb60db0e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:50.300995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f73c-bf4b-47eb-a9e1-00bb60db0e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:50.301268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f73c-bf4b-47eb-a9e1-00bb60db0e8d admin admin] PATH_INFO: `/v3/projects/7c2df164b97a4e589ade9bcdb1b0e480/users/07ce3bb21ee0417fa3897e2301cfb343/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:50.316349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055f73c-bf4b-47eb-a9e1-00bb60db0e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c2df164b97a4e589ade9bcdb1b0e480, user_id=07ce3bb21ee0417fa3897e2301cfb343, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:50.319121 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055f73c-bf4b-47eb-a9e1-00bb60db0e8d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:50.337677 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-44f00a4b-88db-4e3f-bfab-81fbdf609cee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '171974d02a28499298ddf77ea0f956ab'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:50.351692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-44f00a4b-88db-4e3f-bfab-81fbdf609cee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '171974d02a28499298ddf77ea0f956ab'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:50.359362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-44f00a4b-88db-4e3f-bfab-81fbdf609cee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '171974d02a28499298ddf77ea0f956ab'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:50.360136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-44f00a4b-88db-4e3f-bfab-81fbdf609cee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '171974d02a28499298ddf77ea0f956ab'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:50.366169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 967/1923] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:49 2022] DELETE /identity/v3/users/171974d02a28499298ddf77ea0f956ab => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:50.369795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f00a4b-88db-4e3f-bfab-81fbdf609cee admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:50.371650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-44f00a4b-88db-4e3f-bfab-81fbdf609cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:50.400946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 957/1924] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:50 2022] PUT /identity/v3/projects/7c2df164b97a4e589ade9bcdb1b0e480/users/07ce3bb21ee0417fa3897e2301cfb343/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:50.404324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2666658-01ca-461e-a846-af72220f9cbf None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:50.404622 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2666658-01ca-461e-a846-af72220f9cbf None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:50.404907 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2666658-01ca-461e-a846-af72220f9cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:50.422324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-a2666658-01ca-461e-a846-af72220f9cbf None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:50.423920 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-a2666658-01ca-461e-a846-af72220f9cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:50.437782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f00a4b-88db-4e3f-bfab-81fbdf609cee admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:50.485539 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 958/1925] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:50.486741 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2666658-01ca-461e-a846-af72220f9cbf None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:50.488096 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-a2666658-01ca-461e-a846-af72220f9cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:50.496791 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a6c12-f602-48e6-8d64-c92781fbb061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:50.497683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a6c12-f602-48e6-8d64-c92781fbb061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:50.497944 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a6c12-f602-48e6-8d64-c92781fbb061 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:50.498215 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a6c12-f602-48e6-8d64-c92781fbb061 admin admin] PATH_INFO: `/v3/projects/ec281e34337b452a95f805138833607d` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:50.499403 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a6c12-f602-48e6-8d64-c92781fbb061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec281e34337b452a95f805138833607d)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:50.500591 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2666658-01ca-461e-a846-af72220f9cbf None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:50.504218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a6c12-f602-48e6-8d64-c92781fbb061 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:50.505304 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b3219-5b1c-4acc-97be-c7582ed94b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:50.505966 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b3219-5b1c-4acc-97be-c7582ed94b25 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:50.506249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b3219-5b1c-4acc-97be-c7582ed94b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:50.506527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b3219-5b1c-4acc-97be-c7582ed94b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:50.507260 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b3219-5b1c-4acc-97be-c7582ed94b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:50.508890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b3219-5b1c-4acc-97be-c7582ed94b25 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:50.519396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 959/1926] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:50.520051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b3219-5b1c-4acc-97be-c7582ed94b25 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:50.521716 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c63b3219-5b1c-4acc-97be-c7582ed94b25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:50.578131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b3219-5b1c-4acc-97be-c7582ed94b25 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:50.581880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d3d90-3450-4fff-ae68-3a3a8aaf9ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:50.582527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d3d90-3450-4fff-ae68-3a3a8aaf9ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:50.582814 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d3d90-3450-4fff-ae68-3a3a8aaf9ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:50.583097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d3d90-3450-4fff-ae68-3a3a8aaf9ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:50.592043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d3d90-3450-4fff-ae68-3a3a8aaf9ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:50.593479 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d3d90-3450-4fff-ae68-3a3a8aaf9ce8 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:50.603072 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 960/1927] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:50.603874 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d3d90-3450-4fff-ae68-3a3a8aaf9ce8 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:50.613793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d3d90-3450-4fff-ae68-3a3a8aaf9ce8 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:50.626878 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-966a6c12-f602-48e6-8d64-c92781fbb061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec281e34337b452a95f805138833607d', 'request_id': 'req-966a6c12-f602-48e6-8d64-c92781fbb061'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:50.634364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-966a6c12-f602-48e6-8d64-c92781fbb061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec281e34337b452a95f805138833607d', 'request_id': 'req-966a6c12-f602-48e6-8d64-c92781fbb061'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:50.676038 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8321c3-761c-4cec-80b4-205b5fba8a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:50.678071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8321c3-761c-4cec-80b4-205b5fba8a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:50.678367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8321c3-761c-4cec-80b4-205b5fba8a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:50.678680 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8321c3-761c-4cec-80b4-205b5fba8a24 admin admin] PATH_INFO: `/v3/projects/7c2df164b97a4e589ade9bcdb1b0e480/users/07ce3bb21ee0417fa3897e2301cfb343/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:50.680840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8321c3-761c-4cec-80b4-205b5fba8a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c2df164b97a4e589ade9bcdb1b0e480, user_id=07ce3bb21ee0417fa3897e2301cfb343, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:50.684362 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8321c3-761c-4cec-80b4-205b5fba8a24 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:50.695163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 961/1928] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:50 2022] PUT /identity/v3/projects/7c2df164b97a4e589ade9bcdb1b0e480/users/07ce3bb21ee0417fa3897e2301cfb343/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:50.705135 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76795f36-1a47-4b69-a6d2-6066825b01ca None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:50.705502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76795f36-1a47-4b69-a6d2-6066825b01ca None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:50.705711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76795f36-1a47-4b69-a6d2-6066825b01ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:50.732936 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-76795f36-1a47-4b69-a6d2-6066825b01ca None None] MFA Rules not processed for user `07ce3bb21ee0417fa3897e2301cfb343`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:50.734162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-76795f36-1a47-4b69-a6d2-6066825b01ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:50.747261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-966a6c12-f602-48e6-8d64-c92781fbb061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec281e34337b452a95f805138833607d', 'request_id': 'req-966a6c12-f602-48e6-8d64-c92781fbb061'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:50.759117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-966a6c12-f602-48e6-8d64-c92781fbb061 admin admin] The token cache is being invalidate because project ec281e34337b452a95f805138833607d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:50.759411 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-966a6c12-f602-48e6-8d64-c92781fbb061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:50.760158 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-966a6c12-f602-48e6-8d64-c92781fbb061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:50.762712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 968/1929] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:50 2022] DELETE /identity/v3/projects/ec281e34337b452a95f805138833607d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:50.767211 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7e7ab-1da7-473e-a7a4-8d9c8e020711 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:50.767521 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7e7ab-1da7-473e-a7a4-8d9c8e020711 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:50.767808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7e7ab-1da7-473e-a7a4-8d9c8e020711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:50.788970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-f7a7e7ab-1da7-473e-a7a4-8d9c8e020711 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:50.790603 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f7a7e7ab-1da7-473e-a7a4-8d9c8e020711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:50.812714 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 962/1930] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:50.829644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76795f36-1a47-4b69-a6d2-6066825b01ca None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:50.831069 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-76795f36-1a47-4b69-a6d2-6066825b01ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:50.853917 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 969/1931] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:50.862169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf7b21-6f38-4d53-8a2e-91c0aa53e60e None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:50.865511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf7b21-6f38-4d53-8a2e-91c0aa53e60e None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:50.865511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf7b21-6f38-4d53-8a2e-91c0aa53e60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:50.881206 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-9adf7b21-6f38-4d53-8a2e-91c0aa53e60e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:50.885559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9adf7b21-6f38-4d53-8a2e-91c0aa53e60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:50.899504 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 970/1932] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:50.901450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76795f36-1a47-4b69-a6d2-6066825b01ca None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:50.903927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf7b21-6f38-4d53-8a2e-91c0aa53e60e None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:50.906594 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831bd8c-977a-4bc8-a5f2-ff41553e4290 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:50.907265 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831bd8c-977a-4bc8-a5f2-ff41553e4290 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:50.907583 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831bd8c-977a-4bc8-a5f2-ff41553e4290 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:50.911299 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831bd8c-977a-4bc8-a5f2-ff41553e4290 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:50.913971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf7b21-6f38-4d53-8a2e-91c0aa53e60e None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:50.919144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831bd8c-977a-4bc8-a5f2-ff41553e4290 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:50.919719 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d40ff-bd0b-48c3-a204-2b52937cb99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:50.920442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d40ff-bd0b-48c3-a204-2b52937cb99a admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:50.920799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d40ff-bd0b-48c3-a204-2b52937cb99a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:50.921016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831bd8c-977a-4bc8-a5f2-ff41553e4290 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:50.921200 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d40ff-bd0b-48c3-a204-2b52937cb99a admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:50.922136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d40ff-bd0b-48c3-a204-2b52937cb99a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:51:50.922522 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d40ff-bd0b-48c3-a204-2b52937cb99a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:50.924357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d40ff-bd0b-48c3-a204-2b52937cb99a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:50.934245 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 963/1933] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:51:50.943280 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 971/1934] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:51:50.949194 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831bd8c-977a-4bc8-a5f2-ff41553e4290 service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:50.964890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831bd8c-977a-4bc8-a5f2-ff41553e4290 service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:50.968611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6c9d0-a641-4388-8bee-b90e5667edf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:50.969268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6c9d0-a641-4388-8bee-b90e5667edf3 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:50.970019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6c9d0-a641-4388-8bee-b90e5667edf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:50.970019 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6c9d0-a641-4388-8bee-b90e5667edf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:50.970517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6c9d0-a641-4388-8bee-b90e5667edf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:50.972466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6c9d0-a641-4388-8bee-b90e5667edf3 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:51.036169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d40ff-bd0b-48c3-a204-2b52937cb99a admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:51.038123 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-664d40ff-bd0b-48c3-a204-2b52937cb99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:51.055830 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d40ff-bd0b-48c3-a204-2b52937cb99a admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:51.057561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5f3ad-1d24-438e-85a8-855301e4595f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:51.058561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5f3ad-1d24-438e-85a8-855301e4595f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:51.058915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5f3ad-1d24-438e-85a8-855301e4595f admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:51.059199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5f3ad-1d24-438e-85a8-855301e4595f admin admin] PATH_INFO: `/v3/users/b7c7bd391ca74f6993df69ec4c11b74b` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:51.060550 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5f3ad-1d24-438e-85a8-855301e4595f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7c7bd391ca74f6993df69ec4c11b74b)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:51.062494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5f3ad-1d24-438e-85a8-855301e4595f admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:51.111897 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 964/1935] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:50 2022] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:51.115762 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6c9d0-a641-4388-8bee-b90e5667edf3 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:51.182618 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6c9d0-a641-4388-8bee-b90e5667edf3 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:51.190776 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f4bf6-314f-4c6d-acdc-de57c5e89c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:51.190776 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f4bf6-314f-4c6d-acdc-de57c5e89c21 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:51.190776 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f4bf6-314f-4c6d-acdc-de57c5e89c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:51.190776 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f4bf6-314f-4c6d-acdc-de57c5e89c21 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:51.191117 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f4bf6-314f-4c6d-acdc-de57c5e89c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:51.192648 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f4bf6-314f-4c6d-acdc-de57c5e89c21 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:51.209943 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:51.280598 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9af5f3ad-1d24-438e-85a8-855301e4595f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7c7bd391ca74f6993df69ec4c11b74b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:51.301341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 965/1936] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:51 2022] POST /identity/v3/users => generated 284 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:51:51.302181 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f4bf6-314f-4c6d-acdc-de57c5e89c21 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:51.303827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-f89f4bf6-314f-4c6d-acdc-de57c5e89c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:51.316518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f4bf6-314f-4c6d-acdc-de57c5e89c21 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:51.321345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e1acb-89b1-4551-a86b-fa1458d938e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:51.322194 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e1acb-89b1-4551-a86b-fa1458d938e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:51.322476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e1acb-89b1-4551-a86b-fa1458d938e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:51.322748 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e1acb-89b1-4551-a86b-fa1458d938e3 admin admin] PATH_INFO: `/v3/projects/10d5d157d78f40aaad5ad56143db1339` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:51.324521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e1acb-89b1-4551-a86b-fa1458d938e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d5d157d78f40aaad5ad56143db1339)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:51.326517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e1acb-89b1-4551-a86b-fa1458d938e3 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:51.365814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9af5f3ad-1d24-438e-85a8-855301e4595f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7c7bd391ca74f6993df69ec4c11b74b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:51.377910 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9af5f3ad-1d24-438e-85a8-855301e4595f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7c7bd391ca74f6993df69ec4c11b74b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:51.384527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9af5f3ad-1d24-438e-85a8-855301e4595f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7c7bd391ca74f6993df69ec4c11b74b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:51.385150 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9af5f3ad-1d24-438e-85a8-855301e4595f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7c7bd391ca74f6993df69ec4c11b74b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:51.391469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 972/1937] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:51 2022] DELETE /identity/v3/users/b7c7bd391ca74f6993df69ec4c11b74b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:51.392253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5f3ad-1d24-438e-85a8-855301e4595f admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:51.393540 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9af5f3ad-1d24-438e-85a8-855301e4595f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:51.434085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:51.440800 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-867e1acb-89b1-4551-a86b-fa1458d938e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d5d157d78f40aaad5ad56143db1339', 'request_id': 'req-867e1acb-89b1-4551-a86b-fa1458d938e3'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:51.458673 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5f3ad-1d24-438e-85a8-855301e4595f admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:51.520160 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d70fbd-3566-4bae-b986-659e44b7c99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:51.520160 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d70fbd-3566-4bae-b986-659e44b7c99a admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:51.520459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d70fbd-3566-4bae-b986-659e44b7c99a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:51.520732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d70fbd-3566-4bae-b986-659e44b7c99a admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:51.521520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d70fbd-3566-4bae-b986-659e44b7c99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:51.523147 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d70fbd-3566-4bae-b986-659e44b7c99a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:51.534364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 973/1938] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:51.535690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb2b10-b31d-49fb-a897-ebd26e4f8ec2 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:51.535983 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb2b10-b31d-49fb-a897-ebd26e4f8ec2 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:51.536259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb2b10-b31d-49fb-a897-ebd26e4f8ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:51.547839 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-867e1acb-89b1-4551-a86b-fa1458d938e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d5d157d78f40aaad5ad56143db1339', 'request_id': 'req-867e1acb-89b1-4551-a86b-fa1458d938e3'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:51.554696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-867e1acb-89b1-4551-a86b-fa1458d938e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d5d157d78f40aaad5ad56143db1339', 'request_id': 'req-867e1acb-89b1-4551-a86b-fa1458d938e3'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:51.555709 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-5dcb2b10-b31d-49fb-a897-ebd26e4f8ec2 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:51.557324 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-5dcb2b10-b31d-49fb-a897-ebd26e4f8ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:51.566492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 974/1939] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:51.567914 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb2b10-b31d-49fb-a897-ebd26e4f8ec2 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:51.569237 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-867e1acb-89b1-4551-a86b-fa1458d938e3 admin admin] The token cache is being invalidate because project 10d5d157d78f40aaad5ad56143db1339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:51.569538 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-867e1acb-89b1-4551-a86b-fa1458d938e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:51.570384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-867e1acb-89b1-4551-a86b-fa1458d938e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:51.573238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 966/1940] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:51 2022] DELETE /identity/v3/projects/10d5d157d78f40aaad5ad56143db1339 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:51.576930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e1acb-89b1-4551-a86b-fa1458d938e3 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:51.578457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-867e1acb-89b1-4551-a86b-fa1458d938e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:51.585176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb2b10-b31d-49fb-a897-ebd26e4f8ec2 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:51.590991 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be067844-c428-4e6c-acf2-534e3a85563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:51.591982 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be067844-c428-4e6c-acf2-534e3a85563a admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:51.592517 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be067844-c428-4e6c-acf2-534e3a85563a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:51.593011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be067844-c428-4e6c-acf2-534e3a85563a admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:51.593836 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e1acb-89b1-4551-a86b-fa1458d938e3 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:51.594339 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be067844-c428-4e6c-acf2-534e3a85563a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:51.596281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be067844-c428-4e6c-acf2-534e3a85563a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:51.599715 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b1a0c-fd25-496f-b8e6-61fabdffb061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:51.600598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b1a0c-fd25-496f-b8e6-61fabdffb061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:51.600882 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b1a0c-fd25-496f-b8e6-61fabdffb061 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:51.601162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b1a0c-fd25-496f-b8e6-61fabdffb061 admin admin] PATH_INFO: `/v3/users/0308ad31c92b446f98128ed1b4028be4` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:51.602744 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b1a0c-fd25-496f-b8e6-61fabdffb061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0308ad31c92b446f98128ed1b4028be4)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:51.604897 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79b1a0c-fd25-496f-b8e6-61fabdffb061 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:51.612521 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 975/1941] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:51.615804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be067844-c428-4e6c-acf2-534e3a85563a admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:51.618656 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-be067844-c428-4e6c-acf2-534e3a85563a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:51.677271 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be067844-c428-4e6c-acf2-534e3a85563a admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:51.680959 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46914a36-9828-44c1-ab41-f7006962a05e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:51.681608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46914a36-9828-44c1-ab41-f7006962a05e service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:51.681897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46914a36-9828-44c1-ab41-f7006962a05e service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:51.682218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46914a36-9828-44c1-ab41-f7006962a05e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:51.684520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-46914a36-9828-44c1-ab41-f7006962a05e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:51.697449 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46914a36-9828-44c1-ab41-f7006962a05e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:51.699811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46914a36-9828-44c1-ab41-f7006962a05e service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:51.709621 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 976/1942] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:51.710421 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46914a36-9828-44c1-ab41-f7006962a05e service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:51.711733 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-46914a36-9828-44c1-ab41-f7006962a05e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:51.724540 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46914a36-9828-44c1-ab41-f7006962a05e service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:51.729678 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e4cc0-588a-4d70-a3d2-cc7f7453b40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:51.730641 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e4cc0-588a-4d70-a3d2-cc7f7453b40b admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:51.730936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e4cc0-588a-4d70-a3d2-cc7f7453b40b admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:51.731212 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e4cc0-588a-4d70-a3d2-cc7f7453b40b admin admin] PATH_INFO: `/v3/projects/0b538687276741a2a22de6b39f9b3e12/users/844dea66716e4abca42db534b6808261/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:51.748117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e4cc0-588a-4d70-a3d2-cc7f7453b40b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b538687276741a2a22de6b39f9b3e12, user_id=844dea66716e4abca42db534b6808261, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:51.750855 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e4cc0-588a-4d70-a3d2-cc7f7453b40b admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:51.801091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-c79b1a0c-fd25-496f-b8e6-61fabdffb061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0308ad31c92b446f98128ed1b4028be4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:51.813521 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 977/1943] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:51 2022] PUT /identity/v3/projects/0b538687276741a2a22de6b39f9b3e12/users/844dea66716e4abca42db534b6808261/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:51.827290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4284d-9f4b-441d-9775-bdced1216501 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:51.827602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4284d-9f4b-441d-9775-bdced1216501 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:51.827887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4284d-9f4b-441d-9775-bdced1216501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:51.872828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-c79b1a0c-fd25-496f-b8e6-61fabdffb061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0308ad31c92b446f98128ed1b4028be4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:51.873085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-e0b4284d-9f4b-441d-9775-bdced1216501 None None] MFA Rules not processed for user `844dea66716e4abca42db534b6808261`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:51.875682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e0b4284d-9f4b-441d-9775-bdced1216501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:51.893367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-c79b1a0c-fd25-496f-b8e6-61fabdffb061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0308ad31c92b446f98128ed1b4028be4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:51.894125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-c79b1a0c-fd25-496f-b8e6-61fabdffb061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0308ad31c92b446f98128ed1b4028be4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:51.902094 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-c79b1a0c-fd25-496f-b8e6-61fabdffb061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0308ad31c92b446f98128ed1b4028be4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:51.909077 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 967/1944] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:51 2022] DELETE /identity/v3/users/0308ad31c92b446f98128ed1b4028be4 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:51.965169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 978/1945] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:51.969475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b1a0c-fd25-496f-b8e6-61fabdffb061 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:51.970972 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c79b1a0c-fd25-496f-b8e6-61fabdffb061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:52.044711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b1a0c-fd25-496f-b8e6-61fabdffb061 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:52.051831 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a368a5-a660-4be0-a750-fd4520e2d90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:52.053083 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a368a5-a660-4be0-a750-fd4520e2d90f admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:52.053276 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a368a5-a660-4be0-a750-fd4520e2d90f admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:52.053601 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a368a5-a660-4be0-a750-fd4520e2d90f admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:52.055373 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a368a5-a660-4be0-a750-fd4520e2d90f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:52.056290 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a368a5-a660-4be0-a750-fd4520e2d90f admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:52.113479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4284d-9f4b-441d-9775-bdced1216501 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:52.121195 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e0b4284d-9f4b-441d-9775-bdced1216501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:52.207215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:52.212048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 968/1946] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:51 2022] POST /identity/v3/projects => generated 367 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:52.215867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a368a5-a660-4be0-a750-fd4520e2d90f admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:52.255605 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4284d-9f4b-441d-9775-bdced1216501 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:52.312676 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a368a5-a660-4be0-a750-fd4520e2d90f admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:52.321424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb392ab-1550-463f-8895-874fdef71237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:52.321778 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb392ab-1550-463f-8895-874fdef71237 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:52.322341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb392ab-1550-463f-8895-874fdef71237 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:52.322648 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb392ab-1550-463f-8895-874fdef71237 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:52.323409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb392ab-1550-463f-8895-874fdef71237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:52.325947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb392ab-1550-463f-8895-874fdef71237 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:52.345162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:52.346915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:52.347316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:52.359613 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b admin admin] PATH_INFO: `/v3/projects/f2e00ae4336f42ee90fdb2b0e2be5ab2` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:52.361896 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2e00ae4336f42ee90fdb2b0e2be5ab2)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:52.364359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:52.416196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 969/1947] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:52 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:51:52.422468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb392ab-1550-463f-8895-874fdef71237 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:52.434681 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb392ab-1550-463f-8895-874fdef71237 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:52.441055 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd21f3-d729-491c-9630-52460de694d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:52.441791 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd21f3-d729-491c-9630-52460de694d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:52.442084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd21f3-d729-491c-9630-52460de694d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:52.442443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd21f3-d729-491c-9630-52460de694d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:52.443213 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd21f3-d729-491c-9630-52460de694d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:52.448726 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd21f3-d729-491c-9630-52460de694d1 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:52.455576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 970/1948] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:51:52.459705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd21f3-d729-491c-9630-52460de694d1 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:52.467481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:52.472758 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd21f3-d729-491c-9630-52460de694d1 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:52.478466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af143e81-d210-4001-9194-74e5fa221ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:52.479360 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af143e81-d210-4001-9194-74e5fa221ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:52.480689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af143e81-d210-4001-9194-74e5fa221ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:52.480689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af143e81-d210-4001-9194-74e5fa221ab0 admin admin] PATH_INFO: `/v3/projects/7f70d13007974910bd3d826efb2afb12/users/bd6e9ccc6c0f44eabb9b0863317ef832/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:52.498179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af143e81-d210-4001-9194-74e5fa221ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f70d13007974910bd3d826efb2afb12, user_id=bd6e9ccc6c0f44eabb9b0863317ef832, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:52.501397 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af143e81-d210-4001-9194-74e5fa221ab0 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:52.518506 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2e00ae4336f42ee90fdb2b0e2be5ab2', 'request_id': 'req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:52.525883 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2e00ae4336f42ee90fdb2b0e2be5ab2', 'request_id': 'req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:52.667128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 971/1949] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:52 2022] PUT /identity/v3/projects/7f70d13007974910bd3d826efb2afb12/users/bd6e9ccc6c0f44eabb9b0863317ef832/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:52.671621 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af143e81-d210-4001-9194-74e5fa221ab0 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:52.685979 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2e00ae4336f42ee90fdb2b0e2be5ab2', 'request_id': 'req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:52.701403 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b admin admin] The token cache is being invalidate because project f2e00ae4336f42ee90fdb2b0e2be5ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:52.701717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:52.702407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:52.706986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 979/1950] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:52 2022] DELETE /identity/v3/projects/f2e00ae4336f42ee90fdb2b0e2be5ab2 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:52.706986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:52.706986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:52.741191 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af143e81-d210-4001-9194-74e5fa221ab0 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:52.746417 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ae5ce-0e78-4d3c-af90-770ed5fb97c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:52.747086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ae5ce-0e78-4d3c-af90-770ed5fb97c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:52.747369 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ae5ce-0e78-4d3c-af90-770ed5fb97c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:52.747710 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332ae5ce-0e78-4d3c-af90-770ed5fb97c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:52.748444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ae5ce-0e78-4d3c-af90-770ed5fb97c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:52.750049 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332ae5ce-0e78-4d3c-af90-770ed5fb97c7 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:52.760946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 972/1951] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:51:52.764967 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ae5ce-0e78-4d3c-af90-770ed5fb97c7 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:52.766788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-332ae5ce-0e78-4d3c-af90-770ed5fb97c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:52.779215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332ae5ce-0e78-4d3c-af90-770ed5fb97c7 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:52.785102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f60386-13aa-4417-bcfc-adb30383d30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:52.786081 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f60386-13aa-4417-bcfc-adb30383d30f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:52.786365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f60386-13aa-4417-bcfc-adb30383d30f admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:52.786641 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f60386-13aa-4417-bcfc-adb30383d30f admin admin] PATH_INFO: `/v3/users/07ce3bb21ee0417fa3897e2301cfb343` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:52.787876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f60386-13aa-4417-bcfc-adb30383d30f admin admin] RBAC: Authorizing `identity:delete_user(user_id=07ce3bb21ee0417fa3897e2301cfb343)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:52.789903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f60386-13aa-4417-bcfc-adb30383d30f admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:52.797080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501ae77f-cb7c-41ee-ab61-c36eabc61a6b admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:52.802047 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b35277-87e0-4466-a906-b88078d7637e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:52.803470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b35277-87e0-4466-a906-b88078d7637e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:52.803470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b35277-87e0-4466-a906-b88078d7637e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:52.803740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b35277-87e0-4466-a906-b88078d7637e admin admin] PATH_INFO: `/v3/projects/f6025eace8db479f9d7da328f66f5c11` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:52.804925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b35277-87e0-4466-a906-b88078d7637e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6025eace8db479f9d7da328f66f5c11)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:52.806877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b35277-87e0-4466-a906-b88078d7637e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:53.047040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-67b35277-87e0-4466-a906-b88078d7637e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6025eace8db479f9d7da328f66f5c11', 'request_id': 'req-67b35277-87e0-4466-a906-b88078d7637e'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:53.048778 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-d1f60386-13aa-4417-bcfc-adb30383d30f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07ce3bb21ee0417fa3897e2301cfb343'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:53.053580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-67b35277-87e0-4466-a906-b88078d7637e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6025eace8db479f9d7da328f66f5c11', 'request_id': 'req-67b35277-87e0-4466-a906-b88078d7637e'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:53.129746 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-d1f60386-13aa-4417-bcfc-adb30383d30f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07ce3bb21ee0417fa3897e2301cfb343'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:53.144175 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-d1f60386-13aa-4417-bcfc-adb30383d30f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07ce3bb21ee0417fa3897e2301cfb343'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:53.144913 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-d1f60386-13aa-4417-bcfc-adb30383d30f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07ce3bb21ee0417fa3897e2301cfb343'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:53.156618 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-d1f60386-13aa-4417-bcfc-adb30383d30f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07ce3bb21ee0417fa3897e2301cfb343'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:53.162711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 973/1952] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:52 2022] DELETE /identity/v3/users/07ce3bb21ee0417fa3897e2301cfb343 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:53.163489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f60386-13aa-4417-bcfc-adb30383d30f admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:53.167446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d1f60386-13aa-4417-bcfc-adb30383d30f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:53.186617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-67b35277-87e0-4466-a906-b88078d7637e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6025eace8db479f9d7da328f66f5c11', 'request_id': 'req-67b35277-87e0-4466-a906-b88078d7637e'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:53.201986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-67b35277-87e0-4466-a906-b88078d7637e admin admin] The token cache is being invalidate because project f6025eace8db479f9d7da328f66f5c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:53.201986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-67b35277-87e0-4466-a906-b88078d7637e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:53.201986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-67b35277-87e0-4466-a906-b88078d7637e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:53.202270 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:53.206835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 980/1953] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:52 2022] DELETE /identity/v3/projects/f6025eace8db479f9d7da328f66f5c11 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:53.209355 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b64365-031e-46cc-b69d-1b463d812b54 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:53.210380 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b64365-031e-46cc-b69d-1b463d812b54 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:53.210740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b64365-031e-46cc-b69d-1b463d812b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:53.234476 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-20b64365-031e-46cc-b69d-1b463d812b54 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:53.235735 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-20b64365-031e-46cc-b69d-1b463d812b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:53.246544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 981/1954] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:53.247610 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f60386-13aa-4417-bcfc-adb30383d30f admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:53.252588 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c792068-7a53-4fff-a6f4-c931e754cfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:53.253732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c792068-7a53-4fff-a6f4-c931e754cfa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:53.254228 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c792068-7a53-4fff-a6f4-c931e754cfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:53.254352 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95284021-36db-47de-8ab0-401f19dc8715 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:53.254627 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95284021-36db-47de-8ab0-401f19dc8715 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:53.254907 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95284021-36db-47de-8ab0-401f19dc8715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:53.255041 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c792068-7a53-4fff-a6f4-c931e754cfa8 admin admin] PATH_INFO: `/v3/projects/7f70d13007974910bd3d826efb2afb12/users/bd6e9ccc6c0f44eabb9b0863317ef832/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:53.257220 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c792068-7a53-4fff-a6f4-c931e754cfa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f70d13007974910bd3d826efb2afb12, user_id=bd6e9ccc6c0f44eabb9b0863317ef832, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:53.260299 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c792068-7a53-4fff-a6f4-c931e754cfa8 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:53.271330 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 974/1955] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:53 2022] PUT /identity/v3/projects/7f70d13007974910bd3d826efb2afb12/users/bd6e9ccc6c0f44eabb9b0863317ef832/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:53.273886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-95284021-36db-47de-8ab0-401f19dc8715 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:53.275092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-95284021-36db-47de-8ab0-401f19dc8715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:53.281956 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6afa2-4c12-4a28-9e7c-ab07e7368667 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:53.282254 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6afa2-4c12-4a28-9e7c-ab07e7368667 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:53.282541 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6afa2-4c12-4a28-9e7c-ab07e7368667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:53.312171 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-ccb6afa2-4c12-4a28-9e7c-ab07e7368667 None None] MFA Rules not processed for user `bd6e9ccc6c0f44eabb9b0863317ef832`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:53.313153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ccb6afa2-4c12-4a28-9e7c-ab07e7368667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:53.339787 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 982/1956] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:53.344533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95284021-36db-47de-8ab0-401f19dc8715 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:53.354424 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95284021-36db-47de-8ab0-401f19dc8715 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:53.361394 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:53.362430 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5a93b-1105-481c-9052-f32910eddb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:53.363176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a93b-1105-481c-9052-f32910eddb91 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:53.363640 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a93b-1105-481c-9052-f32910eddb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:53.364218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a93b-1105-481c-9052-f32910eddb91 admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:53.368439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5a93b-1105-481c-9052-f32910eddb91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:51:53.368439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5a93b-1105-481c-9052-f32910eddb91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:53.368439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5a93b-1105-481c-9052-f32910eddb91 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:53.383476 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 983/1957] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:51:53.390261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5a93b-1105-481c-9052-f32910eddb91 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:53.413271 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 975/1958] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:53 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:53.416339 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5a93b-1105-481c-9052-f32910eddb91 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:53.427476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6afa2-4c12-4a28-9e7c-ab07e7368667 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:53.428885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94561df3-79d0-4613-b505-c0a2b9b8912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:53.429578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ccb6afa2-4c12-4a28-9e7c-ab07e7368667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:53.429685 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94561df3-79d0-4613-b505-c0a2b9b8912a admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:53.429924 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94561df3-79d0-4613-b505-c0a2b9b8912a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:53.430210 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94561df3-79d0-4613-b505-c0a2b9b8912a admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:53.430908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94561df3-79d0-4613-b505-c0a2b9b8912a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:53.433277 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94561df3-79d0-4613-b505-c0a2b9b8912a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:53.575686 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6afa2-4c12-4a28-9e7c-ab07e7368667 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:53.579371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f32d1-7037-4eff-bf69-484420eb5897 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:53.580076 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f32d1-7037-4eff-bf69-484420eb5897 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:53.580364 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f32d1-7037-4eff-bf69-484420eb5897 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:53.580643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f32d1-7037-4eff-bf69-484420eb5897 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:53.590686 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f32d1-7037-4eff-bf69-484420eb5897 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:53.592761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f32d1-7037-4eff-bf69-484420eb5897 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:53.601993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 976/1959] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:53 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:51:53.617414 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 984/1960] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:53 2022] POST /identity/v3/projects => generated 359 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:51:53.622090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f32d1-7037-4eff-bf69-484420eb5897 service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:53.632622 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f32d1-7037-4eff-bf69-484420eb5897 service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:53.673065 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94561df3-79d0-4613-b505-c0a2b9b8912a admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:53.674871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-94561df3-79d0-4613-b505-c0a2b9b8912a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:53.691786 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f8d8c-b277-45ea-8e07-0b878f280c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:53.692980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f8d8c-b277-45ea-8e07-0b878f280c34 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:53.693434 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f8d8c-b277-45ea-8e07-0b878f280c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:53.693878 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f8d8c-b277-45ea-8e07-0b878f280c34 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:53.694807 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f8d8c-b277-45ea-8e07-0b878f280c34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:53.701656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f8d8c-b277-45ea-8e07-0b878f280c34 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:53.760379 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94561df3-79d0-4613-b505-c0a2b9b8912a admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:53.765215 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ce4a0-bc51-46ca-8b5a-004717e48904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:53.766090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ce4a0-bc51-46ca-8b5a-004717e48904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:53.766376 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ce4a0-bc51-46ca-8b5a-004717e48904 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:53.766654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ce4a0-bc51-46ca-8b5a-004717e48904 admin admin] PATH_INFO: `/v3/projects/7c2df164b97a4e589ade9bcdb1b0e480` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:53.767939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ce4a0-bc51-46ca-8b5a-004717e48904 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c2df164b97a4e589ade9bcdb1b0e480)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:53.769877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ce4a0-bc51-46ca-8b5a-004717e48904 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:53.810572 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 977/1961] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:53 2022] POST /identity/v3/users => generated 280 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:51:53.814760 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f8d8c-b277-45ea-8e07-0b878f280c34 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:53.824317 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f8d8c-b277-45ea-8e07-0b878f280c34 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:53.828934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148918e3-ceb1-453d-a0cc-1018a9f0975e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:53.829596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148918e3-ceb1-453d-a0cc-1018a9f0975e admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:53.829881 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148918e3-ceb1-453d-a0cc-1018a9f0975e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:53.830947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148918e3-ceb1-453d-a0cc-1018a9f0975e admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:53.830947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148918e3-ceb1-453d-a0cc-1018a9f0975e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:53.832534 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148918e3-ceb1-453d-a0cc-1018a9f0975e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:53.842810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 978/1962] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:51:53.846374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148918e3-ceb1-453d-a0cc-1018a9f0975e admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:53.859780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148918e3-ceb1-453d-a0cc-1018a9f0975e admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:53.864607 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fc576-8ac9-4fab-99b3-7f29cf93f6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:53.865274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fc576-8ac9-4fab-99b3-7f29cf93f6b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:53.865557 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fc576-8ac9-4fab-99b3-7f29cf93f6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:53.865840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fc576-8ac9-4fab-99b3-7f29cf93f6b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:53.866567 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fc576-8ac9-4fab-99b3-7f29cf93f6b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:53.868192 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50fc576-8ac9-4fab-99b3-7f29cf93f6b2 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:53.878927 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 979/1963] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:51:53.879728 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fc576-8ac9-4fab-99b3-7f29cf93f6b2 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:53.907578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-b01ce4a0-bc51-46ca-8b5a-004717e48904 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c2df164b97a4e589ade9bcdb1b0e480', 'request_id': 'req-b01ce4a0-bc51-46ca-8b5a-004717e48904'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:53.913853 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-b01ce4a0-bc51-46ca-8b5a-004717e48904 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c2df164b97a4e589ade9bcdb1b0e480', 'request_id': 'req-b01ce4a0-bc51-46ca-8b5a-004717e48904'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:53.934277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50fc576-8ac9-4fab-99b3-7f29cf93f6b2 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:53.982016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a868c0-df04-4e05-b521-5a3a8099f6ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:53.982661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a868c0-df04-4e05-b521-5a3a8099f6ca service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:53.982942 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a868c0-df04-4e05-b521-5a3a8099f6ca service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:53.983225 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a868c0-df04-4e05-b521-5a3a8099f6ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:53.985060 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b6a868c0-df04-4e05-b521-5a3a8099f6ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:53.988635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-b01ce4a0-bc51-46ca-8b5a-004717e48904 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c2df164b97a4e589ade9bcdb1b0e480', 'request_id': 'req-b01ce4a0-bc51-46ca-8b5a-004717e48904'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:54.000511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-b01ce4a0-bc51-46ca-8b5a-004717e48904 admin admin] The token cache is being invalidate because project 7c2df164b97a4e589ade9bcdb1b0e480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:54.000799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-b01ce4a0-bc51-46ca-8b5a-004717e48904 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:54.001442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-b01ce4a0-bc51-46ca-8b5a-004717e48904 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:54.002994 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 985/1964] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:53 2022] DELETE /identity/v3/projects/7c2df164b97a4e589ade9bcdb1b0e480 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:54.006472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ce4a0-bc51-46ca-8b5a-004717e48904 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:54.006472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b01ce4a0-bc51-46ca-8b5a-004717e48904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:54.043880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a868c0-df04-4e05-b521-5a3a8099f6ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:54.045370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a868c0-df04-4e05-b521-5a3a8099f6ca service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:54.054570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 980/1965] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:54.055909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c41c5-78ab-47ba-806c-95f65f89fff0 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:54.056194 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c41c5-78ab-47ba-806c-95f65f89fff0 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:54.056476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c41c5-78ab-47ba-806c-95f65f89fff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:54.075616 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ce4a0-bc51-46ca-8b5a-004717e48904 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:54.075739 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-805c41c5-78ab-47ba-806c-95f65f89fff0 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:54.075847 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-805c41c5-78ab-47ba-806c-95f65f89fff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:54.077544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c20b5c-b0ca-4141-9f58-82bf4462c37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:54.078509 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c20b5c-b0ca-4141-9f58-82bf4462c37c admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:54.078865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c20b5c-b0ca-4141-9f58-82bf4462c37c admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:54.079286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c20b5c-b0ca-4141-9f58-82bf4462c37c admin admin] PATH_INFO: `/v3/projects/71c1557819f64c9cbb700d43f8d927b9/users/4ccf9cd313714fe2a53d7c2cb3a2dced/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:54.092488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 981/1966] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:54.094777 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff1701-d176-4a85-8413-f8c5d4b833bd None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:54.095193 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c20b5c-b0ca-4141-9f58-82bf4462c37c admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c1557819f64c9cbb700d43f8d927b9, user_id=4ccf9cd313714fe2a53d7c2cb3a2dced, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:54.095372 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff1701-d176-4a85-8413-f8c5d4b833bd None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:54.095749 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff1701-d176-4a85-8413-f8c5d4b833bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:54.097902 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c20b5c-b0ca-4141-9f58-82bf4462c37c admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:54.116491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-e3ff1701-d176-4a85-8413-f8c5d4b833bd None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:54.117773 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e3ff1701-d176-4a85-8413-f8c5d4b833bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:54.125819 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 982/1967] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:54.130422 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff1701-d176-4a85-8413-f8c5d4b833bd None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:54.140356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff1701-d176-4a85-8413-f8c5d4b833bd None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:54.145081 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf26e6-59e1-4bac-9e5f-06d60f16bd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:54.145716 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf26e6-59e1-4bac-9e5f-06d60f16bd2a admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:54.146000 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf26e6-59e1-4bac-9e5f-06d60f16bd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:54.146277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf26e6-59e1-4bac-9e5f-06d60f16bd2a admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:54.147077 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf26e6-59e1-4bac-9e5f-06d60f16bd2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:51:54.147388 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf26e6-59e1-4bac-9e5f-06d60f16bd2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:54.149028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf26e6-59e1-4bac-9e5f-06d60f16bd2a admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:54.161078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 983/1968] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:51:54.165439 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf26e6-59e1-4bac-9e5f-06d60f16bd2a admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:54.175100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf26e6-59e1-4bac-9e5f-06d60f16bd2a admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:54.183053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 986/1969] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:54 2022] PUT /identity/v3/projects/71c1557819f64c9cbb700d43f8d927b9/users/4ccf9cd313714fe2a53d7c2cb3a2dced/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:54.194617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f4f7-970a-4a19-b091-19f106559307 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:54.194905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f4f7-970a-4a19-b091-19f106559307 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:54.195185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f4f7-970a-4a19-b091-19f106559307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:54.223736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-2d63f4f7-970a-4a19-b091-19f106559307 None None] MFA Rules not processed for user `4ccf9cd313714fe2a53d7c2cb3a2dced`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:54.224966 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2d63f4f7-970a-4a19-b091-19f106559307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:54.235649 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385ac97-660a-4b69-bbde-b680e36dfcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:54.236318 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385ac97-660a-4b69-bbde-b680e36dfcb7 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:54.236653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385ac97-660a-4b69-bbde-b680e36dfcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:54.236979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385ac97-660a-4b69-bbde-b680e36dfcb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:54.237681 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385ac97-660a-4b69-bbde-b680e36dfcb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:54.239631 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385ac97-660a-4b69-bbde-b680e36dfcb7 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:54.306834 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 987/1970] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:54 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:54.331783 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 984/1971] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:54 2022] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:51:54.336116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63f4f7-970a-4a19-b091-19f106559307 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:54.347207 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63f4f7-970a-4a19-b091-19f106559307 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:54.389634 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385ac97-660a-4b69-bbde-b680e36dfcb7 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:54.399276 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0385ac97-660a-4b69-bbde-b680e36dfcb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:54.420750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485af40f-b03f-4c29-8fb0-76eb6a260916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:54.421427 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485af40f-b03f-4c29-8fb0-76eb6a260916 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:54.421727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485af40f-b03f-4c29-8fb0-76eb6a260916 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:54.425228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485af40f-b03f-4c29-8fb0-76eb6a260916 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:54.425228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485af40f-b03f-4c29-8fb0-76eb6a260916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:54.425228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485af40f-b03f-4c29-8fb0-76eb6a260916 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:54.444386 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:54.453946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385ac97-660a-4b69-bbde-b680e36dfcb7 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:54.457634 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03139169-8903-48d2-b377-a41d93e94caf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:54.458294 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03139169-8903-48d2-b377-a41d93e94caf service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:54.458563 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03139169-8903-48d2-b377-a41d93e94caf service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:54.458863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03139169-8903-48d2-b377-a41d93e94caf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:54.516374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03139169-8903-48d2-b377-a41d93e94caf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:54.517970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03139169-8903-48d2-b377-a41d93e94caf service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:54.526162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 988/1972] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:54 2022] POST /identity/v3/users => generated 288 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:54.528084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 985/1973] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:54 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:51:54.531176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485af40f-b03f-4c29-8fb0-76eb6a260916 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:54.542073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03139169-8903-48d2-b377-a41d93e94caf service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:54.545172 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485af40f-b03f-4c29-8fb0-76eb6a260916 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:54.553522 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad78f1-da22-4cad-8fdd-03c94c0e0c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:54.553740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03139169-8903-48d2-b377-a41d93e94caf service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:54.554281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad78f1-da22-4cad-8fdd-03c94c0e0c46 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:54.558264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad78f1-da22-4cad-8fdd-03c94c0e0c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:54.558264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad78f1-da22-4cad-8fdd-03c94c0e0c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:54.558264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad78f1-da22-4cad-8fdd-03c94c0e0c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:54.558264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad78f1-da22-4cad-8fdd-03c94c0e0c46 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:54.560345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44471f56-81c0-4b4a-b60a-995064b8af4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:54.561299 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44471f56-81c0-4b4a-b60a-995064b8af4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:54.561662 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44471f56-81c0-4b4a-b60a-995064b8af4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:54.562025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44471f56-81c0-4b4a-b60a-995064b8af4d admin admin] PATH_INFO: `/v3/users/4ccf9cd313714fe2a53d7c2cb3a2dced` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:54.563330 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44471f56-81c0-4b4a-b60a-995064b8af4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ccf9cd313714fe2a53d7c2cb3a2dced)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:54.565520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44471f56-81c0-4b4a-b60a-995064b8af4d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:54.582149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 989/1974] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:54.586841 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad78f1-da22-4cad-8fdd-03c94c0e0c46 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:54.608512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad78f1-da22-4cad-8fdd-03c94c0e0c46 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:54.614498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caf054-5a7f-48e3-8ebb-17b05968b922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:54.615352 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caf054-5a7f-48e3-8ebb-17b05968b922 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:54.615750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caf054-5a7f-48e3-8ebb-17b05968b922 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:54.620817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96caf054-5a7f-48e3-8ebb-17b05968b922 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:54.620817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96caf054-5a7f-48e3-8ebb-17b05968b922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:54.620817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96caf054-5a7f-48e3-8ebb-17b05968b922 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:54.630874 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 990/1975] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:54.634802 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caf054-5a7f-48e3-8ebb-17b05968b922 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:54.645394 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96caf054-5a7f-48e3-8ebb-17b05968b922 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:54.650273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de2173-fb6f-41d2-93ad-63f8aae4169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:54.651224 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de2173-fb6f-41d2-93ad-63f8aae4169d admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:54.651561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de2173-fb6f-41d2-93ad-63f8aae4169d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:54.651843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de2173-fb6f-41d2-93ad-63f8aae4169d admin admin] PATH_INFO: `/v3/projects/514c3502f40b42368ef1e397c56bcd4d/users/dcaa086117ce410dbe36f9a1131331b6/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:54.666470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de2173-fb6f-41d2-93ad-63f8aae4169d admin admin] RBAC: Authorizing `identity:create_grant(project_id=514c3502f40b42368ef1e397c56bcd4d, user_id=dcaa086117ce410dbe36f9a1131331b6, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:54.669198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de2173-fb6f-41d2-93ad-63f8aae4169d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:54.780234 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-44471f56-81c0-4b4a-b60a-995064b8af4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ccf9cd313714fe2a53d7c2cb3a2dced'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:54.802485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=77,keystone:DELETE=19,keystone:INSERT=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:54.819189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 991/1976] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:54 2022] PUT /identity/v3/projects/514c3502f40b42368ef1e397c56bcd4d/users/dcaa086117ce410dbe36f9a1131331b6/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:51:54.822563 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d02231-a99d-4a90-8358-7be010386dca None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:54.822918 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d02231-a99d-4a90-8358-7be010386dca None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:54.823261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d02231-a99d-4a90-8358-7be010386dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:54.853038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-86d02231-a99d-4a90-8358-7be010386dca None None] MFA Rules not processed for user `dcaa086117ce410dbe36f9a1131331b6`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:54.854352 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-86d02231-a99d-4a90-8358-7be010386dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:54.896985 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-44471f56-81c0-4b4a-b60a-995064b8af4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ccf9cd313714fe2a53d7c2cb3a2dced'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:54.909782 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-44471f56-81c0-4b4a-b60a-995064b8af4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ccf9cd313714fe2a53d7c2cb3a2dced'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:54.910447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-44471f56-81c0-4b4a-b60a-995064b8af4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ccf9cd313714fe2a53d7c2cb3a2dced'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:54.917722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-44471f56-81c0-4b4a-b60a-995064b8af4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ccf9cd313714fe2a53d7c2cb3a2dced'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:54.924059 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 986/1977] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:51:54 2022] DELETE /identity/v3/users/4ccf9cd313714fe2a53d7c2cb3a2dced => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:54.931608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 992/1978] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:54.931767 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c97cd-e0f3-477c-8078-ae53cb855b79 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:54.931767 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c97cd-e0f3-477c-8078-ae53cb855b79 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:54.931767 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c97cd-e0f3-477c-8078-ae53cb855b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:54.939391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d02231-a99d-4a90-8358-7be010386dca None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:54.940809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-86d02231-a99d-4a90-8358-7be010386dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:54.948178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-3f9c97cd-e0f3-477c-8078-ae53cb855b79 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:54.949459 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3f9c97cd-e0f3-477c-8078-ae53cb855b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:54.999929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d02231-a99d-4a90-8358-7be010386dca None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:55.011962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 987/1979] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:55.022107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c97cd-e0f3-477c-8078-ae53cb855b79 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:55.023113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3f9c97cd-e0f3-477c-8078-ae53cb855b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:55.053392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a42e31-c966-44f5-92b9-0f436e77e374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:55.054046 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a42e31-c966-44f5-92b9-0f436e77e374 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:55.054334 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a42e31-c966-44f5-92b9-0f436e77e374 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:55.054616 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a42e31-c966-44f5-92b9-0f436e77e374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:55.079837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c97cd-e0f3-477c-8078-ae53cb855b79 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:55.083623 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbb9ae-87f8-4c9e-9f2b-b5fa91631b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:55.084269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbb9ae-87f8-4c9e-9f2b-b5fa91631b16 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:55.084558 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbb9ae-87f8-4c9e-9f2b-b5fa91631b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:55.084840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbb9ae-87f8-4c9e-9f2b-b5fa91631b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:55.093989 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbb9ae-87f8-4c9e-9f2b-b5fa91631b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:55.095431 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbb9ae-87f8-4c9e-9f2b-b5fa91631b16 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:55.105841 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 988/1980] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:51:55.111201 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a42e31-c966-44f5-92b9-0f436e77e374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:55.112994 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a42e31-c966-44f5-92b9-0f436e77e374 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:55.122767 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 993/1981] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:51:55.508780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbb9ae-87f8-4c9e-9f2b-b5fa91631b16 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:55.510274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-96dbb9ae-87f8-4c9e-9f2b-b5fa91631b16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:55.527271 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbb9ae-87f8-4c9e-9f2b-b5fa91631b16 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:55.532491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e1fb9-fad7-4f0c-95b1-0632b6effd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:55.533406 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e1fb9-fad7-4f0c-95b1-0632b6effd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:55.533662 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e1fb9-fad7-4f0c-95b1-0632b6effd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:55.533939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e1fb9-fad7-4f0c-95b1-0632b6effd46 admin admin] PATH_INFO: `/v3/projects/71c1557819f64c9cbb700d43f8d927b9` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:55.535162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e1fb9-fad7-4f0c-95b1-0632b6effd46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c1557819f64c9cbb700d43f8d927b9)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:55.540045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e1fb9-fad7-4f0c-95b1-0632b6effd46 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:55.641363 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2b2e1fb9-fad7-4f0c-95b1-0632b6effd46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c1557819f64c9cbb700d43f8d927b9', 'request_id': 'req-2b2e1fb9-fad7-4f0c-95b1-0632b6effd46'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:55.712627 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2b2e1fb9-fad7-4f0c-95b1-0632b6effd46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c1557819f64c9cbb700d43f8d927b9', 'request_id': 'req-2b2e1fb9-fad7-4f0c-95b1-0632b6effd46'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:55.719161 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2b2e1fb9-fad7-4f0c-95b1-0632b6effd46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c1557819f64c9cbb700d43f8d927b9', 'request_id': 'req-2b2e1fb9-fad7-4f0c-95b1-0632b6effd46'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:55.730582 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2b2e1fb9-fad7-4f0c-95b1-0632b6effd46 admin admin] The token cache is being invalidate because project 71c1557819f64c9cbb700d43f8d927b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:51:55.730874 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2b2e1fb9-fad7-4f0c-95b1-0632b6effd46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:55.731643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2b2e1fb9-fad7-4f0c-95b1-0632b6effd46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:51:55.733201 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 989/1982] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:51:55 2022] DELETE /identity/v3/projects/71c1557819f64c9cbb700d43f8d927b9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:55.738196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddcd7f-c190-452c-b155-addcf7d1beb8 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:55.738657 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddcd7f-c190-452c-b155-addcf7d1beb8 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:55.738745 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ddcd7f-c190-452c-b155-addcf7d1beb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:55.756509 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-15ddcd7f-c190-452c-b155-addcf7d1beb8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:55.757707 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-15ddcd7f-c190-452c-b155-addcf7d1beb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:55.820273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 994/1983] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:55.829274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c4fe4-2f46-4c48-83fb-064ccc74deb7 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:55.829772 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c4fe4-2f46-4c48-83fb-064ccc74deb7 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:55.830074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c4fe4-2f46-4c48-83fb-064ccc74deb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:55.850977 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-ff6c4fe4-2f46-4c48-83fb-064ccc74deb7 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:55.852761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ff6c4fe4-2f46-4c48-83fb-064ccc74deb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:55.856198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:55.872067 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 990/1984] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:51:55.877096 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddcd7f-c190-452c-b155-addcf7d1beb8 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:55.889644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ddcd7f-c190-452c-b155-addcf7d1beb8 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:55.894816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cca9ce-84ea-4c0e-bfef-a0bab60f66e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:55.895551 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca9ce-84ea-4c0e-bfef-a0bab60f66e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:55.895819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca9ce-84ea-4c0e-bfef-a0bab60f66e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:55.896156 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cca9ce-84ea-4c0e-bfef-a0bab60f66e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:55.897064 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cca9ce-84ea-4c0e-bfef-a0bab60f66e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:51:55.897377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cca9ce-84ea-4c0e-bfef-a0bab60f66e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:55.912081 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cca9ce-84ea-4c0e-bfef-a0bab60f66e9 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:55.940995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 995/1985] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:51:55.945302 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c4fe4-2f46-4c48-83fb-064ccc74deb7 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:55.957426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c4fe4-2f46-4c48-83fb-064ccc74deb7 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:55.974605 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642c967-85d5-407d-983f-bd1a1228ae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:55.979266 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642c967-85d5-407d-983f-bd1a1228ae8d admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:55.979266 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642c967-85d5-407d-983f-bd1a1228ae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:55.979266 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2642c967-85d5-407d-983f-bd1a1228ae8d admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:55.979266 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642c967-85d5-407d-983f-bd1a1228ae8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:55.983543 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2642c967-85d5-407d-983f-bd1a1228ae8d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:56.165356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 991/1986] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:51:55 2022] POST /identity/v3/projects => generated 365 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:56.169647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cca9ce-84ea-4c0e-bfef-a0bab60f66e9 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:56.180050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cca9ce-84ea-4c0e-bfef-a0bab60f66e9 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:56.242874 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708417da-3838-4cc1-8d07-358d4f4c5f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:56.243712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708417da-3838-4cc1-8d07-358d4f4c5f6e admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:56.244001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708417da-3838-4cc1-8d07-358d4f4c5f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:56.244396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708417da-3838-4cc1-8d07-358d4f4c5f6e admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:56.245074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708417da-3838-4cc1-8d07-358d4f4c5f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:56.247572 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708417da-3838-4cc1-8d07-358d4f4c5f6e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:56.381904 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 996/1987] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:51:56 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:51:56.386790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642c967-85d5-407d-983f-bd1a1228ae8d admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:56.397006 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2642c967-85d5-407d-983f-bd1a1228ae8d admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:56.402428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cec03-0c36-4ed7-be28-a7e32dec1a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:56.403218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cec03-0c36-4ed7-be28-a7e32dec1a3d admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:56.403599 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cec03-0c36-4ed7-be28-a7e32dec1a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:56.403946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5cec03-0c36-4ed7-be28-a7e32dec1a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:56.404747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cec03-0c36-4ed7-be28-a7e32dec1a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:56.406409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5cec03-0c36-4ed7-be28-a7e32dec1a3d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:56.418167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 992/1988] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:56.422025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708417da-3838-4cc1-8d07-358d4f4c5f6e admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:56.432486 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708417da-3838-4cc1-8d07-358d4f4c5f6e admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:56.438229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481294f0-197c-4114-a2c1-68c96591ff78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:56.438900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481294f0-197c-4114-a2c1-68c96591ff78 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:56.439305 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481294f0-197c-4114-a2c1-68c96591ff78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:56.439682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481294f0-197c-4114-a2c1-68c96591ff78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:56.440467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481294f0-197c-4114-a2c1-68c96591ff78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:56.442020 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481294f0-197c-4114-a2c1-68c96591ff78 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:56.454153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 997/1989] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:51:56.458445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cec03-0c36-4ed7-be28-a7e32dec1a3d admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:56.469414 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5cec03-0c36-4ed7-be28-a7e32dec1a3d admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:56.475640 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaee50-e0a4-46f4-a685-9f054b297619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:56.477315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaee50-e0a4-46f4-a685-9f054b297619 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:56.477315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaee50-e0a4-46f4-a685-9f054b297619 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:56.480308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deaee50-e0a4-46f4-a685-9f054b297619 admin admin] PATH_INFO: `/v3/projects/f5679a66726a4b0ba50b3eece536aa30/users/dbb2720aa2f449dcb8dc7f84cceb0f83/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:56.499672 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deaee50-e0a4-46f4-a685-9f054b297619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5679a66726a4b0ba50b3eece536aa30, user_id=dbb2720aa2f449dcb8dc7f84cceb0f83, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:56.502825 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deaee50-e0a4-46f4-a685-9f054b297619 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:56.629372 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 993/1990] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:51:56 2022] PUT /identity/v3/projects/f5679a66726a4b0ba50b3eece536aa30/users/dbb2720aa2f449dcb8dc7f84cceb0f83/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:51:56.640108 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda80a1-bb32-44b8-a829-ce77259f5632 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:56.640306 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda80a1-bb32-44b8-a829-ce77259f5632 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:56.640580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda80a1-bb32-44b8-a829-ce77259f5632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:56.670130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-cdda80a1-bb32-44b8-a829-ce77259f5632 None None] MFA Rules not processed for user `dbb2720aa2f449dcb8dc7f84cceb0f83`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:51:56.671376 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-cdda80a1-bb32-44b8-a829-ce77259f5632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:56.741322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 998/1991] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:51:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:51:56.754919 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:56.756306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaee50-e0a4-46f4-a685-9f054b297619 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:51:56.758240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-4deaee50-e0a4-46f4-a685-9f054b297619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:51:56.817949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deaee50-e0a4-46f4-a685-9f054b297619 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:51:56.822958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a73f00-6e7a-4aad-a42a-90085eacf2b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:51:56.823645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a73f00-6e7a-4aad-a42a-90085eacf2b5 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:51:56.823932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a73f00-6e7a-4aad-a42a-90085eacf2b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:51:56.824215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a73f00-6e7a-4aad-a42a-90085eacf2b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:51:56.832942 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a73f00-6e7a-4aad-a42a-90085eacf2b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:51:56.834402 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a73f00-6e7a-4aad-a42a-90085eacf2b5 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:51:56.844876 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 994/1992] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:51:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:51:57.172110 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:58.229911 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:58.411499 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:59.429427 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:51:59.639025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:00.356736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda80a1-bb32-44b8-a829-ce77259f5632 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:00.358374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-cdda80a1-bb32-44b8-a829-ce77259f5632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:00.365866 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:00.424275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda80a1-bb32-44b8-a829-ce77259f5632 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:00.428949 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f049ec-4eb9-4450-a650-0d1eb4086706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:00.429811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f049ec-4eb9-4450-a650-0d1eb4086706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:00.430090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f049ec-4eb9-4450-a650-0d1eb4086706 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:00.430361 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f049ec-4eb9-4450-a650-0d1eb4086706 admin admin] PATH_INFO: `/v3/users/98c0d19387594287b31a8976870b53a6` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:00.431635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f049ec-4eb9-4450-a650-0d1eb4086706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c0d19387594287b31a8976870b53a6)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:00.433617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f049ec-4eb9-4450-a650-0d1eb4086706 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:00.653344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e4f049ec-4eb9-4450-a650-0d1eb4086706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c0d19387594287b31a8976870b53a6'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:00.764487 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e4f049ec-4eb9-4450-a650-0d1eb4086706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c0d19387594287b31a8976870b53a6'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:00.773683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e4f049ec-4eb9-4450-a650-0d1eb4086706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c0d19387594287b31a8976870b53a6'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:00.781580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e4f049ec-4eb9-4450-a650-0d1eb4086706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c0d19387594287b31a8976870b53a6'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:00.787797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e4f049ec-4eb9-4450-a650-0d1eb4086706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c0d19387594287b31a8976870b53a6'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:00.789452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 999/1993] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:52:00 2022] DELETE /identity/v3/users/98c0d19387594287b31a8976870b53a6 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:01.069977 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a73f00-6e7a-4aad-a42a-90085eacf2b5 service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:01.082499 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a73f00-6e7a-4aad-a42a-90085eacf2b5 service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:01.148324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08a9dc-422b-49f3-b4e0-8045cbef7edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:01.149210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08a9dc-422b-49f3-b4e0-8045cbef7edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:01.149493 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08a9dc-422b-49f3-b4e0-8045cbef7edb admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:01.149770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08a9dc-422b-49f3-b4e0-8045cbef7edb admin admin] PATH_INFO: `/v3/projects/3f3cbfa562e2469298db2c1f810d767b` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:01.150941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08a9dc-422b-49f3-b4e0-8045cbef7edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3cbfa562e2469298db2c1f810d767b)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:01.152946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08a9dc-422b-49f3-b4e0-8045cbef7edb admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:01.263249 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:01.274322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-cd08a9dc-422b-49f3-b4e0-8045cbef7edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3cbfa562e2469298db2c1f810d767b', 'request_id': 'req-cd08a9dc-422b-49f3-b4e0-8045cbef7edb'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:01.357858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-cd08a9dc-422b-49f3-b4e0-8045cbef7edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3cbfa562e2469298db2c1f810d767b', 'request_id': 'req-cd08a9dc-422b-49f3-b4e0-8045cbef7edb'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:01.363919 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-cd08a9dc-422b-49f3-b4e0-8045cbef7edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3cbfa562e2469298db2c1f810d767b', 'request_id': 'req-cd08a9dc-422b-49f3-b4e0-8045cbef7edb'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:01.375038 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-cd08a9dc-422b-49f3-b4e0-8045cbef7edb admin admin] The token cache is being invalidate because project 3f3cbfa562e2469298db2c1f810d767b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:52:01.375325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-cd08a9dc-422b-49f3-b4e0-8045cbef7edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:01.375991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-cd08a9dc-422b-49f3-b4e0-8045cbef7edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:01.377533 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 995/1994] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:52:01 2022] DELETE /identity/v3/projects/3f3cbfa562e2469298db2c1f810d767b => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:01.382369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c91f7e-8a6e-4874-9f56-6c2516137d62 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:01.382753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c91f7e-8a6e-4874-9f56-6c2516137d62 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:01.383132 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c91f7e-8a6e-4874-9f56-6c2516137d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:01.401958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-95c91f7e-8a6e-4874-9f56-6c2516137d62 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:01.403174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-95c91f7e-8a6e-4874-9f56-6c2516137d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:01.461431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1000/1995] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:01.469915 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977d867-e40d-4303-a38e-991637a83d81 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:01.470478 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977d867-e40d-4303-a38e-991637a83d81 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:01.470992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977d867-e40d-4303-a38e-991637a83d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:01.494422 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-b977d867-e40d-4303-a38e-991637a83d81 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:01.496076 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b977d867-e40d-4303-a38e-991637a83d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:01.505514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 996/1996] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:01.512304 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c91f7e-8a6e-4874-9f56-6c2516137d62 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:01.519875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c91f7e-8a6e-4874-9f56-6c2516137d62 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:01.531973 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d745f-cd49-44eb-bc2d-7c332775e430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:01.533500 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d745f-cd49-44eb-bc2d-7c332775e430 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:01.533927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d745f-cd49-44eb-bc2d-7c332775e430 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:01.534368 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d745f-cd49-44eb-bc2d-7c332775e430 admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:01.535262 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d745f-cd49-44eb-bc2d-7c332775e430 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:52:01.535751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d745f-cd49-44eb-bc2d-7c332775e430 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:01.537897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d745f-cd49-44eb-bc2d-7c332775e430 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:01.555433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1001/1997] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:52:01.556333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977d867-e40d-4303-a38e-991637a83d81 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:01.566746 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977d867-e40d-4303-a38e-991637a83d81 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:01.571387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc05b0-ec25-4b51-b198-0ead2c98b8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:01.572117 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc05b0-ec25-4b51-b198-0ead2c98b8bc admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:01.572403 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc05b0-ec25-4b51-b198-0ead2c98b8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:01.572678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc05b0-ec25-4b51-b198-0ead2c98b8bc admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:01.573423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc05b0-ec25-4b51-b198-0ead2c98b8bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:01.575322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc05b0-ec25-4b51-b198-0ead2c98b8bc admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:01.674275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d745f-cd49-44eb-bc2d-7c332775e430 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:01.676139 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-c84d745f-cd49-44eb-bc2d-7c332775e430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:01.695079 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d745f-cd49-44eb-bc2d-7c332775e430 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:01.698421 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107d116-0777-4785-84c6-52b57d495623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:01.699303 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107d116-0777-4785-84c6-52b57d495623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:01.699809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107d116-0777-4785-84c6-52b57d495623 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:01.700092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107d116-0777-4785-84c6-52b57d495623 admin admin] PATH_INFO: `/v3/users/844dea66716e4abca42db534b6808261` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:01.701320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107d116-0777-4785-84c6-52b57d495623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=844dea66716e4abca42db534b6808261)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:01.703307 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107d116-0777-4785-84c6-52b57d495623 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:01.731734 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 997/1998] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:52:01 2022] POST /identity/v3/projects => generated 365 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:52:01.735797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc05b0-ec25-4b51-b198-0ead2c98b8bc admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:01.797486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc05b0-ec25-4b51-b198-0ead2c98b8bc admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:01.802490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150c7d1-1063-45e7-a112-f6b20441c716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:01.803178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150c7d1-1063-45e7-a112-f6b20441c716 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:01.803464 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150c7d1-1063-45e7-a112-f6b20441c716 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:01.803798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150c7d1-1063-45e7-a112-f6b20441c716 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:01.804494 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150c7d1-1063-45e7-a112-f6b20441c716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:01.806454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150c7d1-1063-45e7-a112-f6b20441c716 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:01.828543 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:01.898163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 998/1999] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:52:01 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:52:01.899462 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150c7d1-1063-45e7-a112-f6b20441c716 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:01.914344 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150c7d1-1063-45e7-a112-f6b20441c716 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:01.919003 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1644ef-d7fe-40db-8afa-1bcc2660894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:01.919701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1644ef-d7fe-40db-8afa-1bcc2660894b admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:01.920018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1644ef-d7fe-40db-8afa-1bcc2660894b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:01.920313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1644ef-d7fe-40db-8afa-1bcc2660894b admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:01.920708 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e107d116-0777-4785-84c6-52b57d495623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '844dea66716e4abca42db534b6808261'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:01.921000 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1644ef-d7fe-40db-8afa-1bcc2660894b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:01.922614 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1644ef-d7fe-40db-8afa-1bcc2660894b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:01.938739 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 999/2000] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:52:01.941323 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1644ef-d7fe-40db-8afa-1bcc2660894b admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:01.956142 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1644ef-d7fe-40db-8afa-1bcc2660894b admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:01.961294 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f2e97-2ba4-47f0-9bdb-2a01e4ea1b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:01.962024 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f2e97-2ba4-47f0-9bdb-2a01e4ea1b9b admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:01.962315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f2e97-2ba4-47f0-9bdb-2a01e4ea1b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:01.962599 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f2e97-2ba4-47f0-9bdb-2a01e4ea1b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:01.963441 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f2e97-2ba4-47f0-9bdb-2a01e4ea1b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:01.966634 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f2e97-2ba4-47f0-9bdb-2a01e4ea1b9b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:01.979065 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1000/2001] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:01.985283 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f2e97-2ba4-47f0-9bdb-2a01e4ea1b9b admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:01.996377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f2e97-2ba4-47f0-9bdb-2a01e4ea1b9b admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:02.001394 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98da50-5c74-4070-9769-2d5601df5c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:02.002346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98da50-5c74-4070-9769-2d5601df5c77 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:02.002633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98da50-5c74-4070-9769-2d5601df5c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:02.002912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98da50-5c74-4070-9769-2d5601df5c77 admin admin] PATH_INFO: `/v3/projects/b688b662f7fb4470bf9e3d1ebe1ccc79/users/35d4cbcb8ef7441cb2e2f17b848d0b70/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:02.020361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98da50-5c74-4070-9769-2d5601df5c77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b688b662f7fb4470bf9e3d1ebe1ccc79, user_id=35d4cbcb8ef7441cb2e2f17b848d0b70, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:02.023412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98da50-5c74-4070-9769-2d5601df5c77 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:02.028228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e107d116-0777-4785-84c6-52b57d495623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '844dea66716e4abca42db534b6808261'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:02.043856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e107d116-0777-4785-84c6-52b57d495623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '844dea66716e4abca42db534b6808261'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:02.051792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e107d116-0777-4785-84c6-52b57d495623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '844dea66716e4abca42db534b6808261'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:02.053764 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e107d116-0777-4785-84c6-52b57d495623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '844dea66716e4abca42db534b6808261'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:02.062863 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1002/2002] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:52:01 2022] DELETE /identity/v3/users/844dea66716e4abca42db534b6808261 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:52:02.067780 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0ba2-35b8-4dd7-86c7-25f3caef8ab6 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:02.068369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0ba2-35b8-4dd7-86c7-25f3caef8ab6 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:02.068946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed0ba2-35b8-4dd7-86c7-25f3caef8ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:02.090490 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-e3ed0ba2-35b8-4dd7-86c7-25f3caef8ab6 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:02.091782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e3ed0ba2-35b8-4dd7-86c7-25f3caef8ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:02.115781 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1001/2003] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:01 2022] PUT /identity/v3/projects/b688b662f7fb4470bf9e3d1ebe1ccc79/users/35d4cbcb8ef7441cb2e2f17b848d0b70/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:52:02.125351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46d1f-a272-44c0-90a4-16a4f78030ba None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:02.125742 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46d1f-a272-44c0-90a4-16a4f78030ba None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:02.126119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d46d1f-a272-44c0-90a4-16a4f78030ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:02.158140 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-64d46d1f-a272-44c0-90a4-16a4f78030ba None None] MFA Rules not processed for user `35d4cbcb8ef7441cb2e2f17b848d0b70`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:02.159363 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-64d46d1f-a272-44c0-90a4-16a4f78030ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:02.171662 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1003/2004] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:02.179210 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed0ba2-35b8-4dd7-86c7-25f3caef8ab6 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:02.180763 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e3ed0ba2-35b8-4dd7-86c7-25f3caef8ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:02.238453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1002/2005] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:02.242968 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d46d1f-a272-44c0-90a4-16a4f78030ba None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:02.244341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-64d46d1f-a272-44c0-90a4-16a4f78030ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:02.246510 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed0ba2-35b8-4dd7-86c7-25f3caef8ab6 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:02.302242 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669aba9-f7ea-4063-8819-e4eabcbeea13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:02.302900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669aba9-f7ea-4063-8819-e4eabcbeea13 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:02.303188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669aba9-f7ea-4063-8819-e4eabcbeea13 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:02.303466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669aba9-f7ea-4063-8819-e4eabcbeea13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:02.321873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d46d1f-a272-44c0-90a4-16a4f78030ba None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:02.328192 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349addc-5fb8-4b82-94a3-d94b88af287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:02.328871 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349addc-5fb8-4b82-94a3-d94b88af287e admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:02.329157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349addc-5fb8-4b82-94a3-d94b88af287e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:02.331378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349addc-5fb8-4b82-94a3-d94b88af287e admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:02.331378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349addc-5fb8-4b82-94a3-d94b88af287e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:02.332201 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349addc-5fb8-4b82-94a3-d94b88af287e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:02.370871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669aba9-f7ea-4063-8819-e4eabcbeea13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:02.372387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669aba9-f7ea-4063-8819-e4eabcbeea13 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:02.382214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1004/2006] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:52:02.443848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1003/2007] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:52:02 2022] POST /identity/v3/projects => generated 363 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:52:02.445298 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669aba9-f7ea-4063-8819-e4eabcbeea13 service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:02.456278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669aba9-f7ea-4063-8819-e4eabcbeea13 service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:02.515348 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05d2e1-ae17-453b-97d8-acbfc6770639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:02.516109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05d2e1-ae17-453b-97d8-acbfc6770639 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:02.516383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05d2e1-ae17-453b-97d8-acbfc6770639 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:02.516652 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05d2e1-ae17-453b-97d8-acbfc6770639 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:02.517368 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05d2e1-ae17-453b-97d8-acbfc6770639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:02.519329 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05d2e1-ae17-453b-97d8-acbfc6770639 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:02.535604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:02.647961 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1005/2008] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:52:02 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:02.651887 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349addc-5fb8-4b82-94a3-d94b88af287e admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:02.663234 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349addc-5fb8-4b82-94a3-d94b88af287e admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:02.668827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17842f-f4ad-4375-a480-e9b6348e8c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:02.669562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17842f-f4ad-4375-a480-e9b6348e8c00 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:02.669972 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17842f-f4ad-4375-a480-e9b6348e8c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:02.670256 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17842f-f4ad-4375-a480-e9b6348e8c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:02.670997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17842f-f4ad-4375-a480-e9b6348e8c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:02.672883 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17842f-f4ad-4375-a480-e9b6348e8c00 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:02.688759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1004/2009] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:52:02.690422 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05d2e1-ae17-453b-97d8-acbfc6770639 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:02.701599 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05d2e1-ae17-453b-97d8-acbfc6770639 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:02.708253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a63eb-0731-47e4-bc3f-68ceb5212fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:02.708253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a63eb-0731-47e4-bc3f-68ceb5212fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:02.708253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a63eb-0731-47e4-bc3f-68ceb5212fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:02.713233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a63eb-0731-47e4-bc3f-68ceb5212fd1 admin admin] PATH_INFO: `/v3/projects/9b1a8ccfa473441984134d3ae2d88fb4/users/f3e472fac54e47038ea339db6e2f73a2/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:02.734438 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a63eb-0731-47e4-bc3f-68ceb5212fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1a8ccfa473441984134d3ae2d88fb4, user_id=f3e472fac54e47038ea339db6e2f73a2, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:02.737285 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a63eb-0731-47e4-bc3f-68ceb5212fd1 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:02.771461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:02.802018 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1006/2010] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:02 2022] PUT /identity/v3/projects/9b1a8ccfa473441984134d3ae2d88fb4/users/f3e472fac54e47038ea339db6e2f73a2/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:52:02.810165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17842f-f4ad-4375-a480-e9b6348e8c00 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:02.820523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17842f-f4ad-4375-a480-e9b6348e8c00 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:02.840185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a63eb-0731-47e4-bc3f-68ceb5212fd1 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:02.842105 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f10a63eb-0731-47e4-bc3f-68ceb5212fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:02.908694 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdb2c6-7909-48a0-bbb5-cf215f9171b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:02.909730 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdb2c6-7909-48a0-bbb5-cf215f9171b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:02.910298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdb2c6-7909-48a0-bbb5-cf215f9171b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:02.910580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccdb2c6-7909-48a0-bbb5-cf215f9171b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:02.911470 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdb2c6-7909-48a0-bbb5-cf215f9171b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:02.913795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccdb2c6-7909-48a0-bbb5-cf215f9171b5 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:02.924690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1005/2011] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:52:02.928706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdb2c6-7909-48a0-bbb5-cf215f9171b5 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:02.933595 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a63eb-0731-47e4-bc3f-68ceb5212fd1 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:02.940548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02258611-0f59-4b6a-8f86-d165e2e53cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:02.941664 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02258611-0f59-4b6a-8f86-d165e2e53cd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:02.942005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02258611-0f59-4b6a-8f86-d165e2e53cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:02.942472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02258611-0f59-4b6a-8f86-d165e2e53cd0 admin admin] PATH_INFO: `/v3/projects/0b538687276741a2a22de6b39f9b3e12` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:02.944279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccdb2c6-7909-48a0-bbb5-cf215f9171b5 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:02.944397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02258611-0f59-4b6a-8f86-d165e2e53cd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b538687276741a2a22de6b39f9b3e12)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:02.947453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02258611-0f59-4b6a-8f86-d165e2e53cd0 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:02.951430 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19a581-7635-49ae-a23a-3f6ae8b96ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:02.952458 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19a581-7635-49ae-a23a-3f6ae8b96ad3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:02.952751 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19a581-7635-49ae-a23a-3f6ae8b96ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:02.953169 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19a581-7635-49ae-a23a-3f6ae8b96ad3 admin admin] PATH_INFO: `/v3/projects/9b1a8ccfa473441984134d3ae2d88fb4/users/f3e472fac54e47038ea339db6e2f73a2/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:02.955255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19a581-7635-49ae-a23a-3f6ae8b96ad3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1a8ccfa473441984134d3ae2d88fb4, user_id=f3e472fac54e47038ea339db6e2f73a2, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:02.958092 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19a581-7635-49ae-a23a-3f6ae8b96ad3 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:02.969674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1006/2012] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:02 2022] PUT /identity/v3/projects/9b1a8ccfa473441984134d3ae2d88fb4/users/f3e472fac54e47038ea339db6e2f73a2/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:52:02.979924 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e761e-ac4b-4a2f-bab3-495ec112fbd4 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:02.980233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e761e-ac4b-4a2f-bab3-495ec112fbd4 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:02.980522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e761e-ac4b-4a2f-bab3-495ec112fbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:03.011178 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-297e761e-ac4b-4a2f-bab3-495ec112fbd4 None None] MFA Rules not processed for user `f3e472fac54e47038ea339db6e2f73a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:03.012492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-297e761e-ac4b-4a2f-bab3-495ec112fbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:03.053644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-02258611-0f59-4b6a-8f86-d165e2e53cd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b538687276741a2a22de6b39f9b3e12', 'request_id': 'req-02258611-0f59-4b6a-8f86-d165e2e53cd0'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:03.062732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-02258611-0f59-4b6a-8f86-d165e2e53cd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b538687276741a2a22de6b39f9b3e12', 'request_id': 'req-02258611-0f59-4b6a-8f86-d165e2e53cd0'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:03.088787 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1007/2013] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:02 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:03.101709 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e761e-ac4b-4a2f-bab3-495ec112fbd4 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:03.103605 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-297e761e-ac4b-4a2f-bab3-495ec112fbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:03.168689 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e761e-ac4b-4a2f-bab3-495ec112fbd4 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:03.198573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-02258611-0f59-4b6a-8f86-d165e2e53cd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b538687276741a2a22de6b39f9b3e12', 'request_id': 'req-02258611-0f59-4b6a-8f86-d165e2e53cd0'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:03.215673 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-02258611-0f59-4b6a-8f86-d165e2e53cd0 admin admin] The token cache is being invalidate because project 0b538687276741a2a22de6b39f9b3e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:52:03.216214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-02258611-0f59-4b6a-8f86-d165e2e53cd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:03.217132 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-02258611-0f59-4b6a-8f86-d165e2e53cd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:03.220060 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1007/2014] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:52:02 2022] DELETE /identity/v3/projects/0b538687276741a2a22de6b39f9b3e12 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:52:03.224287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02258611-0f59-4b6a-8f86-d165e2e53cd0 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:03.226341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-02258611-0f59-4b6a-8f86-d165e2e53cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:03.238865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583465e2-aeac-41b7-b9a1-20c9b5882ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:03.239576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583465e2-aeac-41b7-b9a1-20c9b5882ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:03.239868 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583465e2-aeac-41b7-b9a1-20c9b5882ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:03.240141 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583465e2-aeac-41b7-b9a1-20c9b5882ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:03.241981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-583465e2-aeac-41b7-b9a1-20c9b5882ca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:03.325654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02258611-0f59-4b6a-8f86-d165e2e53cd0 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:03.329402 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583465e2-aeac-41b7-b9a1-20c9b5882ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:03.330863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583465e2-aeac-41b7-b9a1-20c9b5882ca4 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:03.338076 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8b7aa-ed05-4ec6-bca5-f4ceb7483aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:03.339145 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8b7aa-ed05-4ec6-bca5-f4ceb7483aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:03.339495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8b7aa-ed05-4ec6-bca5-f4ceb7483aea admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:03.339868 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8b7aa-ed05-4ec6-bca5-f4ceb7483aea admin admin] PATH_INFO: `/v3/users/bd6e9ccc6c0f44eabb9b0863317ef832` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:03.340742 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1008/2015] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:03 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:52:03.344011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8b7aa-ed05-4ec6-bca5-f4ceb7483aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd6e9ccc6c0f44eabb9b0863317ef832)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:03.345955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac8b7aa-ed05-4ec6-bca5-f4ceb7483aea admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:03.400353 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:03.573817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8ac8b7aa-ed05-4ec6-bca5-f4ceb7483aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd6e9ccc6c0f44eabb9b0863317ef832'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:03.662408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8ac8b7aa-ed05-4ec6-bca5-f4ceb7483aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd6e9ccc6c0f44eabb9b0863317ef832'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:03.676273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8ac8b7aa-ed05-4ec6-bca5-f4ceb7483aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd6e9ccc6c0f44eabb9b0863317ef832'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:03.684052 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8ac8b7aa-ed05-4ec6-bca5-f4ceb7483aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd6e9ccc6c0f44eabb9b0863317ef832'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:03.684771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8ac8b7aa-ed05-4ec6-bca5-f4ceb7483aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd6e9ccc6c0f44eabb9b0863317ef832'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:03.690691 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1008/2016] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:52:03 2022] DELETE /identity/v3/users/bd6e9ccc6c0f44eabb9b0863317ef832 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:52:03.758117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:03.937226 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:INSERT=4,keystone:SELECT=79,keystone:DELETE=17 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:04.141264 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583465e2-aeac-41b7-b9a1-20c9b5882ca4 service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:04.154125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583465e2-aeac-41b7-b9a1-20c9b5882ca4 service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:04.211901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76918b-f48c-4191-8fe5-e20c3c8770e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:04.213156 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76918b-f48c-4191-8fe5-e20c3c8770e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:04.214145 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76918b-f48c-4191-8fe5-e20c3c8770e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:04.214431 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76918b-f48c-4191-8fe5-e20c3c8770e3 admin admin] PATH_INFO: `/v3/projects/7f70d13007974910bd3d826efb2afb12` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:04.215879 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76918b-f48c-4191-8fe5-e20c3c8770e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f70d13007974910bd3d826efb2afb12)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:04.218068 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76918b-f48c-4191-8fe5-e20c3c8770e3 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:04.232742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8b7aa-ed05-4ec6-bca5-f4ceb7483aea admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:04.234206 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-8ac8b7aa-ed05-4ec6-bca5-f4ceb7483aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:04.248948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac8b7aa-ed05-4ec6-bca5-f4ceb7483aea admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:04.253716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2131aecd-1f33-47fb-a232-ee530aabc933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:04.254609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131aecd-1f33-47fb-a232-ee530aabc933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:04.254895 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131aecd-1f33-47fb-a232-ee530aabc933 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:04.255202 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131aecd-1f33-47fb-a232-ee530aabc933 admin admin] PATH_INFO: `/v3/users/35d4cbcb8ef7441cb2e2f17b848d0b70` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:04.256452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131aecd-1f33-47fb-a232-ee530aabc933 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d4cbcb8ef7441cb2e2f17b848d0b70)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:04.258448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2131aecd-1f33-47fb-a232-ee530aabc933 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:04.320390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ac76918b-f48c-4191-8fe5-e20c3c8770e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f70d13007974910bd3d826efb2afb12', 'request_id': 'req-ac76918b-f48c-4191-8fe5-e20c3c8770e3'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:04.411202 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ac76918b-f48c-4191-8fe5-e20c3c8770e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f70d13007974910bd3d826efb2afb12', 'request_id': 'req-ac76918b-f48c-4191-8fe5-e20c3c8770e3'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:04.417595 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ac76918b-f48c-4191-8fe5-e20c3c8770e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f70d13007974910bd3d826efb2afb12', 'request_id': 'req-ac76918b-f48c-4191-8fe5-e20c3c8770e3'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:04.431894 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ac76918b-f48c-4191-8fe5-e20c3c8770e3 admin admin] The token cache is being invalidate because project 7f70d13007974910bd3d826efb2afb12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:52:04.432697 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ac76918b-f48c-4191-8fe5-e20c3c8770e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:04.433357 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ac76918b-f48c-4191-8fe5-e20c3c8770e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:04.435153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1009/2017] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:52:04 2022] DELETE /identity/v3/projects/7f70d13007974910bd3d826efb2afb12 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:04.439858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195023e5-a256-4d38-a7c9-07d5484b9766 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:04.440647 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195023e5-a256-4d38-a7c9-07d5484b9766 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:04.441037 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195023e5-a256-4d38-a7c9-07d5484b9766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:04.463085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-2131aecd-1f33-47fb-a232-ee530aabc933 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d4cbcb8ef7441cb2e2f17b848d0b70'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:04.493422 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-195023e5-a256-4d38-a7c9-07d5484b9766 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:04.493422 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-195023e5-a256-4d38-a7c9-07d5484b9766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:04.554170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-2131aecd-1f33-47fb-a232-ee530aabc933 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d4cbcb8ef7441cb2e2f17b848d0b70'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:04.555581 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1010/2018] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:52:04.564791 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a3cb1-b465-493b-a803-8fce968a096f None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:04.565553 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a3cb1-b465-493b-a803-8fce968a096f None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:04.566211 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a3cb1-b465-493b-a803-8fce968a096f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:04.569341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-2131aecd-1f33-47fb-a232-ee530aabc933 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d4cbcb8ef7441cb2e2f17b848d0b70'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:04.578642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-2131aecd-1f33-47fb-a232-ee530aabc933 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d4cbcb8ef7441cb2e2f17b848d0b70'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:04.579471 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-2131aecd-1f33-47fb-a232-ee530aabc933 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d4cbcb8ef7441cb2e2f17b848d0b70'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:04.585711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1009/2019] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:52:04 2022] DELETE /identity/v3/users/35d4cbcb8ef7441cb2e2f17b848d0b70 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:04.590228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c35cfa-67d7-4844-ada2-6740ceddd554 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:04.590911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c35cfa-67d7-4844-ada2-6740ceddd554 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:04.591020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-4e4a3cb1-b465-493b-a803-8fce968a096f None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:04.591469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c35cfa-67d7-4844-ada2-6740ceddd554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:04.592243 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-4e4a3cb1-b465-493b-a803-8fce968a096f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:04.613464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-61c35cfa-67d7-4844-ada2-6740ceddd554 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:04.615010 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-61c35cfa-67d7-4844-ada2-6740ceddd554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:04.656194 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1011/2020] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:52:04.660610 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a3cb1-b465-493b-a803-8fce968a096f None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:04.674735 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a3cb1-b465-493b-a803-8fce968a096f None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:04.679751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1010/2021] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:04.680436 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa6bef-aadd-488c-92a3-c899dfe0f246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:04.681270 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa6bef-aadd-488c-92a3-c899dfe0f246 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:04.681812 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa6bef-aadd-488c-92a3-c899dfe0f246 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:04.681993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa6bef-aadd-488c-92a3-c899dfe0f246 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:04.683341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa6bef-aadd-488c-92a3-c899dfe0f246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:52:04.683687 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa6bef-aadd-488c-92a3-c899dfe0f246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:04.685346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa6bef-aadd-488c-92a3-c899dfe0f246 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:04.689758 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c35cfa-67d7-4844-ada2-6740ceddd554 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:04.691234 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-61c35cfa-67d7-4844-ada2-6740ceddd554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:04.697882 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1012/2022] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:52:04.702843 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa6bef-aadd-488c-92a3-c899dfe0f246 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:04.713038 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa6bef-aadd-488c-92a3-c899dfe0f246 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:04.717848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ade54-6119-4ded-afaa-6c2b33b514b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:04.722522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ade54-6119-4ded-afaa-6c2b33b514b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:04.722522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ade54-6119-4ded-afaa-6c2b33b514b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:04.722522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ade54-6119-4ded-afaa-6c2b33b514b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:04.722522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ade54-6119-4ded-afaa-6c2b33b514b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:04.722522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ade54-6119-4ded-afaa-6c2b33b514b4 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:04.741317 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:04.751658 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c35cfa-67d7-4844-ada2-6740ceddd554 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:04.755286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618995c1-b0da-47ed-a8ac-e65befc559ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:04.755966 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618995c1-b0da-47ed-a8ac-e65befc559ef service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:04.756251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618995c1-b0da-47ed-a8ac-e65befc559ef service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:04.756531 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618995c1-b0da-47ed-a8ac-e65befc559ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:04.765348 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618995c1-b0da-47ed-a8ac-e65befc559ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:04.766777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618995c1-b0da-47ed-a8ac-e65befc559ef service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:04.776117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1011/2023] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:52:04.827447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1013/2024] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:52:04 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:04.828789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618995c1-b0da-47ed-a8ac-e65befc559ef service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:04.838467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618995c1-b0da-47ed-a8ac-e65befc559ef service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:04.901274 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae3b81-1355-49e4-8d88-f84d656b706c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:04.902005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae3b81-1355-49e4-8d88-f84d656b706c admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:04.902408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae3b81-1355-49e4-8d88-f84d656b706c admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:04.902870 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ae3b81-1355-49e4-8d88-f84d656b706c admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:04.903602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae3b81-1355-49e4-8d88-f84d656b706c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:04.905596 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ae3b81-1355-49e4-8d88-f84d656b706c admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:04.954359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:04.991891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1012/2025] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:52:04 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:52:04.993126 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ade54-6119-4ded-afaa-6c2b33b514b4 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:05.004168 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ade54-6119-4ded-afaa-6c2b33b514b4 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:05.008946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f8260-c583-4d45-8d33-19958cce944c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:05.009654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f8260-c583-4d45-8d33-19958cce944c admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:05.009940 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f8260-c583-4d45-8d33-19958cce944c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:05.010260 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f8260-c583-4d45-8d33-19958cce944c admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:05.010999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f8260-c583-4d45-8d33-19958cce944c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:05.012683 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f8260-c583-4d45-8d33-19958cce944c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:05.026756 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1014/2026] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:52:05.028578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae3b81-1355-49e4-8d88-f84d656b706c admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:05.039420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ae3b81-1355-49e4-8d88-f84d656b706c admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:05.045260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0e753-eddc-4d60-9d35-50303c738d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:05.046179 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0e753-eddc-4d60-9d35-50303c738d46 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:05.046541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0e753-eddc-4d60-9d35-50303c738d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:05.047131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0e753-eddc-4d60-9d35-50303c738d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:05.048061 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0e753-eddc-4d60-9d35-50303c738d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:05.049880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a0e753-eddc-4d60-9d35-50303c738d46 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:05.061300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1013/2027] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:05.065294 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f8260-c583-4d45-8d33-19958cce944c admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:05.076123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f8260-c583-4d45-8d33-19958cce944c admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:05.080881 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b146d-96b9-4d43-8762-85635dee26dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:05.081795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b146d-96b9-4d43-8762-85635dee26dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:05.082077 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b146d-96b9-4d43-8762-85635dee26dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:05.082480 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b146d-96b9-4d43-8762-85635dee26dd admin admin] PATH_INFO: `/v3/projects/9bf0f25dcc0641488bd4b10472a61a8d/users/fa8b9968425f40189532fc5ca2daf5e4/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:05.098166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b146d-96b9-4d43-8762-85635dee26dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bf0f25dcc0641488bd4b10472a61a8d, user_id=fa8b9968425f40189532fc5ca2daf5e4, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:05.100875 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9b146d-96b9-4d43-8762-85635dee26dd admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:05.155129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0e753-eddc-4d60-9d35-50303c738d46 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:05.157016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b2a0e753-eddc-4d60-9d35-50303c738d46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:05.173493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0e753-eddc-4d60-9d35-50303c738d46 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:05.184243 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1015/2028] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:05 2022] PUT /identity/v3/projects/9bf0f25dcc0641488bd4b10472a61a8d/users/fa8b9968425f40189532fc5ca2daf5e4/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:05.187394 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9bdd8-5649-41d9-867f-d78d4d16529c None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:05.187748 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9bdd8-5649-41d9-867f-d78d4d16529c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:05.188033 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9bdd8-5649-41d9-867f-d78d4d16529c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:05.204489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-e6d9bdd8-5649-41d9-867f-d78d4d16529c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:05.205824 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e6d9bdd8-5649-41d9-867f-d78d4d16529c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:05.232699 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:05.233609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:05.233894 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:05.234174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd admin admin] PATH_INFO: `/v3/projects/b688b662f7fb4470bf9e3d1ebe1ccc79` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:05.235387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b688b662f7fb4470bf9e3d1ebe1ccc79)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:05.237413 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:05.267020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1016/2029] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:05.277245 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9bdd8-5649-41d9-867f-d78d4d16529c None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:05.329207 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9bdd8-5649-41d9-867f-d78d4d16529c None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:05.332836 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121e6c3-b206-4246-b025-8e5adbe30701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:05.333475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121e6c3-b206-4246-b025-8e5adbe30701 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:05.333764 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121e6c3-b206-4246-b025-8e5adbe30701 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:05.334044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121e6c3-b206-4246-b025-8e5adbe30701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:05.343280 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121e6c3-b206-4246-b025-8e5adbe30701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:05.344745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121e6c3-b206-4246-b025-8e5adbe30701 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:05.354796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1017/2030] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:52:05.422369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b688b662f7fb4470bf9e3d1ebe1ccc79', 'request_id': 'req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:05.428514 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b688b662f7fb4470bf9e3d1ebe1ccc79', 'request_id': 'req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:05.515657 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b688b662f7fb4470bf9e3d1ebe1ccc79', 'request_id': 'req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:05.530421 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd admin admin] The token cache is being invalidate because project b688b662f7fb4470bf9e3d1ebe1ccc79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:52:05.530736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:05.531443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:05.536196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1014/2031] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:52:05 2022] DELETE /identity/v3/projects/b688b662f7fb4470bf9e3d1ebe1ccc79 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:05.537416 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121e6c3-b206-4246-b025-8e5adbe30701 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:05.548282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121e6c3-b206-4246-b025-8e5adbe30701 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:05.624164 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0dd00-2e5b-4e5e-aecc-b030c286bee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:05.625182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0dd00-2e5b-4e5e-aecc-b030c286bee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:05.626127 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0dd00-2e5b-4e5e-aecc-b030c286bee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:05.626449 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0dd00-2e5b-4e5e-aecc-b030c286bee7 admin admin] PATH_INFO: `/v3/users/f3e472fac54e47038ea339db6e2f73a2` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:05.628305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0dd00-2e5b-4e5e-aecc-b030c286bee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3e472fac54e47038ea339db6e2f73a2)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:05.629858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd0dd00-2e5b-4e5e-aecc-b030c286bee7 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:05.829984 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-bdd0dd00-2e5b-4e5e-aecc-b030c286bee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3e472fac54e47038ea339db6e2f73a2'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:05.886286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-bdd0dd00-2e5b-4e5e-aecc-b030c286bee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3e472fac54e47038ea339db6e2f73a2'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:05.900454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-bdd0dd00-2e5b-4e5e-aecc-b030c286bee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3e472fac54e47038ea339db6e2f73a2'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:05.901243 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-bdd0dd00-2e5b-4e5e-aecc-b030c286bee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3e472fac54e47038ea339db6e2f73a2'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:05.909685 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-bdd0dd00-2e5b-4e5e-aecc-b030c286bee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3e472fac54e47038ea339db6e2f73a2'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:05.916773 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1018/2032] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:52:05 2022] DELETE /identity/v3/users/f3e472fac54e47038ea339db6e2f73a2 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:06.219252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:06.473849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:06.475872 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:06.492504 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fd8b7-0c09-4d2d-ba28-69df22d0d5dd admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:06.536049 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:06.555790 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b547a5c-dda8-4c11-910f-0523d726f3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:06.556659 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b547a5c-dda8-4c11-910f-0523d726f3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:06.556948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b547a5c-dda8-4c11-910f-0523d726f3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:06.557264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b547a5c-dda8-4c11-910f-0523d726f3cf admin admin] PATH_INFO: `/v3/projects/9b1a8ccfa473441984134d3ae2d88fb4` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:06.558490 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b547a5c-dda8-4c11-910f-0523d726f3cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b1a8ccfa473441984134d3ae2d88fb4)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:06.560458 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b547a5c-dda8-4c11-910f-0523d726f3cf admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:06.753898 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1b547a5c-dda8-4c11-910f-0523d726f3cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b1a8ccfa473441984134d3ae2d88fb4', 'request_id': 'req-1b547a5c-dda8-4c11-910f-0523d726f3cf'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:06.760765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1b547a5c-dda8-4c11-910f-0523d726f3cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b1a8ccfa473441984134d3ae2d88fb4', 'request_id': 'req-1b547a5c-dda8-4c11-910f-0523d726f3cf'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:06.813750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6e986-1826-487a-a96e-61819ae407d0 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:06.814063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6e986-1826-487a-a96e-61819ae407d0 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:06.814332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6e986-1826-487a-a96e-61819ae407d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:06.830162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1b547a5c-dda8-4c11-910f-0523d726f3cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b1a8ccfa473441984134d3ae2d88fb4', 'request_id': 'req-1b547a5c-dda8-4c11-910f-0523d726f3cf'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:06.844496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1b547a5c-dda8-4c11-910f-0523d726f3cf admin admin] The token cache is being invalidate because project 9b1a8ccfa473441984134d3ae2d88fb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:52:06.845279 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1b547a5c-dda8-4c11-910f-0523d726f3cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:06.847426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1b547a5c-dda8-4c11-910f-0523d726f3cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:06.851771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1015/2033] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:52:06 2022] DELETE /identity/v3/projects/9b1a8ccfa473441984134d3ae2d88fb4 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:06.859036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ba3ad-04fc-4f98-82e7-759255b963fe None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:06.859991 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ba3ad-04fc-4f98-82e7-759255b963fe None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:06.860381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ba3ad-04fc-4f98-82e7-759255b963fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:06.862129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-b7e6e986-1826-487a-a96e-61819ae407d0 None None] MFA Rules not processed for user `fa8b9968425f40189532fc5ca2daf5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:06.864489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b7e6e986-1826-487a-a96e-61819ae407d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:06.901585 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-078ba3ad-04fc-4f98-82e7-759255b963fe None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:06.903619 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-078ba3ad-04fc-4f98-82e7-759255b963fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:06.985028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1019/2034] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:06.995424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6e986-1826-487a-a96e-61819ae407d0 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:06.996913 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b7e6e986-1826-487a-a96e-61819ae407d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:07.003122 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1016/2035] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:52:07.011281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3477c-d62b-446f-9262-54cc878e163b None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:07.011723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3477c-d62b-446f-9262-54cc878e163b None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:07.012107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f3477c-d62b-446f-9262-54cc878e163b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:07.032018 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-f2f3477c-d62b-446f-9262-54cc878e163b None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:07.033323 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f2f3477c-d62b-446f-9262-54cc878e163b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:07.041376 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1017/2036] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:52:07.045495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3477c-d62b-446f-9262-54cc878e163b None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:07.054279 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f3477c-d62b-446f-9262-54cc878e163b None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:07.054425 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6e986-1826-487a-a96e-61819ae407d0 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:07.058925 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab446ec-971f-4e48-8b12-deccdc3d4e93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:07.059283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6afcdf-2417-4025-b3fd-c204fd72f79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:07.059843 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab446ec-971f-4e48-8b12-deccdc3d4e93 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:07.059986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6afcdf-2417-4025-b3fd-c204fd72f79d admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:07.060127 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab446ec-971f-4e48-8b12-deccdc3d4e93 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:07.060244 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6afcdf-2417-4025-b3fd-c204fd72f79d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:07.060407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab446ec-971f-4e48-8b12-deccdc3d4e93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:07.060527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6afcdf-2417-4025-b3fd-c204fd72f79d admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:07.061237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6afcdf-2417-4025-b3fd-c204fd72f79d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:52:07.061551 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6afcdf-2417-4025-b3fd-c204fd72f79d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:07.063175 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6afcdf-2417-4025-b3fd-c204fd72f79d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:07.069556 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab446ec-971f-4e48-8b12-deccdc3d4e93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:07.071048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab446ec-971f-4e48-8b12-deccdc3d4e93 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:07.078824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1018/2037] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:52:07.079853 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6afcdf-2417-4025-b3fd-c204fd72f79d admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:07.083981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1020/2038] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:52:07.090128 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6afcdf-2417-4025-b3fd-c204fd72f79d admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:07.094837 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2953de3-ae69-4eab-920f-47eaed61a8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:07.095487 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2953de3-ae69-4eab-920f-47eaed61a8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:07.095875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2953de3-ae69-4eab-920f-47eaed61a8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:07.096154 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2953de3-ae69-4eab-920f-47eaed61a8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:07.096842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2953de3-ae69-4eab-920f-47eaed61a8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:07.098755 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2953de3-ae69-4eab-920f-47eaed61a8d4 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:07.201401 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1019/2039] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:52:07 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:52:07.205561 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab446ec-971f-4e48-8b12-deccdc3d4e93 service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:07.217872 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab446ec-971f-4e48-8b12-deccdc3d4e93 service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:07.276976 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6b3e9-b549-4e1f-808b-4dfb29d04532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:07.277658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6b3e9-b549-4e1f-808b-4dfb29d04532 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:07.277974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6b3e9-b549-4e1f-808b-4dfb29d04532 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:07.278259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6b3e9-b549-4e1f-808b-4dfb29d04532 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:07.278958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6b3e9-b549-4e1f-808b-4dfb29d04532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:07.280923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6b3e9-b549-4e1f-808b-4dfb29d04532 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:07.320408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2953de3-ae69-4eab-920f-47eaed61a8d4 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:07.322154 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-d2953de3-ae69-4eab-920f-47eaed61a8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:07.337068 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2953de3-ae69-4eab-920f-47eaed61a8d4 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:07.341832 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c97b3-a925-4a0d-9777-e3ff8b93c529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:07.344260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c97b3-a925-4a0d-9777-e3ff8b93c529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:07.344260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c97b3-a925-4a0d-9777-e3ff8b93c529 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:07.344260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c97b3-a925-4a0d-9777-e3ff8b93c529 admin admin] PATH_INFO: `/v3/users/dcaa086117ce410dbe36f9a1131331b6` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:07.344583 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c97b3-a925-4a0d-9777-e3ff8b93c529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcaa086117ce410dbe36f9a1131331b6)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:07.346382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c97b3-a925-4a0d-9777-e3ff8b93c529 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:07.393880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1021/2040] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:52:07 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:07.397820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6b3e9-b549-4e1f-808b-4dfb29d04532 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:07.407328 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6b3e9-b549-4e1f-808b-4dfb29d04532 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:07.411911 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cf41b-cda6-4fab-8cd4-dd5eee1bd830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:07.412544 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cf41b-cda6-4fab-8cd4-dd5eee1bd830 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:07.412829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cf41b-cda6-4fab-8cd4-dd5eee1bd830 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:07.413104 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cf41b-cda6-4fab-8cd4-dd5eee1bd830 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:07.413874 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cf41b-cda6-4fab-8cd4-dd5eee1bd830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:07.415452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cf41b-cda6-4fab-8cd4-dd5eee1bd830 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:07.425427 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1022/2041] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:52:07.429003 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cf41b-cda6-4fab-8cd4-dd5eee1bd830 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:07.438954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cf41b-cda6-4fab-8cd4-dd5eee1bd830 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:07.443668 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc730ad-c442-40f7-a06d-bf5555f47664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:07.444332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc730ad-c442-40f7-a06d-bf5555f47664 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:07.444617 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc730ad-c442-40f7-a06d-bf5555f47664 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:07.444895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc730ad-c442-40f7-a06d-bf5555f47664 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:07.445613 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc730ad-c442-40f7-a06d-bf5555f47664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:07.447184 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc730ad-c442-40f7-a06d-bf5555f47664 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:07.458306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1023/2042] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:52:07.462111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc730ad-c442-40f7-a06d-bf5555f47664 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:07.471247 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc730ad-c442-40f7-a06d-bf5555f47664 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:07.475704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa03cdb-1d19-4d0e-9a3b-8ed01ddd600d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:07.476540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa03cdb-1d19-4d0e-9a3b-8ed01ddd600d admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:07.482533 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa03cdb-1d19-4d0e-9a3b-8ed01ddd600d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:07.482533 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa03cdb-1d19-4d0e-9a3b-8ed01ddd600d admin admin] PATH_INFO: `/v3/projects/6fab4b7cf6e945e38a4a8135e92fd461/users/5a682ccb638947a5b2eddb0f7765b7d8/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:07.491345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa03cdb-1d19-4d0e-9a3b-8ed01ddd600d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fab4b7cf6e945e38a4a8135e92fd461, user_id=5a682ccb638947a5b2eddb0f7765b7d8, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:07.494051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa03cdb-1d19-4d0e-9a3b-8ed01ddd600d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:07.586346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1024/2043] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:07 2022] PUT /identity/v3/projects/6fab4b7cf6e945e38a4a8135e92fd461/users/5a682ccb638947a5b2eddb0f7765b7d8/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:52:07.598284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ad859-0c9e-4f9b-82f7-40f6026b78f3 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:07.598573 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ad859-0c9e-4f9b-82f7-40f6026b78f3 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:07.598846 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ad859-0c9e-4f9b-82f7-40f6026b78f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:07.626647 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-377ad859-0c9e-4f9b-82f7-40f6026b78f3 None None] MFA Rules not processed for user `5a682ccb638947a5b2eddb0f7765b7d8`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:07.627903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-377ad859-0c9e-4f9b-82f7-40f6026b78f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:07.655141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-146c97b3-a925-4a0d-9777-e3ff8b93c529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcaa086117ce410dbe36f9a1131331b6'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:07.699362 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1025/2044] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:52:07.703904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ad859-0c9e-4f9b-82f7-40f6026b78f3 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:07.734782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-146c97b3-a925-4a0d-9777-e3ff8b93c529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcaa086117ce410dbe36f9a1131331b6'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:07.748873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-146c97b3-a925-4a0d-9777-e3ff8b93c529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcaa086117ce410dbe36f9a1131331b6'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:07.756145 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-146c97b3-a925-4a0d-9777-e3ff8b93c529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcaa086117ce410dbe36f9a1131331b6'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:07.763425 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-146c97b3-a925-4a0d-9777-e3ff8b93c529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcaa086117ce410dbe36f9a1131331b6'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:07.778961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ad859-0c9e-4f9b-82f7-40f6026b78f3 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:07.779913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1020/2045] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:52:07 2022] DELETE /identity/v3/users/dcaa086117ce410dbe36f9a1131331b6 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:52:07.784158 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af531cd7-bd61-4900-a00a-4f3de8084c73 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:07.784540 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af531cd7-bd61-4900-a00a-4f3de8084c73 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:07.784900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af531cd7-bd61-4900-a00a-4f3de8084c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:07.802802 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-af531cd7-bd61-4900-a00a-4f3de8084c73 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:07.804182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-af531cd7-bd61-4900-a00a-4f3de8084c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:07.841617 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf80612-77fe-4e49-b029-c1d7ed05e34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:07.842286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf80612-77fe-4e49-b029-c1d7ed05e34e admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:07.842574 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf80612-77fe-4e49-b029-c1d7ed05e34e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:07.842849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf80612-77fe-4e49-b029-c1d7ed05e34e admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:07.843553 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf80612-77fe-4e49-b029-c1d7ed05e34e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:07.845509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf80612-77fe-4e49-b029-c1d7ed05e34e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:07.869433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1021/2046] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:52:07.876683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af531cd7-bd61-4900-a00a-4f3de8084c73 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:07.878141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-af531cd7-bd61-4900-a00a-4f3de8084c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:07.936369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af531cd7-bd61-4900-a00a-4f3de8084c73 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:07.940048 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ea5ee-0b58-43b0-85da-ffbfc9f5964e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:07.940721 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea5ee-0b58-43b0-85da-ffbfc9f5964e service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:07.941006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea5ee-0b58-43b0-85da-ffbfc9f5964e service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:07.941285 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ea5ee-0b58-43b0-85da-ffbfc9f5964e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:07.950581 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ea5ee-0b58-43b0-85da-ffbfc9f5964e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:07.952221 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ea5ee-0b58-43b0-85da-ffbfc9f5964e service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:07.956128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1026/2047] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:52:07 2022] POST /identity/v3/projects => generated 369 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:52:07.957239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf80612-77fe-4e49-b029-c1d7ed05e34e admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:07.958926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-cbf80612-77fe-4e49-b029-c1d7ed05e34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:07.962365 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1022/2048] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:52:08.034210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf80612-77fe-4e49-b029-c1d7ed05e34e admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:08.040168 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea70971-719e-4402-9293-666aa5d8f465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:08.041122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea70971-719e-4402-9293-666aa5d8f465 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:08.042072 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea70971-719e-4402-9293-666aa5d8f465 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:08.042454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea70971-719e-4402-9293-666aa5d8f465 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:08.043261 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea70971-719e-4402-9293-666aa5d8f465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:08.045429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea70971-719e-4402-9293-666aa5d8f465 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:08.167594 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1027/2049] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:52:07 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:08.169984 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ea5ee-0b58-43b0-85da-ffbfc9f5964e service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:08.179552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ea5ee-0b58-43b0-85da-ffbfc9f5964e service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:08.184380 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6256f00-f70d-46cf-8c4c-0fee83292a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:08.185034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6256f00-f70d-46cf-8c4c-0fee83292a61 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:08.185318 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6256f00-f70d-46cf-8c4c-0fee83292a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:08.185597 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6256f00-f70d-46cf-8c4c-0fee83292a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:08.186404 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6256f00-f70d-46cf-8c4c-0fee83292a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:08.188053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6256f00-f70d-46cf-8c4c-0fee83292a61 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:08.198099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1023/2050] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:08.202186 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea70971-719e-4402-9293-666aa5d8f465 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:08.211957 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea70971-719e-4402-9293-666aa5d8f465 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:08.217182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa8504-8a7d-40ca-8de9-07ac99a42f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:08.218063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa8504-8a7d-40ca-8de9-07ac99a42f02 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:08.218347 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa8504-8a7d-40ca-8de9-07ac99a42f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:08.218632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa8504-8a7d-40ca-8de9-07ac99a42f02 admin admin] PATH_INFO: `/v3/projects/a0043f8addfe46748a4485b3f4233a51/users/bf1bb551aa9745dfa2f2de00e1ffe6fe/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:08.234940 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa8504-8a7d-40ca-8de9-07ac99a42f02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0043f8addfe46748a4485b3f4233a51, user_id=bf1bb551aa9745dfa2f2de00e1ffe6fe, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:08.237770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa8504-8a7d-40ca-8de9-07ac99a42f02 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:08.315994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1028/2051] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:08 2022] PUT /identity/v3/projects/a0043f8addfe46748a4485b3f4233a51/users/bf1bb551aa9745dfa2f2de00e1ffe6fe/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:08.323207 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6256f00-f70d-46cf-8c4c-0fee83292a61 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:08.330122 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6256f00-f70d-46cf-8c4c-0fee83292a61 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:08.390884 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0961128e-077f-42ba-a19d-3185509983a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:08.391594 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961128e-077f-42ba-a19d-3185509983a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:08.391884 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961128e-077f-42ba-a19d-3185509983a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:08.392161 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0961128e-077f-42ba-a19d-3185509983a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:08.393031 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961128e-077f-42ba-a19d-3185509983a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:08.394795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0961128e-077f-42ba-a19d-3185509983a7 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:08.409220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1024/2052] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:08.410603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa8504-8a7d-40ca-8de9-07ac99a42f02 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:08.422014 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa8504-8a7d-40ca-8de9-07ac99a42f02 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:08.426969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9720d-9ea7-4481-885e-0aa0b853aa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:08.427888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9720d-9ea7-4481-885e-0aa0b853aa83 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:08.428199 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9720d-9ea7-4481-885e-0aa0b853aa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:08.428491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9720d-9ea7-4481-885e-0aa0b853aa83 admin admin] PATH_INFO: `/v3/projects/a0043f8addfe46748a4485b3f4233a51/users/bf1bb551aa9745dfa2f2de00e1ffe6fe/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:08.430500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9720d-9ea7-4481-885e-0aa0b853aa83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0043f8addfe46748a4485b3f4233a51, user_id=bf1bb551aa9745dfa2f2de00e1ffe6fe, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:08.433875 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9720d-9ea7-4481-885e-0aa0b853aa83 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:08.440557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:08.445626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1029/2053] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:08 2022] PUT /identity/v3/projects/a0043f8addfe46748a4485b3f4233a51/users/bf1bb551aa9745dfa2f2de00e1ffe6fe/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:08.456538 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a613f-a43f-4d04-9780-7001c9f2d4d4 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:08.456918 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a613f-a43f-4d04-9780-7001c9f2d4d4 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:08.457094 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a613f-a43f-4d04-9780-7001c9f2d4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:08.479804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9720d-9ea7-4481-885e-0aa0b853aa83 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:08.481896 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b4c9720d-9ea7-4481-885e-0aa0b853aa83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:08.487501 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-6b3a613f-a43f-4d04-9780-7001c9f2d4d4 None None] MFA Rules not processed for user `bf1bb551aa9745dfa2f2de00e1ffe6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:08.488927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-6b3a613f-a43f-4d04-9780-7001c9f2d4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:08.554378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9720d-9ea7-4481-885e-0aa0b853aa83 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:08.559192 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fbead-1331-4ad8-8980-79b4870c5c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:08.560094 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fbead-1331-4ad8-8980-79b4870c5c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:08.560378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fbead-1331-4ad8-8980-79b4870c5c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:08.560657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fbead-1331-4ad8-8980-79b4870c5c9a admin admin] PATH_INFO: `/v3/projects/514c3502f40b42368ef1e397c56bcd4d` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:08.563556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1025/2054] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:52:08.563700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fbead-1331-4ad8-8980-79b4870c5c9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=514c3502f40b42368ef1e397c56bcd4d)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:08.563845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fbead-1331-4ad8-8980-79b4870c5c9a admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:08.572225 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a613f-a43f-4d04-9780-7001c9f2d4d4 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:08.574322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-6b3a613f-a43f-4d04-9780-7001c9f2d4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:08.631938 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a613f-a43f-4d04-9780-7001c9f2d4d4 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:08.636103 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef713a-d0fe-4541-971b-efcd97166934 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:08.636822 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef713a-d0fe-4541-971b-efcd97166934 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:08.637107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef713a-d0fe-4541-971b-efcd97166934 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:08.637384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef713a-d0fe-4541-971b-efcd97166934 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:08.646176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef713a-d0fe-4541-971b-efcd97166934 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:08.647635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef713a-d0fe-4541-971b-efcd97166934 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:08.657793 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1026/2055] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:08 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:52:08.719976 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7b2fbead-1331-4ad8-8980-79b4870c5c9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '514c3502f40b42368ef1e397c56bcd4d', 'request_id': 'req-7b2fbead-1331-4ad8-8980-79b4870c5c9a'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:08.809373 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7b2fbead-1331-4ad8-8980-79b4870c5c9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '514c3502f40b42368ef1e397c56bcd4d', 'request_id': 'req-7b2fbead-1331-4ad8-8980-79b4870c5c9a'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:08.815244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7b2fbead-1331-4ad8-8980-79b4870c5c9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '514c3502f40b42368ef1e397c56bcd4d', 'request_id': 'req-7b2fbead-1331-4ad8-8980-79b4870c5c9a'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:08.827827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7b2fbead-1331-4ad8-8980-79b4870c5c9a admin admin] The token cache is being invalidate because project 514c3502f40b42368ef1e397c56bcd4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:52:08.828119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7b2fbead-1331-4ad8-8980-79b4870c5c9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:08.828763 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7b2fbead-1331-4ad8-8980-79b4870c5c9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:08.830308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1030/2056] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:52:08 2022] DELETE /identity/v3/projects/514c3502f40b42368ef1e397c56bcd4d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:08.835502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dafeec-d823-44f6-9452-ef60e119e51d None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:08.835823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dafeec-d823-44f6-9452-ef60e119e51d None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:08.836173 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dafeec-d823-44f6-9452-ef60e119e51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:08.854794 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-32dafeec-d823-44f6-9452-ef60e119e51d None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:08.856025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-32dafeec-d823-44f6-9452-ef60e119e51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:08.885589 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354a1a8-02d0-4f7f-9f83-55ff79abf10d None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:08.885899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354a1a8-02d0-4f7f-9f83-55ff79abf10d None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:08.886181 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354a1a8-02d0-4f7f-9f83-55ff79abf10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:08.894820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:08.906056 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-4354a1a8-02d0-4f7f-9f83-55ff79abf10d None None] MFA Rules not processed for user `fa8b9968425f40189532fc5ca2daf5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:08.907281 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-4354a1a8-02d0-4f7f-9f83-55ff79abf10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:08.917980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1027/2057] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:08.925762 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031a7b9-d438-408f-95c9-60db0f692b87 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:08.926062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031a7b9-d438-408f-95c9-60db0f692b87 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:08.926342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031a7b9-d438-408f-95c9-60db0f692b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:08.944514 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-2031a7b9-d438-408f-95c9-60db0f692b87 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:08.945783 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2031a7b9-d438-408f-95c9-60db0f692b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:08.954242 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1028/2058] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:52:08.959799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031a7b9-d438-408f-95c9-60db0f692b87 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:08.962317 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1031/2059] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:08.970216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031a7b9-d438-408f-95c9-60db0f692b87 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:08.974951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e8652-e94e-4bcb-b67d-63fb7fa02083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:08.975668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e8652-e94e-4bcb-b67d-63fb7fa02083 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:08.975957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e8652-e94e-4bcb-b67d-63fb7fa02083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:08.976519 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e8652-e94e-4bcb-b67d-63fb7fa02083 admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:08.977203 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e8652-e94e-4bcb-b67d-63fb7fa02083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:52:08.977511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e8652-e94e-4bcb-b67d-63fb7fa02083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:08.979130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e8652-e94e-4bcb-b67d-63fb7fa02083 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:08.991200 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1029/2060] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:52:08.997609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354a1a8-02d0-4f7f-9f83-55ff79abf10d None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:09.018629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4354a1a8-02d0-4f7f-9f83-55ff79abf10d None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:09.026107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cca1d6-51b2-4aa4-88a2-f3bccff76f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:09.026107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cca1d6-51b2-4aa4-88a2-f3bccff76f0e admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:09.026107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cca1d6-51b2-4aa4-88a2-f3bccff76f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:09.026107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cca1d6-51b2-4aa4-88a2-f3bccff76f0e admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:09.026465 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cca1d6-51b2-4aa4-88a2-f3bccff76f0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:09.028089 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cca1d6-51b2-4aa4-88a2-f3bccff76f0e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:09.136412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1032/2061] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:52:08 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:09.136778 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e8652-e94e-4bcb-b67d-63fb7fa02083 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:09.148082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e8652-e94e-4bcb-b67d-63fb7fa02083 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:09.214874 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14483b5-e11e-484e-a80c-216cb4da300e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:09.215599 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14483b5-e11e-484e-a80c-216cb4da300e admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:09.215891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14483b5-e11e-484e-a80c-216cb4da300e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:09.216173 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14483b5-e11e-484e-a80c-216cb4da300e admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:09.216865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14483b5-e11e-484e-a80c-216cb4da300e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:09.218779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14483b5-e11e-484e-a80c-216cb4da300e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:09.330331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1030/2062] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:52:09 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:09.334196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cca1d6-51b2-4aa4-88a2-f3bccff76f0e admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:09.345550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cca1d6-51b2-4aa4-88a2-f3bccff76f0e admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:09.351137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bdebe-6535-44f6-b61a-ae4fdb950405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:09.352337 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bdebe-6535-44f6-b61a-ae4fdb950405 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:09.352628 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bdebe-6535-44f6-b61a-ae4fdb950405 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:09.356163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3bdebe-6535-44f6-b61a-ae4fdb950405 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:09.356163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bdebe-6535-44f6-b61a-ae4fdb950405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:09.356715 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3bdebe-6535-44f6-b61a-ae4fdb950405 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:09.372085 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1033/2063] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:09.373379 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14483b5-e11e-484e-a80c-216cb4da300e admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:09.390610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14483b5-e11e-484e-a80c-216cb4da300e admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:09.394081 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d7a42-f8c1-49d5-a450-3e873665bc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:09.395091 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7a42-f8c1-49d5-a450-3e873665bc6d admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:09.395382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7a42-f8c1-49d5-a450-3e873665bc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:09.395707 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7a42-f8c1-49d5-a450-3e873665bc6d admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:09.396450 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d7a42-f8c1-49d5-a450-3e873665bc6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:09.398387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d7a42-f8c1-49d5-a450-3e873665bc6d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:09.421249 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1031/2064] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:09.424894 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bdebe-6535-44f6-b61a-ae4fdb950405 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:09.438026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3bdebe-6535-44f6-b61a-ae4fdb950405 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:09.442891 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4df232-5c35-46da-8073-ebb7aa8f503d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:09.443949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4df232-5c35-46da-8073-ebb7aa8f503d admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:09.444232 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4df232-5c35-46da-8073-ebb7aa8f503d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:09.444512 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4df232-5c35-46da-8073-ebb7aa8f503d admin admin] PATH_INFO: `/v3/projects/1f1a0be2847d45a78f690fcd36be1e23/users/007b69eaf06742c79d234a33f5a5462e/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:09.459726 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4df232-5c35-46da-8073-ebb7aa8f503d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1a0be2847d45a78f690fcd36be1e23, user_id=007b69eaf06742c79d234a33f5a5462e, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:09.462384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4df232-5c35-46da-8073-ebb7aa8f503d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:09.581039 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1034/2065] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:09 2022] PUT /identity/v3/projects/1f1a0be2847d45a78f690fcd36be1e23/users/007b69eaf06742c79d234a33f5a5462e/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:52:09.591837 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10411f9a-5115-4d5e-8575-3b1450fd0ad8 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:09.592502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10411f9a-5115-4d5e-8575-3b1450fd0ad8 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:09.593057 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10411f9a-5115-4d5e-8575-3b1450fd0ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:09.622131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-10411f9a-5115-4d5e-8575-3b1450fd0ad8 None None] MFA Rules not processed for user `007b69eaf06742c79d234a33f5a5462e`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:09.623346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-10411f9a-5115-4d5e-8575-3b1450fd0ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:09.700015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1032/2066] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:09.723597 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4df232-5c35-46da-8073-ebb7aa8f503d admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:09.728351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ca4df232-5c35-46da-8073-ebb7aa8f503d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:09.789026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4df232-5c35-46da-8073-ebb7aa8f503d admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:09.793561 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb26005-e615-43ca-9192-b0353f47a928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:09.794165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb26005-e615-43ca-9192-b0353f47a928 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:09.794456 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb26005-e615-43ca-9192-b0353f47a928 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:09.794724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb26005-e615-43ca-9192-b0353f47a928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:09.808322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb26005-e615-43ca-9192-b0353f47a928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:09.808620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb26005-e615-43ca-9192-b0353f47a928 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:09.819105 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1035/2067] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:52:10.066756 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:10.444179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:11.204550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:11.293341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:11.708036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b351a6a-4ee6-4057-b1dd-ca7461d6ad44 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:11.708346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b351a6a-4ee6-4057-b1dd-ca7461d6ad44 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:11.708679 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b351a6a-4ee6-4057-b1dd-ca7461d6ad44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:11.728148 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-5b351a6a-4ee6-4057-b1dd-ca7461d6ad44 None None] MFA Rules not processed for user `007b69eaf06742c79d234a33f5a5462e`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:11.729392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-5b351a6a-4ee6-4057-b1dd-ca7461d6ad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:11.737033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1033/2068] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:11.886761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb26005-e615-43ca-9192-b0353f47a928 service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:11.888370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-7bb26005-e615-43ca-9192-b0353f47a928 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:11.964260 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb26005-e615-43ca-9192-b0353f47a928 service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:11.968783 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecff51-6ac3-46d9-bbf2-821b0e40b8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:11.969658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecff51-6ac3-46d9-bbf2-821b0e40b8cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:11.969941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecff51-6ac3-46d9-bbf2-821b0e40b8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:11.970218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecff51-6ac3-46d9-bbf2-821b0e40b8cd admin admin] PATH_INFO: `/v3/users/5a682ccb638947a5b2eddb0f7765b7d8` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:11.971428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecff51-6ac3-46d9-bbf2-821b0e40b8cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a682ccb638947a5b2eddb0f7765b7d8)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:11.973417 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecff51-6ac3-46d9-bbf2-821b0e40b8cd admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:12.109672 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8eecff51-6ac3-46d9-bbf2-821b0e40b8cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a682ccb638947a5b2eddb0f7765b7d8'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:12.176502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8eecff51-6ac3-46d9-bbf2-821b0e40b8cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a682ccb638947a5b2eddb0f7765b7d8'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:12.191146 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8eecff51-6ac3-46d9-bbf2-821b0e40b8cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a682ccb638947a5b2eddb0f7765b7d8'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:12.191892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8eecff51-6ac3-46d9-bbf2-821b0e40b8cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a682ccb638947a5b2eddb0f7765b7d8'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:12.199911 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8eecff51-6ac3-46d9-bbf2-821b0e40b8cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a682ccb638947a5b2eddb0f7765b7d8'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:12.206690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1036/2069] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:52:11 2022] DELETE /identity/v3/users/5a682ccb638947a5b2eddb0f7765b7d8 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:52:12.211306 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44076aff-85e2-45ec-a201-58f7f1ce8430 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:12.211690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44076aff-85e2-45ec-a201-58f7f1ce8430 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:12.211970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44076aff-85e2-45ec-a201-58f7f1ce8430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:12.230280 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-44076aff-85e2-45ec-a201-58f7f1ce8430 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:12.231488 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-44076aff-85e2-45ec-a201-58f7f1ce8430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:12.301868 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1034/2070] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:12.312227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecff51-6ac3-46d9-bbf2-821b0e40b8cd admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:12.313771 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-8eecff51-6ac3-46d9-bbf2-821b0e40b8cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:12.388666 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:12.419830 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecff51-6ac3-46d9-bbf2-821b0e40b8cd admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:12.425600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c5059-1be7-487d-9d9d-ebf21b17c1f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:12.426489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c5059-1be7-487d-9d9d-ebf21b17c1f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:12.426803 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c5059-1be7-487d-9d9d-ebf21b17c1f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:12.427187 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c5059-1be7-487d-9d9d-ebf21b17c1f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:12.444173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c5059-1be7-487d-9d9d-ebf21b17c1f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:12.445049 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c5059-1be7-487d-9d9d-ebf21b17c1f7 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:12.485659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1037/2071] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:52:12.497355 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:13.035414 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44076aff-85e2-45ec-a201-58f7f1ce8430 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:13.037198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-44076aff-85e2-45ec-a201-58f7f1ce8430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:13.049939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44076aff-85e2-45ec-a201-58f7f1ce8430 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:13.062680 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ff816-ec4d-4107-9e94-a77987829087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:13.064836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ff816-ec4d-4107-9e94-a77987829087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:13.064836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ff816-ec4d-4107-9e94-a77987829087 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:13.064836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ff816-ec4d-4107-9e94-a77987829087 admin admin] PATH_INFO: `/v3/projects/6fab4b7cf6e945e38a4a8135e92fd461` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:13.066126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ff816-ec4d-4107-9e94-a77987829087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fab4b7cf6e945e38a4a8135e92fd461)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:13.068290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ff816-ec4d-4107-9e94-a77987829087 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:13.187068 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-426ff816-ec4d-4107-9e94-a77987829087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fab4b7cf6e945e38a4a8135e92fd461', 'request_id': 'req-426ff816-ec4d-4107-9e94-a77987829087'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:13.194658 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-426ff816-ec4d-4107-9e94-a77987829087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fab4b7cf6e945e38a4a8135e92fd461', 'request_id': 'req-426ff816-ec4d-4107-9e94-a77987829087'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:13.262074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-426ff816-ec4d-4107-9e94-a77987829087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fab4b7cf6e945e38a4a8135e92fd461', 'request_id': 'req-426ff816-ec4d-4107-9e94-a77987829087'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:13.278736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-426ff816-ec4d-4107-9e94-a77987829087 admin admin] The token cache is being invalidate because project 6fab4b7cf6e945e38a4a8135e92fd461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:52:13.279121 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-426ff816-ec4d-4107-9e94-a77987829087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:13.280002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-426ff816-ec4d-4107-9e94-a77987829087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:13.282218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1035/2072] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:52:13 2022] DELETE /identity/v3/projects/6fab4b7cf6e945e38a4a8135e92fd461 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:13.287350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c5059-1be7-487d-9d9d-ebf21b17c1f7 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:13.301858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c5059-1be7-487d-9d9d-ebf21b17c1f7 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:13.361199 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd36f6-754f-491c-9704-b01d9942e7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:13.362066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd36f6-754f-491c-9704-b01d9942e7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:13.362352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd36f6-754f-491c-9704-b01d9942e7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:13.362629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd36f6-754f-491c-9704-b01d9942e7ff admin admin] PATH_INFO: `/v3/users/bf1bb551aa9745dfa2f2de00e1ffe6fe` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:13.363910 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd36f6-754f-491c-9704-b01d9942e7ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf1bb551aa9745dfa2f2de00e1ffe6fe)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:13.365961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd36f6-754f-491c-9704-b01d9942e7ff admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:13.491203 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:13.662966 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-effd36f6-754f-491c-9704-b01d9942e7ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf1bb551aa9745dfa2f2de00e1ffe6fe'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:13.756445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-effd36f6-754f-491c-9704-b01d9942e7ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf1bb551aa9745dfa2f2de00e1ffe6fe'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:13.770686 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:13.785643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-effd36f6-754f-491c-9704-b01d9942e7ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf1bb551aa9745dfa2f2de00e1ffe6fe'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:13.786418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-effd36f6-754f-491c-9704-b01d9942e7ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf1bb551aa9745dfa2f2de00e1ffe6fe'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:13.794052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-effd36f6-754f-491c-9704-b01d9942e7ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf1bb551aa9745dfa2f2de00e1ffe6fe'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:13.800414 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1038/2073] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:52:13 2022] DELETE /identity/v3/users/bf1bb551aa9745dfa2f2de00e1ffe6fe => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:52:14.390243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ff816-ec4d-4107-9e94-a77987829087 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:14.390513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-426ff816-ec4d-4107-9e94-a77987829087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:14.409909 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ff816-ec4d-4107-9e94-a77987829087 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:14.480228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17d27d-8d74-4443-9d6a-e7b0bca4c833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:14.480638 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17d27d-8d74-4443-9d6a-e7b0bca4c833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:14.481232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17d27d-8d74-4443-9d6a-e7b0bca4c833 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:14.481667 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17d27d-8d74-4443-9d6a-e7b0bca4c833 admin admin] PATH_INFO: `/v3/projects/a0043f8addfe46748a4485b3f4233a51` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:14.486209 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17d27d-8d74-4443-9d6a-e7b0bca4c833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0043f8addfe46748a4485b3f4233a51)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:14.488634 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17d27d-8d74-4443-9d6a-e7b0bca4c833 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:14.653808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bb17d27d-8d74-4443-9d6a-e7b0bca4c833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0043f8addfe46748a4485b3f4233a51', 'request_id': 'req-bb17d27d-8d74-4443-9d6a-e7b0bca4c833'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:14.659845 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bb17d27d-8d74-4443-9d6a-e7b0bca4c833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0043f8addfe46748a4485b3f4233a51', 'request_id': 'req-bb17d27d-8d74-4443-9d6a-e7b0bca4c833'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:14.734831 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bb17d27d-8d74-4443-9d6a-e7b0bca4c833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0043f8addfe46748a4485b3f4233a51', 'request_id': 'req-bb17d27d-8d74-4443-9d6a-e7b0bca4c833'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:14.746168 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bb17d27d-8d74-4443-9d6a-e7b0bca4c833 admin admin] The token cache is being invalidate because project a0043f8addfe46748a4485b3f4233a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:52:14.746459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bb17d27d-8d74-4443-9d6a-e7b0bca4c833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:14.747080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bb17d27d-8d74-4443-9d6a-e7b0bca4c833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:14.748648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1036/2074] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:52:14 2022] DELETE /identity/v3/projects/a0043f8addfe46748a4485b3f4233a51 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:14.753529 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78266ab5-f5d5-4719-80e4-171559dce928 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:14.754029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78266ab5-f5d5-4719-80e4-171559dce928 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:14.754126 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78266ab5-f5d5-4719-80e4-171559dce928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:14.772066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-78266ab5-f5d5-4719-80e4-171559dce928 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:14.773269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-78266ab5-f5d5-4719-80e4-171559dce928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:14.781396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:14.837488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1039/2075] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:14.846172 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d3b9d-598e-460f-8d1a-a87d92912be7 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:14.846501 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d3b9d-598e-460f-8d1a-a87d92912be7 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:14.846782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d3b9d-598e-460f-8d1a-a87d92912be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:14.866595 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-5d4d3b9d-598e-460f-8d1a-a87d92912be7 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:14.868600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-5d4d3b9d-598e-460f-8d1a-a87d92912be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:14.877622 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1037/2076] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:14.881691 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78266ab5-f5d5-4719-80e4-171559dce928 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:14.893934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78266ab5-f5d5-4719-80e4-171559dce928 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:14.899187 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797c52d-f008-4fa9-a218-eb153d2ac33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:14.899948 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797c52d-f008-4fa9-a218-eb153d2ac33a admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:14.900350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797c52d-f008-4fa9-a218-eb153d2ac33a admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:14.901274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797c52d-f008-4fa9-a218-eb153d2ac33a admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:14.901986 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797c52d-f008-4fa9-a218-eb153d2ac33a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:52:14.902296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797c52d-f008-4fa9-a218-eb153d2ac33a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:14.904474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797c52d-f008-4fa9-a218-eb153d2ac33a admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:14.918025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1040/2077] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:52:14.924568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d3b9d-598e-460f-8d1a-a87d92912be7 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:14.933736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d3b9d-598e-460f-8d1a-a87d92912be7 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:14.938477 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27aece-f98d-4d75-b2b1-0740d8ad88fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:14.939112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27aece-f98d-4d75-b2b1-0740d8ad88fa admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:14.939399 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27aece-f98d-4d75-b2b1-0740d8ad88fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:14.939713 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27aece-f98d-4d75-b2b1-0740d8ad88fa admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:14.940925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27aece-f98d-4d75-b2b1-0740d8ad88fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:14.942391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27aece-f98d-4d75-b2b1-0740d8ad88fa admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:15.019850 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1038/2078] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:52:14 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:15.020971 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797c52d-f008-4fa9-a218-eb153d2ac33a admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:15.032438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797c52d-f008-4fa9-a218-eb153d2ac33a admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:15.110230 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e7da6-2ffb-4659-9ee2-332a8504c00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:15.111308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e7da6-2ffb-4659-9ee2-332a8504c00c admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:15.111308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e7da6-2ffb-4659-9ee2-332a8504c00c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:15.111643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e7da6-2ffb-4659-9ee2-332a8504c00c admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:15.114082 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e7da6-2ffb-4659-9ee2-332a8504c00c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:15.115921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817e7da6-2ffb-4659-9ee2-332a8504c00c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:15.152998 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:15.206719 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1041/2079] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:52:15 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:15.211789 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27aece-f98d-4d75-b2b1-0740d8ad88fa admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:15.229025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27aece-f98d-4d75-b2b1-0740d8ad88fa admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:15.234138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589d4a6-8864-4b8a-b49d-7c611e0fae0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:15.234815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589d4a6-8864-4b8a-b49d-7c611e0fae0d admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:15.235103 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589d4a6-8864-4b8a-b49d-7c611e0fae0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:15.235386 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589d4a6-8864-4b8a-b49d-7c611e0fae0d admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:15.236176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589d4a6-8864-4b8a-b49d-7c611e0fae0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:15.237923 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589d4a6-8864-4b8a-b49d-7c611e0fae0d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:15.250977 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1039/2080] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:15.255001 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e7da6-2ffb-4659-9ee2-332a8504c00c admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:15.266807 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e7da6-2ffb-4659-9ee2-332a8504c00c admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:15.281427 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195afce-d364-4ed3-b82b-ece36923e5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:15.281427 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195afce-d364-4ed3-b82b-ece36923e5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:15.281721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195afce-d364-4ed3-b82b-ece36923e5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:15.282080 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195afce-d364-4ed3-b82b-ece36923e5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:15.283586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195afce-d364-4ed3-b82b-ece36923e5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:15.285796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195afce-d364-4ed3-b82b-ece36923e5a0 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:15.302700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1042/2081] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:15.308334 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589d4a6-8864-4b8a-b49d-7c611e0fae0d admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:15.325019 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589d4a6-8864-4b8a-b49d-7c611e0fae0d admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:15.338876 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842eed5-44d3-466d-bf78-4e50f64979f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:15.342089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842eed5-44d3-466d-bf78-4e50f64979f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:15.342504 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842eed5-44d3-466d-bf78-4e50f64979f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:15.342912 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842eed5-44d3-466d-bf78-4e50f64979f3 admin admin] PATH_INFO: `/v3/projects/8b470003533d4dcfa88e57257727bc85/users/2d8c0ad1bf4d4b5da8bec87b3ef7b944/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:15.370579 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842eed5-44d3-466d-bf78-4e50f64979f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b470003533d4dcfa88e57257727bc85, user_id=2d8c0ad1bf4d4b5da8bec87b3ef7b944, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:15.374442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842eed5-44d3-466d-bf78-4e50f64979f3 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:15.380749 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:15.485271 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1040/2082] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:15 2022] PUT /identity/v3/projects/8b470003533d4dcfa88e57257727bc85/users/2d8c0ad1bf4d4b5da8bec87b3ef7b944/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:52:15.497453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3f39b-d415-4c0e-aeab-b70d0aa76993 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:15.497734 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3f39b-d415-4c0e-aeab-b70d0aa76993 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:15.498026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3f39b-d415-4c0e-aeab-b70d0aa76993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:15.541910 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-91b3f39b-d415-4c0e-aeab-b70d0aa76993 None None] MFA Rules not processed for user `2d8c0ad1bf4d4b5da8bec87b3ef7b944`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:15.543392 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-91b3f39b-d415-4c0e-aeab-b70d0aa76993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:15.627339 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1043/2083] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:15.629026 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842eed5-44d3-466d-bf78-4e50f64979f3 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:15.697003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842eed5-44d3-466d-bf78-4e50f64979f3 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:15.703609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91bb7-335c-4ac5-873e-1ed173d9912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:15.704558 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91bb7-335c-4ac5-873e-1ed173d9912e admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:15.704846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91bb7-335c-4ac5-873e-1ed173d9912e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:15.707507 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91bb7-335c-4ac5-873e-1ed173d9912e admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:15.707507 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad91bb7-335c-4ac5-873e-1ed173d9912e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:15.708184 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad91bb7-335c-4ac5-873e-1ed173d9912e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:15.820948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1041/2084] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:52:15 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:15.825750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3f39b-d415-4c0e-aeab-b70d0aa76993 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:15.833820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:15.838205 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3f39b-d415-4c0e-aeab-b70d0aa76993 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:15.896726 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9a1ab-4b58-4717-9097-693b6a788fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:15.897405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9a1ab-4b58-4717-9097-693b6a788fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:15.897765 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9a1ab-4b58-4717-9097-693b6a788fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:15.898050 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9a1ab-4b58-4717-9097-693b6a788fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:15.898766 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9a1ab-4b58-4717-9097-693b6a788fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:15.900742 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9a1ab-4b58-4717-9097-693b6a788fe7 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:15.989485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1044/2085] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:52:15 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:15.990782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91bb7-335c-4ac5-873e-1ed173d9912e admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:16.001555 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91bb7-335c-4ac5-873e-1ed173d9912e admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:16.006187 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50220f5c-c8d4-4820-83c5-959327981a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:16.006847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50220f5c-c8d4-4820-83c5-959327981a9f admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:16.007129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50220f5c-c8d4-4820-83c5-959327981a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:16.007472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50220f5c-c8d4-4820-83c5-959327981a9f admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:16.008222 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50220f5c-c8d4-4820-83c5-959327981a9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:16.009811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50220f5c-c8d4-4820-83c5-959327981a9f admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:16.021571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1042/2086] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:16.025786 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9a1ab-4b58-4717-9097-693b6a788fe7 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:16.036154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9a1ab-4b58-4717-9097-693b6a788fe7 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:16.042440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcae29e-740f-4f04-ae2e-b90e4932a529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:16.043371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae29e-740f-4f04-ae2e-b90e4932a529 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:16.043768 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae29e-740f-4f04-ae2e-b90e4932a529 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:16.044101 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcae29e-740f-4f04-ae2e-b90e4932a529 admin admin] PATH_INFO: `/v3/projects/5d4f7410390c43dfb70bb3bef1e164d9/users/5614022afc554a74b781fe033684d55f/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:16.059679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcae29e-740f-4f04-ae2e-b90e4932a529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4f7410390c43dfb70bb3bef1e164d9, user_id=5614022afc554a74b781fe033684d55f, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:16.062603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcae29e-740f-4f04-ae2e-b90e4932a529 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:16.136984 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1045/2087] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:16 2022] PUT /identity/v3/projects/5d4f7410390c43dfb70bb3bef1e164d9/users/5614022afc554a74b781fe033684d55f/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:16.140915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50220f5c-c8d4-4820-83c5-959327981a9f admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:16.151268 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50220f5c-c8d4-4820-83c5-959327981a9f admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:16.198055 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:16.217593 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:16.221276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555c897-ff8d-4d68-9861-96b2099c099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:16.221995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555c897-ff8d-4d68-9861-96b2099c099a admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:16.222276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555c897-ff8d-4d68-9861-96b2099c099a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:16.222560 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555c897-ff8d-4d68-9861-96b2099c099a admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:16.223304 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555c897-ff8d-4d68-9861-96b2099c099a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:16.224966 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555c897-ff8d-4d68-9861-96b2099c099a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:16.237727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1043/2088] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:16.242279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcae29e-740f-4f04-ae2e-b90e4932a529 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:16.254186 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcae29e-740f-4f04-ae2e-b90e4932a529 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:16.259253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ff3cb-eb83-4df9-8167-19d883680514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:16.260312 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ff3cb-eb83-4df9-8167-19d883680514 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:16.260669 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ff3cb-eb83-4df9-8167-19d883680514 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:16.261024 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ff3cb-eb83-4df9-8167-19d883680514 admin admin] PATH_INFO: `/v3/projects/5d4f7410390c43dfb70bb3bef1e164d9/users/5614022afc554a74b781fe033684d55f/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:16.263099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ff3cb-eb83-4df9-8167-19d883680514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4f7410390c43dfb70bb3bef1e164d9, user_id=5614022afc554a74b781fe033684d55f, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:16.266270 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9ff3cb-eb83-4df9-8167-19d883680514 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:16.281850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1046/2089] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:16 2022] PUT /identity/v3/projects/5d4f7410390c43dfb70bb3bef1e164d9/users/5614022afc554a74b781fe033684d55f/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:16.293752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b5947-23bc-47d3-802e-ce72762ff983 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:16.294040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b5947-23bc-47d3-802e-ce72762ff983 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:16.294323 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b5947-23bc-47d3-802e-ce72762ff983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:16.329996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-564b5947-23bc-47d3-802e-ce72762ff983 None None] MFA Rules not processed for user `5614022afc554a74b781fe033684d55f`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:16.329996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-564b5947-23bc-47d3-802e-ce72762ff983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:16.400094 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1044/2090] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:16.413403 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ff3cb-eb83-4df9-8167-19d883680514 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:16.415189 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-8d9ff3cb-eb83-4df9-8167-19d883680514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:16.473890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9ff3cb-eb83-4df9-8167-19d883680514 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:16.478626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c30cc0-634f-46e3-9f76-5e3739386de2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:16.480314 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c30cc0-634f-46e3-9f76-5e3739386de2 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:16.480600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c30cc0-634f-46e3-9f76-5e3739386de2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:16.480877 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c30cc0-634f-46e3-9f76-5e3739386de2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:16.491581 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c30cc0-634f-46e3-9f76-5e3739386de2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:16.493051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c30cc0-634f-46e3-9f76-5e3739386de2 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:16.500696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:16.504202 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1047/2091] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:52:16.534993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:16.631908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:16.708364 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:17.125311 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:17.233753 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:17.564316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b5947-23bc-47d3-802e-ce72762ff983 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:17.574130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b5947-23bc-47d3-802e-ce72762ff983 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:17.579000 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f741d-81d3-43c9-ac0d-66bf9eb0424f tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5614022afc554a74b781fe033684d55f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d4f7410390c43dfb70bb3bef1e164d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:17.579703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f741d-81d3-43c9-ac0d-66bf9eb0424f tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:17.582085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f741d-81d3-43c9-ac0d-66bf9eb0424f tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:17.582085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f741d-81d3-43c9-ac0d-66bf9eb0424f tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:17.582085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f741d-81d3-43c9-ac0d-66bf9eb0424f tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:52:17.582085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f741d-81d3-43c9-ac0d-66bf9eb0424f tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:17.583045 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f741d-81d3-43c9-ac0d-66bf9eb0424f tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:17.594864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1045/2092] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:52:17.599268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c30cc0-634f-46e3-9f76-5e3739386de2 service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:17.608735 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c30cc0-634f-46e3-9f76-5e3739386de2 service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:17.614522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d3dd2-822f-4f74-bc50-54f9b3cb603d tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5614022afc554a74b781fe033684d55f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d4f7410390c43dfb70bb3bef1e164d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:17.615383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d3dd2-822f-4f74-bc50-54f9b3cb603d tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:17.615925 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d3dd2-822f-4f74-bc50-54f9b3cb603d tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:17.616385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d3dd2-822f-4f74-bc50-54f9b3cb603d tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:17.617328 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d3dd2-822f-4f74-bc50-54f9b3cb603d tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:17.622573 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d3dd2-822f-4f74-bc50-54f9b3cb603d tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:17.709663 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1048/2093] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:52:17 2022] POST /identity/v3/projects => generated 353 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:17.713498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f741d-81d3-43c9-ac0d-66bf9eb0424f tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:17.724011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f741d-81d3-43c9-ac0d-66bf9eb0424f tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:17.731490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:17.801129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee37c1e-8521-4ace-83b2-e6742e413c63 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5614022afc554a74b781fe033684d55f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d4f7410390c43dfb70bb3bef1e164d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:17.801952 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee37c1e-8521-4ace-83b2-e6742e413c63 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:17.802734 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee37c1e-8521-4ace-83b2-e6742e413c63 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:17.803129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee37c1e-8521-4ace-83b2-e6742e413c63 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:17.814963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee37c1e-8521-4ace-83b2-e6742e413c63 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:52:17.815582 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee37c1e-8521-4ace-83b2-e6742e413c63 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:17.817446 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee37c1e-8521-4ace-83b2-e6742e413c63 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:17.838239 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1046/2094] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:52:17.843246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:17.882000 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d3dd2-822f-4f74-bc50-54f9b3cb603d tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:17.895228 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d3dd2-822f-4f74-bc50-54f9b3cb603d tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:17.900000 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27096ce-ed4c-4082-8d8f-0ea86992f3e6 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5614022afc554a74b781fe033684d55f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d4f7410390c43dfb70bb3bef1e164d9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:17.900897 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27096ce-ed4c-4082-8d8f-0ea86992f3e6 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:17.901210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27096ce-ed4c-4082-8d8f-0ea86992f3e6 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:17.901490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27096ce-ed4c-4082-8d8f-0ea86992f3e6 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] PATH_INFO: `/v3/projects/3740ccc97cbe4e86b63b77567841d0f0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:17.903255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27096ce-ed4c-4082-8d8f-0ea86992f3e6 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3740ccc97cbe4e86b63b77567841d0f0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:17.905301 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27096ce-ed4c-4082-8d8f-0ea86992f3e6 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:18.015383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-b27096ce-ed4c-4082-8d8f-0ea86992f3e6 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3740ccc97cbe4e86b63b77567841d0f0', 'request_id': 'req-b27096ce-ed4c-4082-8d8f-0ea86992f3e6'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:18.071285 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-b27096ce-ed4c-4082-8d8f-0ea86992f3e6 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3740ccc97cbe4e86b63b77567841d0f0', 'request_id': 'req-b27096ce-ed4c-4082-8d8f-0ea86992f3e6'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:18.078046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-b27096ce-ed4c-4082-8d8f-0ea86992f3e6 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3740ccc97cbe4e86b63b77567841d0f0', 'request_id': 'req-b27096ce-ed4c-4082-8d8f-0ea86992f3e6'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:18.091345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-b27096ce-ed4c-4082-8d8f-0ea86992f3e6 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] The token cache is being invalidate because project 3740ccc97cbe4e86b63b77567841d0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:52:18.091671 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-b27096ce-ed4c-4082-8d8f-0ea86992f3e6 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:18.092402 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-b27096ce-ed4c-4082-8d8f-0ea86992f3e6 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:18.094001 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1049/2095] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:52:17 2022] DELETE /identity/v3/projects/3740ccc97cbe4e86b63b77567841d0f0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:18.125152 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:18.285269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:18.702769 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:18.871986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee37c1e-8521-4ace-83b2-e6742e413c63 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:18.873840 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-8ee37c1e-8521-4ace-83b2-e6742e413c63 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:18.945404 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee37c1e-8521-4ace-83b2-e6742e413c63 tempest-VolumeQuotaClassesTest-994523095 tempest-VolumeQuotaClassesTest-994523095-project-admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:19.013901 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12d7c2-b804-4b5c-b61c-22342ab35666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:19.018464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12d7c2-b804-4b5c-b61c-22342ab35666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:19.018464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12d7c2-b804-4b5c-b61c-22342ab35666 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:19.018464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12d7c2-b804-4b5c-b61c-22342ab35666 admin admin] PATH_INFO: `/v3/users/2d8c0ad1bf4d4b5da8bec87b3ef7b944` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:19.018464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12d7c2-b804-4b5c-b61c-22342ab35666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8c0ad1bf4d4b5da8bec87b3ef7b944)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:19.019525 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12d7c2-b804-4b5c-b61c-22342ab35666 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:19.124200 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:19.201217 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-4a12d7c2-b804-4b5c-b61c-22342ab35666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8c0ad1bf4d4b5da8bec87b3ef7b944'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:19.284901 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-4a12d7c2-b804-4b5c-b61c-22342ab35666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8c0ad1bf4d4b5da8bec87b3ef7b944'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:19.296296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:19.299273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-4a12d7c2-b804-4b5c-b61c-22342ab35666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8c0ad1bf4d4b5da8bec87b3ef7b944'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:19.306514 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-4a12d7c2-b804-4b5c-b61c-22342ab35666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8c0ad1bf4d4b5da8bec87b3ef7b944'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:19.307242 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-4a12d7c2-b804-4b5c-b61c-22342ab35666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8c0ad1bf4d4b5da8bec87b3ef7b944'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:19.313893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1047/2096] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:52:18 2022] DELETE /identity/v3/users/2d8c0ad1bf4d4b5da8bec87b3ef7b944 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:19.318521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2457f-0c4f-4ece-92da-95e5f1fa5645 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:19.318818 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2457f-0c4f-4ece-92da-95e5f1fa5645 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:19.319120 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2457f-0c4f-4ece-92da-95e5f1fa5645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:19.336389 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-e0f2457f-0c4f-4ece-92da-95e5f1fa5645 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:19.337590 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e0f2457f-0c4f-4ece-92da-95e5f1fa5645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:19.395622 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1050/2097] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:19.405860 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12d7c2-b804-4b5c-b61c-22342ab35666 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:19.409253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-4a12d7c2-b804-4b5c-b61c-22342ab35666 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:19.429269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:19.467751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12d7c2-b804-4b5c-b61c-22342ab35666 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:19.471741 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ad508-bfc1-440a-94ff-8ee9099d0ac2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:19.472392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ad508-bfc1-440a-94ff-8ee9099d0ac2 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:19.472676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ad508-bfc1-440a-94ff-8ee9099d0ac2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:19.472953 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ad508-bfc1-440a-94ff-8ee9099d0ac2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:19.483264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ad508-bfc1-440a-94ff-8ee9099d0ac2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:19.486051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ad508-bfc1-440a-94ff-8ee9099d0ac2 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:19.494410 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1048/2098] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:52:19.530967 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:19.599798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:19.799443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:20.046205 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2457f-0c4f-4ece-92da-95e5f1fa5645 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:20.047691 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e0f2457f-0c4f-4ece-92da-95e5f1fa5645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:20.058901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:20.061638 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2457f-0c4f-4ece-92da-95e5f1fa5645 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:20.066288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62202afa-c7b2-4e7c-9fe3-982c085f5184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:20.067149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62202afa-c7b2-4e7c-9fe3-982c085f5184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:20.067430 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62202afa-c7b2-4e7c-9fe3-982c085f5184 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:20.067743 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62202afa-c7b2-4e7c-9fe3-982c085f5184 admin admin] PATH_INFO: `/v3/projects/8b470003533d4dcfa88e57257727bc85` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:20.068946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62202afa-c7b2-4e7c-9fe3-982c085f5184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b470003533d4dcfa88e57257727bc85)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:20.070867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62202afa-c7b2-4e7c-9fe3-982c085f5184 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:20.192079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-62202afa-c7b2-4e7c-9fe3-982c085f5184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b470003533d4dcfa88e57257727bc85', 'request_id': 'req-62202afa-c7b2-4e7c-9fe3-982c085f5184'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:20.287056 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-62202afa-c7b2-4e7c-9fe3-982c085f5184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b470003533d4dcfa88e57257727bc85', 'request_id': 'req-62202afa-c7b2-4e7c-9fe3-982c085f5184'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:20.298757 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-62202afa-c7b2-4e7c-9fe3-982c085f5184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b470003533d4dcfa88e57257727bc85', 'request_id': 'req-62202afa-c7b2-4e7c-9fe3-982c085f5184'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:20.317698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-62202afa-c7b2-4e7c-9fe3-982c085f5184 admin admin] The token cache is being invalidate because project 8b470003533d4dcfa88e57257727bc85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:52:20.318098 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-62202afa-c7b2-4e7c-9fe3-982c085f5184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:20.319410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-62202afa-c7b2-4e7c-9fe3-982c085f5184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:20.321253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1051/2099] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:52:20 2022] DELETE /identity/v3/projects/8b470003533d4dcfa88e57257727bc85 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:20.334971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ad508-bfc1-440a-94ff-8ee9099d0ac2 service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:20.336021 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ad508-bfc1-440a-94ff-8ee9099d0ac2 service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:20.348782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:20.376321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:20.398508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efacfef-0f1b-4342-84ba-f098b02c4aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:20.399411 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efacfef-0f1b-4342-84ba-f098b02c4aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:20.399944 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efacfef-0f1b-4342-84ba-f098b02c4aad admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:20.400417 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efacfef-0f1b-4342-84ba-f098b02c4aad admin admin] PATH_INFO: `/v3/users/5614022afc554a74b781fe033684d55f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:20.402603 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efacfef-0f1b-4342-84ba-f098b02c4aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=5614022afc554a74b781fe033684d55f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:20.404584 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efacfef-0f1b-4342-84ba-f098b02c4aad admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:20.693037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8efacfef-0f1b-4342-84ba-f098b02c4aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5614022afc554a74b781fe033684d55f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:20.758746 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8efacfef-0f1b-4342-84ba-f098b02c4aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5614022afc554a74b781fe033684d55f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:20.772492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8efacfef-0f1b-4342-84ba-f098b02c4aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5614022afc554a74b781fe033684d55f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:20.780079 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8efacfef-0f1b-4342-84ba-f098b02c4aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5614022afc554a74b781fe033684d55f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:20.780725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8efacfef-0f1b-4342-84ba-f098b02c4aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5614022afc554a74b781fe033684d55f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:20.786487 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1049/2100] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:52:20 2022] DELETE /identity/v3/users/5614022afc554a74b781fe033684d55f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:20.793194 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:21.028340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:21.210147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62202afa-c7b2-4e7c-9fe3-982c085f5184 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:21.211649 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-62202afa-c7b2-4e7c-9fe3-982c085f5184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:21.225181 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62202afa-c7b2-4e7c-9fe3-982c085f5184 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:21.282884 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f04fb-7c2e-4efa-b1ef-d270a9481333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:21.283788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f04fb-7c2e-4efa-b1ef-d270a9481333 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:21.284074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f04fb-7c2e-4efa-b1ef-d270a9481333 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:21.284350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f04fb-7c2e-4efa-b1ef-d270a9481333 admin admin] PATH_INFO: `/v3/projects/5d4f7410390c43dfb70bb3bef1e164d9` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:21.285540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f04fb-7c2e-4efa-b1ef-d270a9481333 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4f7410390c43dfb70bb3bef1e164d9)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:21.287453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f04fb-7c2e-4efa-b1ef-d270a9481333 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:21.428246 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0b0f04fb-7c2e-4efa-b1ef-d270a9481333 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4f7410390c43dfb70bb3bef1e164d9', 'request_id': 'req-0b0f04fb-7c2e-4efa-b1ef-d270a9481333'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:21.534315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0b0f04fb-7c2e-4efa-b1ef-d270a9481333 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4f7410390c43dfb70bb3bef1e164d9', 'request_id': 'req-0b0f04fb-7c2e-4efa-b1ef-d270a9481333'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:21.547261 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0b0f04fb-7c2e-4efa-b1ef-d270a9481333 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4f7410390c43dfb70bb3bef1e164d9', 'request_id': 'req-0b0f04fb-7c2e-4efa-b1ef-d270a9481333'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:21.569804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0b0f04fb-7c2e-4efa-b1ef-d270a9481333 admin admin] The token cache is being invalidate because project 5d4f7410390c43dfb70bb3bef1e164d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:52:21.570321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0b0f04fb-7c2e-4efa-b1ef-d270a9481333 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:21.571132 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0b0f04fb-7c2e-4efa-b1ef-d270a9481333 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:21.575827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1052/2101] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:52:21 2022] DELETE /identity/v3/projects/5d4f7410390c43dfb70bb3bef1e164d9 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:21.580989 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be94f6-a3a7-4167-898a-524ef6bf10d8 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:21.581506 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be94f6-a3a7-4167-898a-524ef6bf10d8 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:21.581605 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be94f6-a3a7-4167-898a-524ef6bf10d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:21.606184 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-a3be94f6-a3a7-4167-898a-524ef6bf10d8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:21.607581 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a3be94f6-a3a7-4167-898a-524ef6bf10d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:21.686656 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1050/2102] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:21.700656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700281a-1203-4e83-8f33-1487e7de26db None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:21.701202 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700281a-1203-4e83-8f33-1487e7de26db None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:21.701643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700281a-1203-4e83-8f33-1487e7de26db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:21.737392 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-3700281a-1203-4e83-8f33-1487e7de26db None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:21.738687 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3700281a-1203-4e83-8f33-1487e7de26db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:21.749258 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1053/2103] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:21.753310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be94f6-a3a7-4167-898a-524ef6bf10d8 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:21.770753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be94f6-a3a7-4167-898a-524ef6bf10d8 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:21.775465 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c9f5b-048b-4d30-a06f-cde5700e3bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:21.776672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c9f5b-048b-4d30-a06f-cde5700e3bbe admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:21.776954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c9f5b-048b-4d30-a06f-cde5700e3bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:21.777226 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c9f5b-048b-4d30-a06f-cde5700e3bbe admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:21.777955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c9f5b-048b-4d30-a06f-cde5700e3bbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:52:21.778259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c9f5b-048b-4d30-a06f-cde5700e3bbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:21.780129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c9f5b-048b-4d30-a06f-cde5700e3bbe admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:21.795586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1051/2104] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:52:21.797915 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700281a-1203-4e83-8f33-1487e7de26db None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:21.807879 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700281a-1203-4e83-8f33-1487e7de26db None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:21.813506 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6525a88-fdff-4ad8-aa51-cebc0746ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:21.814263 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6525a88-fdff-4ad8-aa51-cebc0746ee91 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:21.814646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6525a88-fdff-4ad8-aa51-cebc0746ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:21.815029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6525a88-fdff-4ad8-aa51-cebc0746ee91 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:21.815960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6525a88-fdff-4ad8-aa51-cebc0746ee91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:21.818208 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6525a88-fdff-4ad8-aa51-cebc0746ee91 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:21.920844 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:21.927340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1054/2105] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:52:21 2022] POST /identity/v3/projects => generated 389 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:21.931416 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c9f5b-048b-4d30-a06f-cde5700e3bbe admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:21.941940 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c9f5b-048b-4d30-a06f-cde5700e3bbe admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:22.001358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df69665-60ff-445e-8ce0-1b3486534c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:22.002039 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df69665-60ff-445e-8ce0-1b3486534c73 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:22.002313 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df69665-60ff-445e-8ce0-1b3486534c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:22.002590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df69665-60ff-445e-8ce0-1b3486534c73 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:22.003286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df69665-60ff-445e-8ce0-1b3486534c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:22.005453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df69665-60ff-445e-8ce0-1b3486534c73 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:22.125157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1052/2106] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:52:21 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:22.129230 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6525a88-fdff-4ad8-aa51-cebc0746ee91 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:22.139686 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6525a88-fdff-4ad8-aa51-cebc0746ee91 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:22.142263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:22.144315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3145631-1fa8-406d-8332-fe0ed39ef0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:22.147454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3145631-1fa8-406d-8332-fe0ed39ef0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:22.147454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3145631-1fa8-406d-8332-fe0ed39ef0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:22.147454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3145631-1fa8-406d-8332-fe0ed39ef0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:22.147454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3145631-1fa8-406d-8332-fe0ed39ef0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:22.147866 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3145631-1fa8-406d-8332-fe0ed39ef0a9 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:22.160114 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1055/2107] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:22.164320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df69665-60ff-445e-8ce0-1b3486534c73 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:22.174454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df69665-60ff-445e-8ce0-1b3486534c73 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:22.179063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d88a9-3798-4b10-961e-c66e7b51137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:22.179754 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d88a9-3798-4b10-961e-c66e7b51137f admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:22.180044 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d88a9-3798-4b10-961e-c66e7b51137f admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:22.180321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d88a9-3798-4b10-961e-c66e7b51137f admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:22.181050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d88a9-3798-4b10-961e-c66e7b51137f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:22.182716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d88a9-3798-4b10-961e-c66e7b51137f admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:22.192982 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1053/2108] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:22.197060 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3145631-1fa8-406d-8332-fe0ed39ef0a9 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:22.207993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3145631-1fa8-406d-8332-fe0ed39ef0a9 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:22.214782 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b408928-da63-4cbf-ade6-73e70d9ade79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:22.215751 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408928-da63-4cbf-ade6-73e70d9ade79 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:22.216202 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408928-da63-4cbf-ade6-73e70d9ade79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:22.216503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b408928-da63-4cbf-ade6-73e70d9ade79 admin admin] PATH_INFO: `/v3/projects/2b8d6728048f4ee38c43569a2d69f97e/users/4308f87926794843ac0750ec83658382/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:22.233912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b408928-da63-4cbf-ade6-73e70d9ade79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8d6728048f4ee38c43569a2d69f97e, user_id=4308f87926794843ac0750ec83658382, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:22.237236 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b408928-da63-4cbf-ade6-73e70d9ade79 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:22.326077 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1056/2109] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:22 2022] PUT /identity/v3/projects/2b8d6728048f4ee38c43569a2d69f97e/users/4308f87926794843ac0750ec83658382/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:52:22.336512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5c6a-0687-429d-8108-27e8e767c3e1 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:22.336851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5c6a-0687-429d-8108-27e8e767c3e1 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:22.337136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e5c6a-0687-429d-8108-27e8e767c3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:22.363015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-5f9e5c6a-0687-429d-8108-27e8e767c3e1 None None] MFA Rules not processed for user `4308f87926794843ac0750ec83658382`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:22.364264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-5f9e5c6a-0687-429d-8108-27e8e767c3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:22.430319 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1054/2110] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:22.435206 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b408928-da63-4cbf-ade6-73e70d9ade79 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:22.500533 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b408928-da63-4cbf-ade6-73e70d9ade79 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:22.505194 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27413fc4-7469-4ac5-a162-1af701947904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:22.505848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27413fc4-7469-4ac5-a162-1af701947904 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:22.506134 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27413fc4-7469-4ac5-a162-1af701947904 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:22.506413 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27413fc4-7469-4ac5-a162-1af701947904 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:22.507114 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27413fc4-7469-4ac5-a162-1af701947904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:22.509068 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27413fc4-7469-4ac5-a162-1af701947904 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:22.620662 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1057/2111] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:52:22 2022] POST /identity/v3/projects => generated 389 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:22.624788 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5c6a-0687-429d-8108-27e8e767c3e1 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:22.636334 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9e5c6a-0687-429d-8108-27e8e767c3e1 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:22.692537 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daf4fd-e970-44b7-90aa-bf637bd46a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:22.693264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daf4fd-e970-44b7-90aa-bf637bd46a49 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:22.693552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daf4fd-e970-44b7-90aa-bf637bd46a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:22.693858 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daf4fd-e970-44b7-90aa-bf637bd46a49 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:22.694593 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2daf4fd-e970-44b7-90aa-bf637bd46a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:22.696560 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2daf4fd-e970-44b7-90aa-bf637bd46a49 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:22.792748 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1055/2112] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:52:22 2022] POST /identity/v3/users => generated 301 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:22.796715 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27413fc4-7469-4ac5-a162-1af701947904 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:22.807961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27413fc4-7469-4ac5-a162-1af701947904 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:22.812759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af63a7-6639-4e02-805b-a1fc29e14f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:22.813501 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af63a7-6639-4e02-805b-a1fc29e14f1c admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:22.813776 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af63a7-6639-4e02-805b-a1fc29e14f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:22.814058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57af63a7-6639-4e02-805b-a1fc29e14f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:22.814784 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af63a7-6639-4e02-805b-a1fc29e14f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:22.816454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57af63a7-6639-4e02-805b-a1fc29e14f1c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:22.827870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1058/2113] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:22.832188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daf4fd-e970-44b7-90aa-bf637bd46a49 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:22.842919 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daf4fd-e970-44b7-90aa-bf637bd46a49 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:22.847503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b86624-bcb0-4c59-93a3-bec68a72a7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:22.850702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b86624-bcb0-4c59-93a3-bec68a72a7bb admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:22.850702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b86624-bcb0-4c59-93a3-bec68a72a7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:22.850702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b86624-bcb0-4c59-93a3-bec68a72a7bb admin admin] PATH_INFO: `/v3/projects/9eced9c56f284ecfac67433453dd54a1/users/0192d3ce109445799cf3276f4fff3255/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:22.864995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b86624-bcb0-4c59-93a3-bec68a72a7bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eced9c56f284ecfac67433453dd54a1, user_id=0192d3ce109445799cf3276f4fff3255, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:22.867844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b86624-bcb0-4c59-93a3-bec68a72a7bb admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:22.942775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1056/2114] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:22 2022] PUT /identity/v3/projects/9eced9c56f284ecfac67433453dd54a1/users/0192d3ce109445799cf3276f4fff3255/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:22.946403 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af63a7-6639-4e02-805b-a1fc29e14f1c admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:22.956380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57af63a7-6639-4e02-805b-a1fc29e14f1c admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:23.014491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17111a30-8ac7-4efe-a1b9-3343bbcbf25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:23.015078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17111a30-8ac7-4efe-a1b9-3343bbcbf25b admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:23.015860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17111a30-8ac7-4efe-a1b9-3343bbcbf25b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:23.016145 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17111a30-8ac7-4efe-a1b9-3343bbcbf25b admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:23.016870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17111a30-8ac7-4efe-a1b9-3343bbcbf25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:23.018474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17111a30-8ac7-4efe-a1b9-3343bbcbf25b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:23.029210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1059/2115] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:23.033370 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b86624-bcb0-4c59-93a3-bec68a72a7bb admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:23.043963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b86624-bcb0-4c59-93a3-bec68a72a7bb admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:23.049003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983eb889-505a-4912-8af3-09c5b77fbcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:23.049924 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eb889-505a-4912-8af3-09c5b77fbcf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:23.050220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eb889-505a-4912-8af3-09c5b77fbcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:23.050486 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eb889-505a-4912-8af3-09c5b77fbcf2 admin admin] PATH_INFO: `/v3/projects/9eced9c56f284ecfac67433453dd54a1/users/0192d3ce109445799cf3276f4fff3255/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:23.052584 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983eb889-505a-4912-8af3-09c5b77fbcf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eced9c56f284ecfac67433453dd54a1, user_id=0192d3ce109445799cf3276f4fff3255, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:23.055243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983eb889-505a-4912-8af3-09c5b77fbcf2 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:23.067436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1057/2116] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:23 2022] PUT /identity/v3/projects/9eced9c56f284ecfac67433453dd54a1/users/0192d3ce109445799cf3276f4fff3255/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:23.076652 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e172a20-3db0-44d7-9596-039b8ab2af01 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:23.076945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e172a20-3db0-44d7-9596-039b8ab2af01 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:23.077229 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e172a20-3db0-44d7-9596-039b8ab2af01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:23.104785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-0e172a20-3db0-44d7-9596-039b8ab2af01 None None] MFA Rules not processed for user `0192d3ce109445799cf3276f4fff3255`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:23.106001 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0e172a20-3db0-44d7-9596-039b8ab2af01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:23.173571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1060/2117] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:23.184400 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983eb889-505a-4912-8af3-09c5b77fbcf2 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:23.186105 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-983eb889-505a-4912-8af3-09c5b77fbcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:23.244768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983eb889-505a-4912-8af3-09c5b77fbcf2 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:23.248469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e6eb7-19f1-4332-ad24-521513288b24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:23.249162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e6eb7-19f1-4332-ad24-521513288b24 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:23.249446 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e6eb7-19f1-4332-ad24-521513288b24 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:23.249723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e6eb7-19f1-4332-ad24-521513288b24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:23.258592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e6eb7-19f1-4332-ad24-521513288b24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:23.260104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e6eb7-19f1-4332-ad24-521513288b24 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:23.269649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1058/2118] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:52:23.406142 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e172a20-3db0-44d7-9596-039b8ab2af01 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:23.467695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e172a20-3db0-44d7-9596-039b8ab2af01 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:23.472732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f9f04-30a5-42d2-aef5-7a2ac398b7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:23.474802 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f9f04-30a5-42d2-aef5-7a2ac398b7de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:23.475092 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f9f04-30a5-42d2-aef5-7a2ac398b7de admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:23.475370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f9f04-30a5-42d2-aef5-7a2ac398b7de admin admin] PATH_INFO: `/v3/users/4308f87926794843ac0750ec83658382` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:23.477103 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f9f04-30a5-42d2-aef5-7a2ac398b7de admin admin] RBAC: Authorizing `identity:delete_user(user_id=4308f87926794843ac0750ec83658382)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:23.479341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794f9f04-30a5-42d2-aef5-7a2ac398b7de admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:23.507460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:23.656424 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:23.659394 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-794f9f04-30a5-42d2-aef5-7a2ac398b7de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4308f87926794843ac0750ec83658382'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:23.731977 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-794f9f04-30a5-42d2-aef5-7a2ac398b7de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4308f87926794843ac0750ec83658382'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:23.750552 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-794f9f04-30a5-42d2-aef5-7a2ac398b7de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4308f87926794843ac0750ec83658382'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:23.751276 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-794f9f04-30a5-42d2-aef5-7a2ac398b7de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4308f87926794843ac0750ec83658382'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:23.761740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-794f9f04-30a5-42d2-aef5-7a2ac398b7de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4308f87926794843ac0750ec83658382'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:23.768376 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1061/2119] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:52:23 2022] DELETE /identity/v3/users/4308f87926794843ac0750ec83658382 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:23.772719 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4b2f7-c11c-43bd-853e-6005a0234a17 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:23.773013 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4b2f7-c11c-43bd-853e-6005a0234a17 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:23.773296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4b2f7-c11c-43bd-853e-6005a0234a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:23.810928 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-fad4b2f7-c11c-43bd-853e-6005a0234a17 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:23.812214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-fad4b2f7-c11c-43bd-853e-6005a0234a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:23.878362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1059/2120] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:52:23.890394 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f9f04-30a5-42d2-aef5-7a2ac398b7de admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:23.892116 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-794f9f04-30a5-42d2-aef5-7a2ac398b7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:23.956839 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f9f04-30a5-42d2-aef5-7a2ac398b7de admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:23.960606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d54b6-9825-4815-aa37-3e8897e351ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:23.961268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d54b6-9825-4815-aa37-3e8897e351ee service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:23.961557 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d54b6-9825-4815-aa37-3e8897e351ee service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:23.961841 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d54b6-9825-4815-aa37-3e8897e351ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:23.971706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d54b6-9825-4815-aa37-3e8897e351ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:23.973167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d54b6-9825-4815-aa37-3e8897e351ee service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:23.983979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1062/2121] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:52:24.457588 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4b2f7-c11c-43bd-853e-6005a0234a17 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:24.459164 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-fad4b2f7-c11c-43bd-853e-6005a0234a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:24.472246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4b2f7-c11c-43bd-853e-6005a0234a17 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:24.477664 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:24.478542 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:24.479742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:24.485624 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04 admin admin] PATH_INFO: `/v3/projects/2b8d6728048f4ee38c43569a2d69f97e` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:24.485624 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b8d6728048f4ee38c43569a2d69f97e)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:24.485624 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:24.648873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b8d6728048f4ee38c43569a2d69f97e', 'request_id': 'req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:24.655449 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b8d6728048f4ee38c43569a2d69f97e', 'request_id': 'req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:24.665617 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:24.743242 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b8d6728048f4ee38c43569a2d69f97e', 'request_id': 'req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:24.752905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04 admin admin] The token cache is being invalidate because project 2b8d6728048f4ee38c43569a2d69f97e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:52:24.753307 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:24.754065 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:24.758673 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1060/2122] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:52:24 2022] DELETE /identity/v3/projects/2b8d6728048f4ee38c43569a2d69f97e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:24.760529 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d54b6-9825-4815-aa37-3e8897e351ee service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:24.770451 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d54b6-9825-4815-aa37-3e8897e351ee service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:24.825321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96266e5e-b22d-4036-93b8-40f760928d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:24.826190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96266e5e-b22d-4036-93b8-40f760928d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:24.826475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96266e5e-b22d-4036-93b8-40f760928d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:24.826757 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96266e5e-b22d-4036-93b8-40f760928d7b admin admin] PATH_INFO: `/v3/users/0192d3ce109445799cf3276f4fff3255` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:24.827980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96266e5e-b22d-4036-93b8-40f760928d7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0192d3ce109445799cf3276f4fff3255)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:24.829946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96266e5e-b22d-4036-93b8-40f760928d7b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:24.833589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:24.977446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-96266e5e-b22d-4036-93b8-40f760928d7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0192d3ce109445799cf3276f4fff3255'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:25.043369 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-96266e5e-b22d-4036-93b8-40f760928d7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0192d3ce109445799cf3276f4fff3255'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:25.056309 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-96266e5e-b22d-4036-93b8-40f760928d7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0192d3ce109445799cf3276f4fff3255'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:25.057635 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-96266e5e-b22d-4036-93b8-40f760928d7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0192d3ce109445799cf3276f4fff3255'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:25.064531 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-96266e5e-b22d-4036-93b8-40f760928d7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0192d3ce109445799cf3276f4fff3255'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:25.070770 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1063/2123] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:52:24 2022] DELETE /identity/v3/users/0192d3ce109445799cf3276f4fff3255 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:25.506749 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:25.508328 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:25.529935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e65ed6-d2cb-4e47-a01d-44c4b23eed04 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:25.591350 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce9493-a3d8-4117-965f-7319e561af34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:25.592243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce9493-a3d8-4117-965f-7319e561af34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:25.592572 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce9493-a3d8-4117-965f-7319e561af34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:25.592846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce9493-a3d8-4117-965f-7319e561af34 admin admin] PATH_INFO: `/v3/projects/9eced9c56f284ecfac67433453dd54a1` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:25.594066 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce9493-a3d8-4117-965f-7319e561af34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eced9c56f284ecfac67433453dd54a1)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:25.596021 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce9493-a3d8-4117-965f-7319e561af34 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:25.714598 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-61ce9493-a3d8-4117-965f-7319e561af34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eced9c56f284ecfac67433453dd54a1', 'request_id': 'req-61ce9493-a3d8-4117-965f-7319e561af34'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:25.720899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-61ce9493-a3d8-4117-965f-7319e561af34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eced9c56f284ecfac67433453dd54a1', 'request_id': 'req-61ce9493-a3d8-4117-965f-7319e561af34'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:25.808237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-61ce9493-a3d8-4117-965f-7319e561af34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eced9c56f284ecfac67433453dd54a1', 'request_id': 'req-61ce9493-a3d8-4117-965f-7319e561af34'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:25.819683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-61ce9493-a3d8-4117-965f-7319e561af34 admin admin] The token cache is being invalidate because project 9eced9c56f284ecfac67433453dd54a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:52:25.820063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-61ce9493-a3d8-4117-965f-7319e561af34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:25.820865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-61ce9493-a3d8-4117-965f-7319e561af34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:25.822935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1061/2124] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:52:25 2022] DELETE /identity/v3/projects/9eced9c56f284ecfac67433453dd54a1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:25.830334 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866ae0-2f50-4afc-8ab1-f1b5536f6407 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:25.830930 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866ae0-2f50-4afc-8ab1-f1b5536f6407 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:25.831857 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866ae0-2f50-4afc-8ab1-f1b5536f6407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:25.853674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-fb866ae0-2f50-4afc-8ab1-f1b5536f6407 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:25.854960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-fb866ae0-2f50-4afc-8ab1-f1b5536f6407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:25.927763 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1064/2125] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:25.935016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a79cb9-cfea-469a-9a9f-f95df7f72206 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:25.935016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a79cb9-cfea-469a-9a9f-f95df7f72206 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:25.935016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a79cb9-cfea-469a-9a9f-f95df7f72206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:25.952995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-e4a79cb9-cfea-469a-9a9f-f95df7f72206 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:25.954242 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e4a79cb9-cfea-469a-9a9f-f95df7f72206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:25.966487 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1062/2126] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:52:25.967764 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb866ae0-2f50-4afc-8ab1-f1b5536f6407 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:25.978100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb866ae0-2f50-4afc-8ab1-f1b5536f6407 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:25.983205 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1289524-2c78-46f3-b6f8-617456981ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:25.983959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1289524-2c78-46f3-b6f8-617456981ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:25.984315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1289524-2c78-46f3-b6f8-617456981ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:25.984602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1289524-2c78-46f3-b6f8-617456981ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:25.985506 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1289524-2c78-46f3-b6f8-617456981ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:52:25.985824 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1289524-2c78-46f3-b6f8-617456981ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:25.987428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1289524-2c78-46f3-b6f8-617456981ac9 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:26.003345 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1065/2127] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:52:26.004462 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a79cb9-cfea-469a-9a9f-f95df7f72206 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:26.014600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a79cb9-cfea-469a-9a9f-f95df7f72206 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:26.019815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542092cf-cdad-4497-84d1-8ebf2b1c1d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:26.020623 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542092cf-cdad-4497-84d1-8ebf2b1c1d0f admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:26.020913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542092cf-cdad-4497-84d1-8ebf2b1c1d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:26.021190 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542092cf-cdad-4497-84d1-8ebf2b1c1d0f admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:26.021899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542092cf-cdad-4497-84d1-8ebf2b1c1d0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:26.023951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542092cf-cdad-4497-84d1-8ebf2b1c1d0f admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:26.109546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1063/2128] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:52:26 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:26.113432 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1289524-2c78-46f3-b6f8-617456981ac9 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:26.124187 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1289524-2c78-46f3-b6f8-617456981ac9 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:26.179518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af790d-5550-442f-801b-c1be07a4e7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:26.180221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af790d-5550-442f-801b-c1be07a4e7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:26.180507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af790d-5550-442f-801b-c1be07a4e7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:26.180792 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af790d-5550-442f-801b-c1be07a4e7e3 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:26.181492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af790d-5550-442f-801b-c1be07a4e7e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:26.183981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af790d-5550-442f-801b-c1be07a4e7e3 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:26.284803 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1066/2129] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:52:26 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:52:26.288876 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542092cf-cdad-4497-84d1-8ebf2b1c1d0f admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:26.299006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542092cf-cdad-4497-84d1-8ebf2b1c1d0f admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:26.304420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf830f3-4db3-445c-a42a-ef43ede73fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:26.308009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf830f3-4db3-445c-a42a-ef43ede73fac admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:26.308314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf830f3-4db3-445c-a42a-ef43ede73fac admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:26.308596 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf830f3-4db3-445c-a42a-ef43ede73fac admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:26.309352 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf830f3-4db3-445c-a42a-ef43ede73fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:26.310977 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf830f3-4db3-445c-a42a-ef43ede73fac admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:26.324118 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1064/2130] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:26.331358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af790d-5550-442f-801b-c1be07a4e7e3 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:26.340064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af790d-5550-442f-801b-c1be07a4e7e3 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:26.344789 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d081ee3-1800-4f43-b3ba-86a9e68b2e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:26.345451 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d081ee3-1800-4f43-b3ba-86a9e68b2e1b admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:26.345736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d081ee3-1800-4f43-b3ba-86a9e68b2e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:26.348129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d081ee3-1800-4f43-b3ba-86a9e68b2e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:26.348129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d081ee3-1800-4f43-b3ba-86a9e68b2e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:26.348387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d081ee3-1800-4f43-b3ba-86a9e68b2e1b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:26.359917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1067/2131] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:26.364184 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf830f3-4db3-445c-a42a-ef43ede73fac admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:26.375035 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf830f3-4db3-445c-a42a-ef43ede73fac admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:26.379827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942ec72-da8f-4736-9113-6f2b81617159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:26.380791 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942ec72-da8f-4736-9113-6f2b81617159 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:26.381082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942ec72-da8f-4736-9113-6f2b81617159 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:26.381362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942ec72-da8f-4736-9113-6f2b81617159 admin admin] PATH_INFO: `/v3/projects/26d66a96a4f64665871dd134a108b125/users/eb789e5f96f44d58bb1547279c60d911/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:26.396904 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942ec72-da8f-4736-9113-6f2b81617159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d66a96a4f64665871dd134a108b125, user_id=eb789e5f96f44d58bb1547279c60d911, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:26.400240 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942ec72-da8f-4736-9113-6f2b81617159 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:26.420061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:26.496699 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1065/2132] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:26 2022] PUT /identity/v3/projects/26d66a96a4f64665871dd134a108b125/users/eb789e5f96f44d58bb1547279c60d911/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:26.500754 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51750ba4-7807-4282-add1-09f2e5b9da61 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:26.501048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51750ba4-7807-4282-add1-09f2e5b9da61 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:26.501327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51750ba4-7807-4282-add1-09f2e5b9da61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:26.530128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-51750ba4-7807-4282-add1-09f2e5b9da61 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:26.536767 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-51750ba4-7807-4282-add1-09f2e5b9da61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:26.576173 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:26.602421 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1068/2133] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:26.613839 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942ec72-da8f-4736-9113-6f2b81617159 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:26.615591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f942ec72-da8f-4736-9113-6f2b81617159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:26.673253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942ec72-da8f-4736-9113-6f2b81617159 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:26.676937 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa849be-6d53-4d73-b0b0-e792be885fea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:26.677578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa849be-6d53-4d73-b0b0-e792be885fea service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:26.677856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa849be-6d53-4d73-b0b0-e792be885fea service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:26.678130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa849be-6d53-4d73-b0b0-e792be885fea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:26.687795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa849be-6d53-4d73-b0b0-e792be885fea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:26.689212 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa849be-6d53-4d73-b0b0-e792be885fea service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:26.698690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1066/2134] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:52:27.980509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9f08b-f229-44a4-9a70-5167269bf90d None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:27.981018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9f08b-f229-44a4-9a70-5167269bf90d None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:27.981111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9f08b-f229-44a4-9a70-5167269bf90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:28.008424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-2eb9f08b-f229-44a4-9a70-5167269bf90d None None] MFA Rules not processed for user `eb789e5f96f44d58bb1547279c60d911`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:28.010177 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-2eb9f08b-f229-44a4-9a70-5167269bf90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:28.080351 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:28.085546 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1069/2135] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:28.090673 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa849be-6d53-4d73-b0b0-e792be885fea service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:28.101626 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa849be-6d53-4d73-b0b0-e792be885fea service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:28.106157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e646fb-076f-4679-91aa-c76633170565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:28.106861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e646fb-076f-4679-91aa-c76633170565 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:28.107143 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e646fb-076f-4679-91aa-c76633170565 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:28.107417 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e646fb-076f-4679-91aa-c76633170565 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:28.108163 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e646fb-076f-4679-91aa-c76633170565 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:28.110074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e646fb-076f-4679-91aa-c76633170565 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:28.193717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1067/2136] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:52:28 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:28.198581 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9f08b-f229-44a4-9a70-5167269bf90d None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:28.209707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9f08b-f229-44a4-9a70-5167269bf90d None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:28.265549 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842fb02-43c8-4261-9529-62a08c7413a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:28.266143 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842fb02-43c8-4261-9529-62a08c7413a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:28.266431 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842fb02-43c8-4261-9529-62a08c7413a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:28.266715 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842fb02-43c8-4261-9529-62a08c7413a9 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:28.267410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842fb02-43c8-4261-9529-62a08c7413a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:28.269380 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842fb02-43c8-4261-9529-62a08c7413a9 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:28.353346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1070/2137] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:52:28 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:28.357261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e646fb-076f-4679-91aa-c76633170565 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:28.367731 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e646fb-076f-4679-91aa-c76633170565 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:28.372972 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38752036-6b2a-47d7-99d9-8ccefb610937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:28.373799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38752036-6b2a-47d7-99d9-8ccefb610937 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:28.373904 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38752036-6b2a-47d7-99d9-8ccefb610937 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:28.374430 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38752036-6b2a-47d7-99d9-8ccefb610937 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:28.374980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38752036-6b2a-47d7-99d9-8ccefb610937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:28.376651 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38752036-6b2a-47d7-99d9-8ccefb610937 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:28.388155 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1068/2138] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:28.392356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842fb02-43c8-4261-9529-62a08c7413a9 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:28.402468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842fb02-43c8-4261-9529-62a08c7413a9 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:28.407117 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ca525-1256-48b6-8fd8-c6bd0b2bd280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:28.408026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca525-1256-48b6-8fd8-c6bd0b2bd280 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:28.408405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca525-1256-48b6-8fd8-c6bd0b2bd280 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:28.408706 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ca525-1256-48b6-8fd8-c6bd0b2bd280 admin admin] PATH_INFO: `/v3/projects/98d3f81379b0407e8c35218076e560b5/users/d06dff199ec942b9858d17e83ebef052/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:28.423553 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ca525-1256-48b6-8fd8-c6bd0b2bd280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d3f81379b0407e8c35218076e560b5, user_id=d06dff199ec942b9858d17e83ebef052, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:28.426301 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622ca525-1256-48b6-8fd8-c6bd0b2bd280 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:28.547777 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1071/2139] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:28 2022] PUT /identity/v3/projects/98d3f81379b0407e8c35218076e560b5/users/d06dff199ec942b9858d17e83ebef052/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:28.551762 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38752036-6b2a-47d7-99d9-8ccefb610937 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:28.562150 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38752036-6b2a-47d7-99d9-8ccefb610937 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:28.618259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f741e9a-55c0-4144-b9ae-939aa3b1e35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:28.618923 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f741e9a-55c0-4144-b9ae-939aa3b1e35d admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:28.619724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f741e9a-55c0-4144-b9ae-939aa3b1e35d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:28.620002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f741e9a-55c0-4144-b9ae-939aa3b1e35d admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:28.620723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f741e9a-55c0-4144-b9ae-939aa3b1e35d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:28.622322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f741e9a-55c0-4144-b9ae-939aa3b1e35d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:28.632063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1069/2140] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:28.636899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ca525-1256-48b6-8fd8-c6bd0b2bd280 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:28.647102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622ca525-1256-48b6-8fd8-c6bd0b2bd280 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:28.651939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830aead-d510-41f6-956f-860da297eefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:28.652822 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830aead-d510-41f6-956f-860da297eefd admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:28.653109 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830aead-d510-41f6-956f-860da297eefd admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:28.653391 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830aead-d510-41f6-956f-860da297eefd admin admin] PATH_INFO: `/v3/projects/98d3f81379b0407e8c35218076e560b5/users/d06dff199ec942b9858d17e83ebef052/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:28.655381 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830aead-d510-41f6-956f-860da297eefd admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d3f81379b0407e8c35218076e560b5, user_id=d06dff199ec942b9858d17e83ebef052, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:28.658062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2830aead-d510-41f6-956f-860da297eefd admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:28.668899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1072/2141] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:28 2022] PUT /identity/v3/projects/98d3f81379b0407e8c35218076e560b5/users/d06dff199ec942b9858d17e83ebef052/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:30.434803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f9d7-553a-48f3-a20f-31a93f9f1c71 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:30.435887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f9d7-553a-48f3-a20f-31a93f9f1c71 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:30.435887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326f9d7-553a-48f3-a20f-31a93f9f1c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:30.466854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-5326f9d7-553a-48f3-a20f-31a93f9f1c71 None None] MFA Rules not processed for user `d06dff199ec942b9858d17e83ebef052`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:30.467912 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-5326f9d7-553a-48f3-a20f-31a93f9f1c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:30.558711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:30.580796 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1070/2142] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:30.591179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489a6db-8d51-4963-b119-7adb0a9eb210 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:30.591761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489a6db-8d51-4963-b119-7adb0a9eb210 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:30.591761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489a6db-8d51-4963-b119-7adb0a9eb210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:30.612685 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-8489a6db-8d51-4963-b119-7adb0a9eb210 None None] MFA Rules not processed for user `eb789e5f96f44d58bb1547279c60d911`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:30.614249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-8489a6db-8d51-4963-b119-7adb0a9eb210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:30.674799 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1073/2143] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:30.685323 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f9d7-553a-48f3-a20f-31a93f9f1c71 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:30.686779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-5326f9d7-553a-48f3-a20f-31a93f9f1c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:30.771328 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326f9d7-553a-48f3-a20f-31a93f9f1c71 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:30.777643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d7537-b969-45f8-a11a-3a50542fa1dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:30.778391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d7537-b969-45f8-a11a-3a50542fa1dc service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:30.778679 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d7537-b969-45f8-a11a-3a50542fa1dc service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:30.778958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d7537-b969-45f8-a11a-3a50542fa1dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:30.787152 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d7537-b969-45f8-a11a-3a50542fa1dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:30.789024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d7537-b969-45f8-a11a-3a50542fa1dc service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:30.798543 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1071/2144] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:52:32.491514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6656875-b9bc-45f8-87ae-3a0645e72acd None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:32.492125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6656875-b9bc-45f8-87ae-3a0645e72acd None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:32.492125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6656875-b9bc-45f8-87ae-3a0645e72acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:32.524573 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-f6656875-b9bc-45f8-87ae-3a0645e72acd None None] MFA Rules not processed for user `fa8b9968425f40189532fc5ca2daf5e4`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:32.526552 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-f6656875-b9bc-45f8-87ae-3a0645e72acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:32.597397 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:32.607800 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1074/2145] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:35.579822 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc6a2-729d-4bb3-818f-d224c9719b54 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:35.580323 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc6a2-729d-4bb3-818f-d224c9719b54 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:35.580665 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc6a2-729d-4bb3-818f-d224c9719b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:35.600836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-278fc6a2-729d-4bb3-818f-d224c9719b54 None None] MFA Rules not processed for user `6e6313c444eb4a788b6559eff17959f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:35.602484 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-278fc6a2-729d-4bb3-818f-d224c9719b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:35.675836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1072/2146] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jun 27 18:52:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:35.720615 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6656875-b9bc-45f8-87ae-3a0645e72acd None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:35.722073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-f6656875-b9bc-45f8-87ae-3a0645e72acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:35.798972 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6656875-b9bc-45f8-87ae-3a0645e72acd None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:35.804160 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e462f4-40fe-431c-bfd4-a98178b59c34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94555ff897d94c90968c470d82ff9e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:35.804752 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e462f4-40fe-431c-bfd4-a98178b59c34 service swift] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:35.805069 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e462f4-40fe-431c-bfd4-a98178b59c34 service swift] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:35.805373 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e462f4-40fe-431c-bfd4-a98178b59c34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:35.816546 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e462f4-40fe-431c-bfd4-a98178b59c34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:35.818441 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e462f4-40fe-431c-bfd4-a98178b59c34 service swift] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:35.837607 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1075/2147] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jun 27 18:52:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 18:52:36.167301 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fc6a2-729d-4bb3-818f-d224c9719b54 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:36.168850 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-278fc6a2-729d-4bb3-818f-d224c9719b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:36.250350 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fc6a2-729d-4bb3-818f-d224c9719b54 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:36.254936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cba82-5f51-4eb6-a244-1ec9c3d14f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:36.255847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cba82-5f51-4eb6-a244-1ec9c3d14f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:36.256133 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cba82-5f51-4eb6-a244-1ec9c3d14f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:36.256412 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cba82-5f51-4eb6-a244-1ec9c3d14f08 admin admin] PATH_INFO: `/v3/users/dbb2720aa2f449dcb8dc7f84cceb0f83` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:36.257676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cba82-5f51-4eb6-a244-1ec9c3d14f08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbb2720aa2f449dcb8dc7f84cceb0f83)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:36.259685 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cba82-5f51-4eb6-a244-1ec9c3d14f08 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:36.285806 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:36.463368 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e33cba82-5f51-4eb6-a244-1ec9c3d14f08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbb2720aa2f449dcb8dc7f84cceb0f83'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:36.509533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e33cba82-5f51-4eb6-a244-1ec9c3d14f08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbb2720aa2f449dcb8dc7f84cceb0f83'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:36.528161 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e33cba82-5f51-4eb6-a244-1ec9c3d14f08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbb2720aa2f449dcb8dc7f84cceb0f83'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:36.535462 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e33cba82-5f51-4eb6-a244-1ec9c3d14f08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbb2720aa2f449dcb8dc7f84cceb0f83'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:36.536209 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e33cba82-5f51-4eb6-a244-1ec9c3d14f08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbb2720aa2f449dcb8dc7f84cceb0f83'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:36.542897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1073/2148] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:52:36 2022] DELETE /identity/v3/users/dbb2720aa2f449dcb8dc7f84cceb0f83 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:52:36.547773 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c2de1-bf06-4365-8d48-e158399e3800 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:36.548089 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c2de1-bf06-4365-8d48-e158399e3800 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:36.548388 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c2de1-bf06-4365-8d48-e158399e3800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:36.567138 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-132c2de1-bf06-4365-8d48-e158399e3800 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:36.568424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-132c2de1-bf06-4365-8d48-e158399e3800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:36.632338 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1076/2149] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:36.642479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cba82-5f51-4eb6-a244-1ec9c3d14f08 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:36.644143 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e33cba82-5f51-4eb6-a244-1ec9c3d14f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:36.701809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cba82-5f51-4eb6-a244-1ec9c3d14f08 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:36.705708 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223594b3-d917-4344-90ad-564980cd4126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:36.706386 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223594b3-d917-4344-90ad-564980cd4126 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:36.706672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223594b3-d917-4344-90ad-564980cd4126 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:36.707064 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223594b3-d917-4344-90ad-564980cd4126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:36.716556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223594b3-d917-4344-90ad-564980cd4126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:36.718014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223594b3-d917-4344-90ad-564980cd4126 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:36.727564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1074/2150] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:52:36.805165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43c03c-a7e2-4cc4-a219-febad43ca569 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:36.805674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43c03c-a7e2-4cc4-a219-febad43ca569 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:36.805777 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43c03c-a7e2-4cc4-a219-febad43ca569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:36.830580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-db43c03c-a7e2-4cc4-a219-febad43ca569 None None] MFA Rules not processed for user `6e6313c444eb4a788b6559eff17959f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:36.831830 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-db43c03c-a7e2-4cc4-a219-febad43ca569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:36.888701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1077/2151] 10.222.0.36 () {58 vars in 967 bytes} [Mon Jun 27 18:52:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:36.902765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223594b3-d917-4344-90ad-564980cd4126 service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:36.908990 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-223594b3-d917-4344-90ad-564980cd4126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:37.070863 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223594b3-d917-4344-90ad-564980cd4126 service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:37.077714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e4048-de10-4408-bc1c-f521769fd8a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94555ff897d94c90968c470d82ff9e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:37.078387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e4048-de10-4408-bc1c-f521769fd8a3 service swift] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:37.078663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e4048-de10-4408-bc1c-f521769fd8a3 service swift] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:37.078939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e4048-de10-4408-bc1c-f521769fd8a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:37.088196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e4048-de10-4408-bc1c-f521769fd8a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:37.089799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e4048-de10-4408-bc1c-f521769fd8a3 service swift] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:37.098361 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1075/2152] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jun 27 18:52:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 18:52:37.290433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43c03c-a7e2-4cc4-a219-febad43ca569 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:37.291894 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-db43c03c-a7e2-4cc4-a219-febad43ca569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:37.306599 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43c03c-a7e2-4cc4-a219-febad43ca569 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:37.313536 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49b119-e832-4d3d-bc70-3e52006af3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:37.313536 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49b119-e832-4d3d-bc70-3e52006af3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:37.313536 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49b119-e832-4d3d-bc70-3e52006af3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:37.313536 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49b119-e832-4d3d-bc70-3e52006af3c5 admin admin] PATH_INFO: `/v3/projects/f5679a66726a4b0ba50b3eece536aa30` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:37.315482 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49b119-e832-4d3d-bc70-3e52006af3c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5679a66726a4b0ba50b3eece536aa30)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:37.317361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49b119-e832-4d3d-bc70-3e52006af3c5 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:37.386971 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:37.399466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa49b119-e832-4d3d-bc70-3e52006af3c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5679a66726a4b0ba50b3eece536aa30', 'request_id': 'req-aa49b119-e832-4d3d-bc70-3e52006af3c5'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:37.496520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa49b119-e832-4d3d-bc70-3e52006af3c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5679a66726a4b0ba50b3eece536aa30', 'request_id': 'req-aa49b119-e832-4d3d-bc70-3e52006af3c5'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:37.502760 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa49b119-e832-4d3d-bc70-3e52006af3c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5679a66726a4b0ba50b3eece536aa30', 'request_id': 'req-aa49b119-e832-4d3d-bc70-3e52006af3c5'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:37.531093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa49b119-e832-4d3d-bc70-3e52006af3c5 admin admin] The token cache is being invalidate because project f5679a66726a4b0ba50b3eece536aa30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:52:37.531398 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa49b119-e832-4d3d-bc70-3e52006af3c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:37.532180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa49b119-e832-4d3d-bc70-3e52006af3c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:37.534072 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1078/2153] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:52:37 2022] DELETE /identity/v3/projects/f5679a66726a4b0ba50b3eece536aa30 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:37.541245 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5e5a8-e4ed-4c10-b324-d9ea3e1df12d None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:37.541686 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5e5a8-e4ed-4c10-b324-d9ea3e1df12d None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:37.542081 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5e5a8-e4ed-4c10-b324-d9ea3e1df12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:37.565231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-0ca5e5a8-e4ed-4c10-b324-d9ea3e1df12d None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:37.566483 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-0ca5e5a8-e4ed-4c10-b324-d9ea3e1df12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:37.620493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:37.652025 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1076/2154] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:37.659990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9faa53-0536-4cac-bb7c-e8d0f0a74373 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:37.660310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9faa53-0536-4cac-bb7c-e8d0f0a74373 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:37.660650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9faa53-0536-4cac-bb7c-e8d0f0a74373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:37.680228 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-da9faa53-0536-4cac-bb7c-e8d0f0a74373 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:37.682096 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-da9faa53-0536-4cac-bb7c-e8d0f0a74373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:37.690291 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1079/2155] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:37.694585 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5e5a8-e4ed-4c10-b324-d9ea3e1df12d None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:37.704790 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5e5a8-e4ed-4c10-b324-d9ea3e1df12d None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:37.709523 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b26f2a-9361-4bff-9627-66548a4a233e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:37.710209 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b26f2a-9361-4bff-9627-66548a4a233e admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:37.710520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b26f2a-9361-4bff-9627-66548a4a233e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:37.710803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b26f2a-9361-4bff-9627-66548a4a233e admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:37.711564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b26f2a-9361-4bff-9627-66548a4a233e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:52:37.711883 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b26f2a-9361-4bff-9627-66548a4a233e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:37.713520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b26f2a-9361-4bff-9627-66548a4a233e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:37.733360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1077/2156] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:52:37.738659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9faa53-0536-4cac-bb7c-e8d0f0a74373 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:37.752720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9faa53-0536-4cac-bb7c-e8d0f0a74373 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:37.769204 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca776932-1f1f-4c8f-97a0-cf8c7c5f2958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:37.769883 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca776932-1f1f-4c8f-97a0-cf8c7c5f2958 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:37.770171 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca776932-1f1f-4c8f-97a0-cf8c7c5f2958 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:37.770450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca776932-1f1f-4c8f-97a0-cf8c7c5f2958 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:37.771155 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca776932-1f1f-4c8f-97a0-cf8c7c5f2958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:37.773249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca776932-1f1f-4c8f-97a0-cf8c7c5f2958 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:37.774351 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a933aba-aae8-4b8d-8345-6ef797a01ac7 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:37.775883 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a933aba-aae8-4b8d-8345-6ef797a01ac7 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:37.776448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a933aba-aae8-4b8d-8345-6ef797a01ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:37.795070 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-9a933aba-aae8-4b8d-8345-6ef797a01ac7 None None] MFA Rules not processed for user `6e6313c444eb4a788b6559eff17959f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:37.796544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9a933aba-aae8-4b8d-8345-6ef797a01ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:37.855231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1078/2157] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jun 27 18:52:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:52:37.880606 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a933aba-aae8-4b8d-8345-6ef797a01ac7 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:37.886083 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1080/2158] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:52:37 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:52:37.887316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca776932-1f1f-4c8f-97a0-cf8c7c5f2958 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:37.887609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9a933aba-aae8-4b8d-8345-6ef797a01ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:37.974978 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca776932-1f1f-4c8f-97a0-cf8c7c5f2958 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:37.981438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ba2f0-d078-4fd1-a87d-7909781463a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:37.982774 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ba2f0-d078-4fd1-a87d-7909781463a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:37.983330 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ba2f0-d078-4fd1-a87d-7909781463a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:37.983957 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2ba2f0-d078-4fd1-a87d-7909781463a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:37.985053 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ba2f0-d078-4fd1-a87d-7909781463a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:37.987760 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2ba2f0-d078-4fd1-a87d-7909781463a4 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:37.994521 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a933aba-aae8-4b8d-8345-6ef797a01ac7 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:38.057361 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8d4dc-252a-4c3d-8919-32bb996e2e6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94555ff897d94c90968c470d82ff9e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:38.058005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8d4dc-252a-4c3d-8919-32bb996e2e6c service swift] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:38.058284 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8d4dc-252a-4c3d-8919-32bb996e2e6c service swift] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:38.058559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8d4dc-252a-4c3d-8919-32bb996e2e6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:38.082257 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1081/2159] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:52:37 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:38.086483 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ba2f0-d078-4fd1-a87d-7909781463a4 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:38.096598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2ba2f0-d078-4fd1-a87d-7909781463a4 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:38.109558 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8173a2-c12a-4802-b7ec-d173c5b766b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:38.110368 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8173a2-c12a-4802-b7ec-d173c5b766b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:38.110730 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8173a2-c12a-4802-b7ec-d173c5b766b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:38.111094 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8173a2-c12a-4802-b7ec-d173c5b766b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:38.111938 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8173a2-c12a-4802-b7ec-d173c5b766b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:38.113603 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8173a2-c12a-4802-b7ec-d173c5b766b7 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:38.115612 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8d4dc-252a-4c3d-8919-32bb996e2e6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:38.117273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8d4dc-252a-4c3d-8919-32bb996e2e6c service swift] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:38.127566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1082/2160] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:52:38.128894 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8173a2-c12a-4802-b7ec-d173c5b766b7 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:38.133169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1079/2161] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jun 27 18:52:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 18:52:38.145586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8173a2-c12a-4802-b7ec-d173c5b766b7 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:38.148904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f007b-c737-4de0-8373-c91fdab56195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:38.150282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f007b-c737-4de0-8373-c91fdab56195 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:38.150584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f007b-c737-4de0-8373-c91fdab56195 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:38.150867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f007b-c737-4de0-8373-c91fdab56195 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:38.151776 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f007b-c737-4de0-8373-c91fdab56195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:38.153390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f007b-c737-4de0-8373-c91fdab56195 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:38.164483 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:38.169294 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1083/2162] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:38.170375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8d4dc-252a-4c3d-8919-32bb996e2e6c service swift] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:38.181708 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8d4dc-252a-4c3d-8919-32bb996e2e6c service swift] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:38.188070 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bab649-2c85-4da5-99fa-e87240be3fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:38.189054 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bab649-2c85-4da5-99fa-e87240be3fef admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:38.203001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bab649-2c85-4da5-99fa-e87240be3fef admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:38.203001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bab649-2c85-4da5-99fa-e87240be3fef admin admin] PATH_INFO: `/v3/projects/b9e113a981824b229d19bd7e6151bf13/users/794c7a8149c4471a9d067e712e6e60df/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:38.208849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bab649-2c85-4da5-99fa-e87240be3fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9e113a981824b229d19bd7e6151bf13, user_id=794c7a8149c4471a9d067e712e6e60df, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:38.211839 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bab649-2c85-4da5-99fa-e87240be3fef admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:38.313282 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1080/2163] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:38 2022] PUT /identity/v3/projects/b9e113a981824b229d19bd7e6151bf13/users/794c7a8149c4471a9d067e712e6e60df/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:38.323869 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275c029-3837-4efa-88a6-cf04e1e9ce5f None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:38.324419 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275c029-3837-4efa-88a6-cf04e1e9ce5f None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:38.324847 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c275c029-3837-4efa-88a6-cf04e1e9ce5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:38.364584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-c275c029-3837-4efa-88a6-cf04e1e9ce5f None None] MFA Rules not processed for user `794c7a8149c4471a9d067e712e6e60df`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:38.376090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c275c029-3837-4efa-88a6-cf04e1e9ce5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:38.463644 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:38.512500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1084/2164] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:38.524063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bab649-2c85-4da5-99fa-e87240be3fef admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:38.527089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-48bab649-2c85-4da5-99fa-e87240be3fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:38.602857 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bab649-2c85-4da5-99fa-e87240be3fef admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:38.607608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a94ecf-2e2b-47cd-ac24-e7011ea1db78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:38.608568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a94ecf-2e2b-47cd-ac24-e7011ea1db78 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:38.608744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a94ecf-2e2b-47cd-ac24-e7011ea1db78 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:38.609030 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a94ecf-2e2b-47cd-ac24-e7011ea1db78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:38.618405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a94ecf-2e2b-47cd-ac24-e7011ea1db78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:38.619992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a94ecf-2e2b-47cd-ac24-e7011ea1db78 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:38.633218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1081/2165] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:52:38.663064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275c029-3837-4efa-88a6-cf04e1e9ce5f None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:38.757358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c275c029-3837-4efa-88a6-cf04e1e9ce5f None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:38.783335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4dab5-06dd-479a-bdc1-1ddd0a55479c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:38.792030 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4dab5-06dd-479a-bdc1-1ddd0a55479c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:38.792330 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4dab5-06dd-479a-bdc1-1ddd0a55479c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:38.794487 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4dab5-06dd-479a-bdc1-1ddd0a55479c admin admin] PATH_INFO: `/v3/users/794c7a8149c4471a9d067e712e6e60df` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:38.797478 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4dab5-06dd-479a-bdc1-1ddd0a55479c admin admin] RBAC: Authorizing `identity:delete_user(user_id=794c7a8149c4471a9d067e712e6e60df)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:38.799458 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4dab5-06dd-479a-bdc1-1ddd0a55479c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:38.880862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3681490-1569-4d5f-b11e-fe60ccf3eace None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:38.881385 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3681490-1569-4d5f-b11e-fe60ccf3eace None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:38.881385 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3681490-1569-4d5f-b11e-fe60ccf3eace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:38.900438 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-c3681490-1569-4d5f-b11e-fe60ccf3eace None None] MFA Rules not processed for user `6e6313c444eb4a788b6559eff17959f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:38.901675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-c3681490-1569-4d5f-b11e-fe60ccf3eace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:38.967201 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1082/2166] 10.222.0.36 () {58 vars in 967 bytes} [Mon Jun 27 18:52:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:52:38.980139 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3681490-1569-4d5f-b11e-fe60ccf3eace None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:39.023168 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:39.053873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3681490-1569-4d5f-b11e-fe60ccf3eace None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:39.059899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df781c80-64f4-432d-ae87-7aee0a174bb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94555ff897d94c90968c470d82ff9e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:39.060551 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df781c80-64f4-432d-ae87-7aee0a174bb1 service swift] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:39.061855 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df781c80-64f4-432d-ae87-7aee0a174bb1 service swift] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:39.062159 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df781c80-64f4-432d-ae87-7aee0a174bb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:39.070825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df781c80-64f4-432d-ae87-7aee0a174bb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:39.073205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df781c80-64f4-432d-ae87-7aee0a174bb1 service swift] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:39.084079 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1083/2167] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jun 27 18:52:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 18:52:39.093319 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-89a4dab5-06dd-479a-bdc1-1ddd0a55479c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794c7a8149c4471a9d067e712e6e60df'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:39.156659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-89a4dab5-06dd-479a-bdc1-1ddd0a55479c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794c7a8149c4471a9d067e712e6e60df'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:39.169775 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-89a4dab5-06dd-479a-bdc1-1ddd0a55479c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794c7a8149c4471a9d067e712e6e60df'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:39.170509 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-89a4dab5-06dd-479a-bdc1-1ddd0a55479c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794c7a8149c4471a9d067e712e6e60df'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:39.178857 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-89a4dab5-06dd-479a-bdc1-1ddd0a55479c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794c7a8149c4471a9d067e712e6e60df'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:39.186240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1085/2168] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:52:38 2022] DELETE /identity/v3/users/794c7a8149c4471a9d067e712e6e60df => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:39.192643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa688c9f-415f-4ca0-8288-904ad7eae785 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:39.196011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa688c9f-415f-4ca0-8288-904ad7eae785 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:39.200224 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa688c9f-415f-4ca0-8288-904ad7eae785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:39.214597 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-fa688c9f-415f-4ca0-8288-904ad7eae785 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:39.215846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-fa688c9f-415f-4ca0-8288-904ad7eae785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:39.319360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1084/2169] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:39.326074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4dab5-06dd-479a-bdc1-1ddd0a55479c admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:39.327474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-89a4dab5-06dd-479a-bdc1-1ddd0a55479c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:39.387225 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4dab5-06dd-479a-bdc1-1ddd0a55479c admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:39.390821 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c17193-88ac-41ff-b010-f23aab250526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:39.391466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c17193-88ac-41ff-b010-f23aab250526 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:39.391787 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c17193-88ac-41ff-b010-f23aab250526 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:39.392064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c17193-88ac-41ff-b010-f23aab250526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:39.403890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c17193-88ac-41ff-b010-f23aab250526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:39.405333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c17193-88ac-41ff-b010-f23aab250526 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:39.421604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1086/2170] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:52:39.957695 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa688c9f-415f-4ca0-8288-904ad7eae785 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:39.959257 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-fa688c9f-415f-4ca0-8288-904ad7eae785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:39.989306 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa688c9f-415f-4ca0-8288-904ad7eae785 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:39.994316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a6254-0882-40e2-bac8-48f427afdf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:39.995760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a6254-0882-40e2-bac8-48f427afdf6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:39.996075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a6254-0882-40e2-bac8-48f427afdf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:39.997215 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a6254-0882-40e2-bac8-48f427afdf6a admin admin] PATH_INFO: `/v3/projects/b9e113a981824b229d19bd7e6151bf13` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:39.999383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a6254-0882-40e2-bac8-48f427afdf6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9e113a981824b229d19bd7e6151bf13)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:40.001424 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a6254-0882-40e2-bac8-48f427afdf6a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:40.144961 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bf6a6254-0882-40e2-bac8-48f427afdf6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9e113a981824b229d19bd7e6151bf13', 'request_id': 'req-bf6a6254-0882-40e2-bac8-48f427afdf6a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:40.154712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bf6a6254-0882-40e2-bac8-48f427afdf6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9e113a981824b229d19bd7e6151bf13', 'request_id': 'req-bf6a6254-0882-40e2-bac8-48f427afdf6a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:40.255330 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bf6a6254-0882-40e2-bac8-48f427afdf6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9e113a981824b229d19bd7e6151bf13', 'request_id': 'req-bf6a6254-0882-40e2-bac8-48f427afdf6a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:40.267732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bf6a6254-0882-40e2-bac8-48f427afdf6a admin admin] The token cache is being invalidate because project b9e113a981824b229d19bd7e6151bf13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:52:40.268135 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bf6a6254-0882-40e2-bac8-48f427afdf6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:40.268778 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bf6a6254-0882-40e2-bac8-48f427afdf6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:40.270582 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1085/2171] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:52:39 2022] DELETE /identity/v3/projects/b9e113a981824b229d19bd7e6151bf13 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:41.982551 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c17193-88ac-41ff-b010-f23aab250526 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:41.984065 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-40c17193-88ac-41ff-b010-f23aab250526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:41.996775 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c17193-88ac-41ff-b010-f23aab250526 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:42.001674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:42.055984 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb2986-0c2b-40af-a20e-95335c7f4059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:42.056855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb2986-0c2b-40af-a20e-95335c7f4059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:42.057140 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb2986-0c2b-40af-a20e-95335c7f4059 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:42.057443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cb2986-0c2b-40af-a20e-95335c7f4059 admin admin] PATH_INFO: `/v3/users/007b69eaf06742c79d234a33f5a5462e` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:42.058738 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb2986-0c2b-40af-a20e-95335c7f4059 admin admin] RBAC: Authorizing `identity:delete_user(user_id=007b69eaf06742c79d234a33f5a5462e)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:42.060651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cb2986-0c2b-40af-a20e-95335c7f4059 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:42.236229 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-45cb2986-0c2b-40af-a20e-95335c7f4059 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '007b69eaf06742c79d234a33f5a5462e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:42.317606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-45cb2986-0c2b-40af-a20e-95335c7f4059 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '007b69eaf06742c79d234a33f5a5462e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:42.331580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-45cb2986-0c2b-40af-a20e-95335c7f4059 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '007b69eaf06742c79d234a33f5a5462e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:42.332328 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-45cb2986-0c2b-40af-a20e-95335c7f4059 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '007b69eaf06742c79d234a33f5a5462e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:42.340664 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-45cb2986-0c2b-40af-a20e-95335c7f4059 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '007b69eaf06742c79d234a33f5a5462e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:42.346932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1087/2172] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:52:41 2022] DELETE /identity/v3/users/007b69eaf06742c79d234a33f5a5462e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:42.351487 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a0b28-5c75-4d6e-bcdc-1965cdcc13b4 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:42.351951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a0b28-5c75-4d6e-bcdc-1965cdcc13b4 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:42.352091 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35a0b28-5c75-4d6e-bcdc-1965cdcc13b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:42.369456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-b35a0b28-5c75-4d6e-bcdc-1965cdcc13b4 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:42.370661 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b35a0b28-5c75-4d6e-bcdc-1965cdcc13b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:42.415764 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:42.431728 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1086/2173] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:42.442228 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb2986-0c2b-40af-a20e-95335c7f4059 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:42.443501 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-45cb2986-0c2b-40af-a20e-95335c7f4059 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:42.503219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cb2986-0c2b-40af-a20e-95335c7f4059 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:42.507088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb598746-f539-4bd0-9177-9388a5f28c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:42.507769 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb598746-f539-4bd0-9177-9388a5f28c9f service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:42.508059 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb598746-f539-4bd0-9177-9388a5f28c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:42.508341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb598746-f539-4bd0-9177-9388a5f28c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:42.517716 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb598746-f539-4bd0-9177-9388a5f28c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:42.519162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb598746-f539-4bd0-9177-9388a5f28c9f service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:42.529610 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1088/2174] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:52:42.777838 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a0b28-5c75-4d6e-bcdc-1965cdcc13b4 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:42.779279 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b35a0b28-5c75-4d6e-bcdc-1965cdcc13b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:42.793117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35a0b28-5c75-4d6e-bcdc-1965cdcc13b4 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:42.810343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c86726-8709-4b3b-8f9d-196e5172cbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:42.812434 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c86726-8709-4b3b-8f9d-196e5172cbed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:42.812950 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c86726-8709-4b3b-8f9d-196e5172cbed admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:42.813372 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c86726-8709-4b3b-8f9d-196e5172cbed admin admin] PATH_INFO: `/v3/projects/1f1a0be2847d45a78f690fcd36be1e23` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:42.816355 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c86726-8709-4b3b-8f9d-196e5172cbed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f1a0be2847d45a78f690fcd36be1e23)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:42.816958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c86726-8709-4b3b-8f9d-196e5172cbed admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:42.941320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-d8c86726-8709-4b3b-8f9d-196e5172cbed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f1a0be2847d45a78f690fcd36be1e23', 'request_id': 'req-d8c86726-8709-4b3b-8f9d-196e5172cbed'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:42.949008 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-d8c86726-8709-4b3b-8f9d-196e5172cbed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f1a0be2847d45a78f690fcd36be1e23', 'request_id': 'req-d8c86726-8709-4b3b-8f9d-196e5172cbed'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:43.035023 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-d8c86726-8709-4b3b-8f9d-196e5172cbed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f1a0be2847d45a78f690fcd36be1e23', 'request_id': 'req-d8c86726-8709-4b3b-8f9d-196e5172cbed'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:43.050041 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-d8c86726-8709-4b3b-8f9d-196e5172cbed admin admin] The token cache is being invalidate because project 1f1a0be2847d45a78f690fcd36be1e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:52:43.050596 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-d8c86726-8709-4b3b-8f9d-196e5172cbed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:43.051260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-d8c86726-8709-4b3b-8f9d-196e5172cbed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:43.053312 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1087/2175] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:52:42 2022] DELETE /identity/v3/projects/1f1a0be2847d45a78f690fcd36be1e23 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:43.058022 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b2984-2057-4ed3-9a13-ca82461ac968 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:43.058552 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b2984-2057-4ed3-9a13-ca82461ac968 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:43.058552 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b2984-2057-4ed3-9a13-ca82461ac968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:43.077204 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-ce4b2984-2057-4ed3-9a13-ca82461ac968 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:43.078423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ce4b2984-2057-4ed3-9a13-ca82461ac968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:43.110100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:43.151162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1089/2176] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:43.160690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878d170-965c-4ea4-a178-b61eb88c5081 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:43.160690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878d170-965c-4ea4-a178-b61eb88c5081 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:43.160690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878d170-965c-4ea4-a178-b61eb88c5081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:43.183561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-b878d170-965c-4ea4-a178-b61eb88c5081 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:43.189317 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b878d170-965c-4ea4-a178-b61eb88c5081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:43.206039 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1088/2177] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:43.210204 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b2984-2057-4ed3-9a13-ca82461ac968 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:43.220733 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b2984-2057-4ed3-9a13-ca82461ac968 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:43.225505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005bf45-e530-43f8-8c65-ff8c6dbf5e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:43.226427 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005bf45-e530-43f8-8c65-ff8c6dbf5e35 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:43.226718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005bf45-e530-43f8-8c65-ff8c6dbf5e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:43.229438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005bf45-e530-43f8-8c65-ff8c6dbf5e35 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:43.229438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005bf45-e530-43f8-8c65-ff8c6dbf5e35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:52:43.229438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005bf45-e530-43f8-8c65-ff8c6dbf5e35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:43.231103 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005bf45-e530-43f8-8c65-ff8c6dbf5e35 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:43.243258 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1090/2178] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:52:43.247799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878d170-965c-4ea4-a178-b61eb88c5081 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:43.258566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878d170-965c-4ea4-a178-b61eb88c5081 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:43.264449 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1773dc8-ff03-4a27-9f86-9012b1259c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:43.265319 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1773dc8-ff03-4a27-9f86-9012b1259c67 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:43.265710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1773dc8-ff03-4a27-9f86-9012b1259c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:43.266099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1773dc8-ff03-4a27-9f86-9012b1259c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:43.267015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1773dc8-ff03-4a27-9f86-9012b1259c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:43.269428 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1773dc8-ff03-4a27-9f86-9012b1259c67 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:43.384592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1089/2179] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:52:43 2022] POST /identity/v3/projects => generated 399 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:43.387404 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005bf45-e530-43f8-8c65-ff8c6dbf5e35 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:43.398033 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005bf45-e530-43f8-8c65-ff8c6dbf5e35 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:43.468448 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8aad3e-4284-4cf1-a843-d27d0617bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:43.469287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aad3e-4284-4cf1-a843-d27d0617bfab admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:43.469574 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aad3e-4284-4cf1-a843-d27d0617bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:43.469850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8aad3e-4284-4cf1-a843-d27d0617bfab admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:43.470561 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8aad3e-4284-4cf1-a843-d27d0617bfab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:43.472526 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8aad3e-4284-4cf1-a843-d27d0617bfab admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:43.607505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1091/2180] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:52:43 2022] POST /identity/v3/users => generated 300 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:52:43.608681 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1773dc8-ff03-4a27-9f86-9012b1259c67 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:43.619924 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1773dc8-ff03-4a27-9f86-9012b1259c67 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:43.625183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ff882-c721-4aea-85e2-ede204eb6cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:43.625851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ff882-c721-4aea-85e2-ede204eb6cfc admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:43.626136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ff882-c721-4aea-85e2-ede204eb6cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:43.626415 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ff882-c721-4aea-85e2-ede204eb6cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:43.627454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ff882-c721-4aea-85e2-ede204eb6cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:43.629202 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ff882-c721-4aea-85e2-ede204eb6cfc admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:43.640892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1090/2181] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:43.645548 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8aad3e-4284-4cf1-a843-d27d0617bfab admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:43.656094 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8aad3e-4284-4cf1-a843-d27d0617bfab admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:43.661088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453767f-702f-4516-a61d-5cf516b5b013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:43.661780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453767f-702f-4516-a61d-5cf516b5b013 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:43.662066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453767f-702f-4516-a61d-5cf516b5b013 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:43.662344 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453767f-702f-4516-a61d-5cf516b5b013 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:43.663072 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453767f-702f-4516-a61d-5cf516b5b013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:43.668977 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453767f-702f-4516-a61d-5cf516b5b013 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:43.675466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1092/2182] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:52:43.679836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ff882-c721-4aea-85e2-ede204eb6cfc admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:43.690393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ff882-c721-4aea-85e2-ede204eb6cfc admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:43.694914 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193961d-a20e-4908-8067-65ab74126577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:43.695824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193961d-a20e-4908-8067-65ab74126577 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:43.696114 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193961d-a20e-4908-8067-65ab74126577 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:43.696386 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193961d-a20e-4908-8067-65ab74126577 admin admin] PATH_INFO: `/v3/projects/b751a2f6866146de805eb4a48dd73b35/users/5658ad3e7c0f4cb3970347f5482fcb94/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:43.711273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193961d-a20e-4908-8067-65ab74126577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b751a2f6866146de805eb4a48dd73b35, user_id=5658ad3e7c0f4cb3970347f5482fcb94, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:43.714007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193961d-a20e-4908-8067-65ab74126577 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:43.805394 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1091/2183] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:52:43 2022] PUT /identity/v3/projects/b751a2f6866146de805eb4a48dd73b35/users/5658ad3e7c0f4cb3970347f5482fcb94/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:43.816281 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ce58-87da-4675-8ac7-f80383956845 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:43.816665 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ce58-87da-4675-8ac7-f80383956845 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:43.817029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096ce58-87da-4675-8ac7-f80383956845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:43.845176 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-1096ce58-87da-4675-8ac7-f80383956845 None None] MFA Rules not processed for user `5658ad3e7c0f4cb3970347f5482fcb94`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:43.846492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-1096ce58-87da-4675-8ac7-f80383956845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:43.928054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1093/2184] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:43 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:43.940431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193961d-a20e-4908-8067-65ab74126577 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:43.942290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-3193961d-a20e-4908-8067-65ab74126577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:44.009264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193961d-a20e-4908-8067-65ab74126577 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:44.012990 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e070b-2bc2-4836-b045-26ed57029945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:44.013634 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e070b-2bc2-4836-b045-26ed57029945 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:44.013927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e070b-2bc2-4836-b045-26ed57029945 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:44.014191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e070b-2bc2-4836-b045-26ed57029945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:44.023755 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e070b-2bc2-4836-b045-26ed57029945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:44.026320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e070b-2bc2-4836-b045-26ed57029945 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:44.036090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1092/2185] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:52:49.580238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096ce58-87da-4675-8ac7-f80383956845 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:49.580238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-1096ce58-87da-4675-8ac7-f80383956845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:49.594718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096ce58-87da-4675-8ac7-f80383956845 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:49.599588 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f189eb9f-9c3f-4ade-9e1a-8fe04eeb0252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:49.600321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189eb9f-9c3f-4ade-9e1a-8fe04eeb0252 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:49.600675 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189eb9f-9c3f-4ade-9e1a-8fe04eeb0252 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:49.601282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f189eb9f-9c3f-4ade-9e1a-8fe04eeb0252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:49.603319 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-f189eb9f-9c3f-4ade-9e1a-8fe04eeb0252 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:49.637440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:49.675883 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189eb9f-9c3f-4ade-9e1a-8fe04eeb0252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:49.677334 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f189eb9f-9c3f-4ade-9e1a-8fe04eeb0252 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:49.688160 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1094/2186] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:49 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:52:50.660993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e070b-2bc2-4836-b045-26ed57029945 service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:50.671767 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:50.726471 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5b023-65a4-45a3-b018-fbc01015da31 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:50.727004 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5b023-65a4-45a3-b018-fbc01015da31 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:50.729405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5b023-65a4-45a3-b018-fbc01015da31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:50.736079 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e070b-2bc2-4836-b045-26ed57029945 service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:50.747570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-a2c5b023-65a4-45a3-b018-fbc01015da31 None None] MFA Rules not processed for user `89794cd59f4d44318aff08fe38de3dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:50.747570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-a2c5b023-65a4-45a3-b018-fbc01015da31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:50.747894 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115db47-d1da-4231-87cc-0a104debc438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:50.753019 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115db47-d1da-4231-87cc-0a104debc438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:50.753410 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115db47-d1da-4231-87cc-0a104debc438 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:50.753950 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115db47-d1da-4231-87cc-0a104debc438 admin admin] PATH_INFO: `/v3/users/5658ad3e7c0f4cb3970347f5482fcb94` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:50.755412 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115db47-d1da-4231-87cc-0a104debc438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5658ad3e7c0f4cb3970347f5482fcb94)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:50.757699 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115db47-d1da-4231-87cc-0a104debc438 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:50.811886 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1095/2187] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:50.980533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f115db47-d1da-4231-87cc-0a104debc438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5658ad3e7c0f4cb3970347f5482fcb94'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:51.090383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f115db47-d1da-4231-87cc-0a104debc438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5658ad3e7c0f4cb3970347f5482fcb94'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:51.112042 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f115db47-d1da-4231-87cc-0a104debc438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5658ad3e7c0f4cb3970347f5482fcb94'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:51.126482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f115db47-d1da-4231-87cc-0a104debc438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5658ad3e7c0f4cb3970347f5482fcb94'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:51.127394 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f115db47-d1da-4231-87cc-0a104debc438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5658ad3e7c0f4cb3970347f5482fcb94'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:51.134609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1093/2188] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:52:50 2022] DELETE /identity/v3/users/5658ad3e7c0f4cb3970347f5482fcb94 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:51.139141 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86beead-72ba-4c9f-a085-901afbeca2c0 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:51.139440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86beead-72ba-4c9f-a085-901afbeca2c0 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:51.139783 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86beead-72ba-4c9f-a085-901afbeca2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:51.163284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-d86beead-72ba-4c9f-a085-901afbeca2c0 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:51.164824 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d86beead-72ba-4c9f-a085-901afbeca2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:51.258679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1096/2189] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:51.268128 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115db47-d1da-4231-87cc-0a104debc438 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:51.269662 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f115db47-d1da-4231-87cc-0a104debc438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:51.336910 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115db47-d1da-4231-87cc-0a104debc438 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:51.340684 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995b865c-ca89-4724-b1ce-26b7f7c3e06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:51.341451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b865c-ca89-4724-b1ce-26b7f7c3e06c service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:51.342199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b865c-ca89-4724-b1ce-26b7f7c3e06c service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:51.342199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995b865c-ca89-4724-b1ce-26b7f7c3e06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:51.352967 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b865c-ca89-4724-b1ce-26b7f7c3e06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:51.354561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995b865c-ca89-4724-b1ce-26b7f7c3e06c service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:51.365840 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1094/2190] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:52:51.979050 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86beead-72ba-4c9f-a085-901afbeca2c0 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:51.980796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d86beead-72ba-4c9f-a085-901afbeca2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:51.994272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86beead-72ba-4c9f-a085-901afbeca2c0 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:52.003067 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3ccee-22dc-430d-8387-52eed8bc1b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:52.005580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3ccee-22dc-430d-8387-52eed8bc1b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:52.005580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3ccee-22dc-430d-8387-52eed8bc1b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:52.005580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3ccee-22dc-430d-8387-52eed8bc1b3b admin admin] PATH_INFO: `/v3/projects/b751a2f6866146de805eb4a48dd73b35` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:52.006357 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3ccee-22dc-430d-8387-52eed8bc1b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b751a2f6866146de805eb4a48dd73b35)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:52.009191 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef3ccee-22dc-430d-8387-52eed8bc1b3b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:52.159998 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8ef3ccee-22dc-430d-8387-52eed8bc1b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b751a2f6866146de805eb4a48dd73b35', 'request_id': 'req-8ef3ccee-22dc-430d-8387-52eed8bc1b3b'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:52.218847 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8ef3ccee-22dc-430d-8387-52eed8bc1b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b751a2f6866146de805eb4a48dd73b35', 'request_id': 'req-8ef3ccee-22dc-430d-8387-52eed8bc1b3b'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:52.224400 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:52.231444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8ef3ccee-22dc-430d-8387-52eed8bc1b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b751a2f6866146de805eb4a48dd73b35', 'request_id': 'req-8ef3ccee-22dc-430d-8387-52eed8bc1b3b'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:52.239447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8ef3ccee-22dc-430d-8387-52eed8bc1b3b admin admin] The token cache is being invalidate because project b751a2f6866146de805eb4a48dd73b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:52:52.239943 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8ef3ccee-22dc-430d-8387-52eed8bc1b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:52.240656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8ef3ccee-22dc-430d-8387-52eed8bc1b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:52:52.242276 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1097/2191] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:52:51 2022] DELETE /identity/v3/projects/b751a2f6866146de805eb4a48dd73b35 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:52:53.110331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df124ab-e173-4e2f-90f5-2fa8b7ab3938 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:53.110331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df124ab-e173-4e2f-90f5-2fa8b7ab3938 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:53.110331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df124ab-e173-4e2f-90f5-2fa8b7ab3938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:53.125562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-2df124ab-e173-4e2f-90f5-2fa8b7ab3938 None None] MFA Rules not processed for user `f455a84e20834cec8b84aa88ef263b56`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:53.126771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2df124ab-e173-4e2f-90f5-2fa8b7ab3938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:53.152714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:52:53.181314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1095/2192] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:52:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:59.096434 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db4496-382b-4117-bab0-4bfa4bc0c457 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:59.096919 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db4496-382b-4117-bab0-4bfa4bc0c457 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:59.097094 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db4496-382b-4117-bab0-4bfa4bc0c457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:59.117386 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-c6db4496-382b-4117-bab0-4bfa4bc0c457 None None] MFA Rules not processed for user `6e6313c444eb4a788b6559eff17959f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:52:59.122660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c6db4496-382b-4117-bab0-4bfa4bc0c457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:59.181360 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1098/2193] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jun 27 18:52:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:52:59.196702 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df124ab-e173-4e2f-90f5-2fa8b7ab3938 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:52:59.198725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2df124ab-e173-4e2f-90f5-2fa8b7ab3938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:52:59.291096 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df124ab-e173-4e2f-90f5-2fa8b7ab3938 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:52:59.297474 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c3a29-a16f-4306-ae08-0046e5ef989c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94555ff897d94c90968c470d82ff9e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:52:59.298430 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c3a29-a16f-4306-ae08-0046e5ef989c service swift] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:52:59.298696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c3a29-a16f-4306-ae08-0046e5ef989c service swift] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:52:59.298973 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c3a29-a16f-4306-ae08-0046e5ef989c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:52:59.308821 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c3a29-a16f-4306-ae08-0046e5ef989c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:52:59.312046 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c3a29-a16f-4306-ae08-0046e5ef989c service swift] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:52:59.321501 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1096/2194] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jun 27 18:52:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 18:53:03.698531 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b9631-2f8b-470d-bd67-6c15d3819f01 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:03.699028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b9631-2f8b-470d-bd67-6c15d3819f01 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:03.699221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62b9631-2f8b-470d-bd67-6c15d3819f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:03.737829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-a62b9631-2f8b-470d-bd67-6c15d3819f01 None None] MFA Rules not processed for user `6e6313c444eb4a788b6559eff17959f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:03.739810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-a62b9631-2f8b-470d-bd67-6c15d3819f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:03.753114 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1099/2195] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jun 27 18:53:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:53:03.770798 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c3a29-a16f-4306-ae08-0046e5ef989c service swift] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:03.782707 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c3a29-a16f-4306-ae08-0046e5ef989c service swift] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:03.801737 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec223af5-fe3e-461c-89d7-c40b7071f8f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94555ff897d94c90968c470d82ff9e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:03.805841 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec223af5-fe3e-461c-89d7-c40b7071f8f8 service swift] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:03.805841 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec223af5-fe3e-461c-89d7-c40b7071f8f8 service swift] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:03.805841 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec223af5-fe3e-461c-89d7-c40b7071f8f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:03.816659 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec223af5-fe3e-461c-89d7-c40b7071f8f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:03.818882 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec223af5-fe3e-461c-89d7-c40b7071f8f8 service swift] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:03.829771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1097/2196] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jun 27 18:53:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 18:53:13.715577 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:DELETE=1,keystone:SELECT=32 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:13.826514 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=49 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:20.077613 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b9631-2f8b-470d-bd67-6c15d3819f01 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:20.079328 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-a62b9631-2f8b-470d-bd67-6c15d3819f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:20.304011 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62b9631-2f8b-470d-bd67-6c15d3819f01 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:20.308955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe983aad-ba09-4668-8daa-b4d2f6067a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:20.309941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe983aad-ba09-4668-8daa-b4d2f6067a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:20.310226 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe983aad-ba09-4668-8daa-b4d2f6067a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:20.310504 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe983aad-ba09-4668-8daa-b4d2f6067a2f admin admin] PATH_INFO: `/v3/users/eb789e5f96f44d58bb1547279c60d911` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:20.312333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe983aad-ba09-4668-8daa-b4d2f6067a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb789e5f96f44d58bb1547279c60d911)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:20.314342 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe983aad-ba09-4668-8daa-b4d2f6067a2f admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:20.581927 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-fe983aad-ba09-4668-8daa-b4d2f6067a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb789e5f96f44d58bb1547279c60d911'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:20.642832 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-fe983aad-ba09-4668-8daa-b4d2f6067a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb789e5f96f44d58bb1547279c60d911'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:20.663107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-fe983aad-ba09-4668-8daa-b4d2f6067a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb789e5f96f44d58bb1547279c60d911'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:20.663917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-fe983aad-ba09-4668-8daa-b4d2f6067a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb789e5f96f44d58bb1547279c60d911'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:20.674074 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-fe983aad-ba09-4668-8daa-b4d2f6067a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb789e5f96f44d58bb1547279c60d911'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:20.688570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1100/2197] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:53:20 2022] DELETE /identity/v3/users/eb789e5f96f44d58bb1547279c60d911 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:53:21.108122 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec223af5-fe3e-461c-89d7-c40b7071f8f8 service swift] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:21.153998 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec223af5-fe3e-461c-89d7-c40b7071f8f8 service swift] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:21.230108 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:21.231001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:21.231285 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:21.231593 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b admin admin] PATH_INFO: `/v3/projects/26d66a96a4f64665871dd134a108b125` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:21.232858 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d66a96a4f64665871dd134a108b125)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:21.234818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:21.351760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d66a96a4f64665871dd134a108b125', 'request_id': 'req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:21.357801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d66a96a4f64665871dd134a108b125', 'request_id': 'req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:21.428433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d66a96a4f64665871dd134a108b125', 'request_id': 'req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:21.440207 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b admin admin] The token cache is being invalidate because project 26d66a96a4f64665871dd134a108b125 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:53:21.440499 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:21.441129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:21.442676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1098/2198] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:53:21 2022] DELETE /identity/v3/projects/26d66a96a4f64665871dd134a108b125 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:53:21.446567 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe983aad-ba09-4668-8daa-b4d2f6067a2f admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:21.448094 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-fe983aad-ba09-4668-8daa-b4d2f6067a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:21.461149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe983aad-ba09-4668-8daa-b4d2f6067a2f admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:21.473161 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:21.517945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c31429-24e1-4572-9c0e-26f2549df2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:21.518798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c31429-24e1-4572-9c0e-26f2549df2a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:21.519082 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c31429-24e1-4572-9c0e-26f2549df2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:21.519388 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c31429-24e1-4572-9c0e-26f2549df2a8 admin admin] PATH_INFO: `/v3/users/d06dff199ec942b9858d17e83ebef052` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:21.520620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c31429-24e1-4572-9c0e-26f2549df2a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d06dff199ec942b9858d17e83ebef052)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:21.522550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c31429-24e1-4572-9c0e-26f2549df2a8 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:21.717728 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-f2c31429-24e1-4572-9c0e-26f2549df2a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd06dff199ec942b9858d17e83ebef052'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:21.788121 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-f2c31429-24e1-4572-9c0e-26f2549df2a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd06dff199ec942b9858d17e83ebef052'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:21.801003 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-f2c31429-24e1-4572-9c0e-26f2549df2a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd06dff199ec942b9858d17e83ebef052'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:21.801639 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-f2c31429-24e1-4572-9c0e-26f2549df2a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd06dff199ec942b9858d17e83ebef052'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:21.808449 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-f2c31429-24e1-4572-9c0e-26f2549df2a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd06dff199ec942b9858d17e83ebef052'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:21.814406 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1101/2199] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:53:21 2022] DELETE /identity/v3/users/d06dff199ec942b9858d17e83ebef052 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:53:22.037262 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:22.038996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:22.052101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2b1cb-1a84-46c3-8598-ac8b7dd7818b admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:22.109408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e37b70-f6f3-419c-ba3e-e0a142daa8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:22.110273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e37b70-f6f3-419c-ba3e-e0a142daa8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:22.110553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e37b70-f6f3-419c-ba3e-e0a142daa8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:22.110829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e37b70-f6f3-419c-ba3e-e0a142daa8ca admin admin] PATH_INFO: `/v3/projects/98d3f81379b0407e8c35218076e560b5` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:22.112031 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e37b70-f6f3-419c-ba3e-e0a142daa8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=98d3f81379b0407e8c35218076e560b5)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:22.113951 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e37b70-f6f3-419c-ba3e-e0a142daa8ca admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:22.121840 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:22.229022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-77e37b70-f6f3-419c-ba3e-e0a142daa8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98d3f81379b0407e8c35218076e560b5', 'request_id': 'req-77e37b70-f6f3-419c-ba3e-e0a142daa8ca'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:22.235664 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-77e37b70-f6f3-419c-ba3e-e0a142daa8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98d3f81379b0407e8c35218076e560b5', 'request_id': 'req-77e37b70-f6f3-419c-ba3e-e0a142daa8ca'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:22.297328 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-77e37b70-f6f3-419c-ba3e-e0a142daa8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98d3f81379b0407e8c35218076e560b5', 'request_id': 'req-77e37b70-f6f3-419c-ba3e-e0a142daa8ca'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:22.310008 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-77e37b70-f6f3-419c-ba3e-e0a142daa8ca admin admin] The token cache is being invalidate because project 98d3f81379b0407e8c35218076e560b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:53:22.310305 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-77e37b70-f6f3-419c-ba3e-e0a142daa8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:22.310946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-77e37b70-f6f3-419c-ba3e-e0a142daa8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:22.312904 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1099/2200] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:53:22 2022] DELETE /identity/v3/projects/98d3f81379b0407e8c35218076e560b5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:53:22.317554 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b7f2b-05b6-4262-a3f4-cfd853248e17 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:22.317848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b7f2b-05b6-4262-a3f4-cfd853248e17 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:22.318131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b7f2b-05b6-4262-a3f4-cfd853248e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:22.376484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-663b7f2b-05b6-4262-a3f4-cfd853248e17 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:22.377798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-663b7f2b-05b6-4262-a3f4-cfd853248e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:22.436018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1102/2201] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:22.443810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196565af-a2d5-4212-8a1f-a0885474b669 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:22.444413 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196565af-a2d5-4212-8a1f-a0885474b669 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:22.444413 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196565af-a2d5-4212-8a1f-a0885474b669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:22.462229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-196565af-a2d5-4212-8a1f-a0885474b669 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:22.463429 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-196565af-a2d5-4212-8a1f-a0885474b669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:22.471563 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1100/2202] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:53:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:22.475766 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b7f2b-05b6-4262-a3f4-cfd853248e17 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:22.485145 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b7f2b-05b6-4262-a3f4-cfd853248e17 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:22.489668 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277e11-03f7-4a41-98b7-6eab5add461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:22.490308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277e11-03f7-4a41-98b7-6eab5add461a admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:22.490592 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277e11-03f7-4a41-98b7-6eab5add461a admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:22.490869 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277e11-03f7-4a41-98b7-6eab5add461a admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:22.492199 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41277e11-03f7-4a41-98b7-6eab5add461a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:53:22.492511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41277e11-03f7-4a41-98b7-6eab5add461a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:22.494161 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41277e11-03f7-4a41-98b7-6eab5add461a admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:22.495621 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:22.506084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1103/2203] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:53:22.510849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196565af-a2d5-4212-8a1f-a0885474b669 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:22.520019 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196565af-a2d5-4212-8a1f-a0885474b669 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:22.525077 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72d4be-b665-480e-a1ad-6b921718745b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:22.525421 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72d4be-b665-480e-a1ad-6b921718745b admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:22.525704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72d4be-b665-480e-a1ad-6b921718745b admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:22.525981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72d4be-b665-480e-a1ad-6b921718745b admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:22.526695 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72d4be-b665-480e-a1ad-6b921718745b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:22.528639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72d4be-b665-480e-a1ad-6b921718745b admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:22.624663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1101/2204] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:53:22 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:53:22.628834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277e11-03f7-4a41-98b7-6eab5add461a admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:22.639945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277e11-03f7-4a41-98b7-6eab5add461a admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:22.672243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0172e6-eb6e-4337-8009-ca23220c0b6f None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:22.672535 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0172e6-eb6e-4337-8009-ca23220c0b6f None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:22.672813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0172e6-eb6e-4337-8009-ca23220c0b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:22.699778 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2a39e-9f7c-44c4-b866-402db1d523ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:22.700441 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2a39e-9f7c-44c4-b866-402db1d523ca admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:22.700554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-bc0172e6-eb6e-4337-8009-ca23220c0b6f None None] MFA Rules not processed for user `6e6313c444eb4a788b6559eff17959f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:22.700725 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2a39e-9f7c-44c4-b866-402db1d523ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:22.701001 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2a39e-9f7c-44c4-b866-402db1d523ca admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:22.701684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2a39e-9f7c-44c4-b866-402db1d523ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:22.701785 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-bc0172e6-eb6e-4337-8009-ca23220c0b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:22.703616 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2a39e-9f7c-44c4-b866-402db1d523ca admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:22.773228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1102/2205] 10.222.0.36 () {58 vars in 967 bytes} [Mon Jun 27 18:53:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:22.787032 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0172e6-eb6e-4337-8009-ca23220c0b6f None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:22.787326 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-bc0172e6-eb6e-4337-8009-ca23220c0b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:22.815980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1104/2206] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:53:22 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:53:22.817060 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2a39e-9f7c-44c4-b866-402db1d523ca admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:22.826920 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2a39e-9f7c-44c4-b866-402db1d523ca admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:22.834200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417d6e5-b39e-4746-a531-bb85449b2a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:22.835203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417d6e5-b39e-4746-a531-bb85449b2a4d admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:22.835705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417d6e5-b39e-4746-a531-bb85449b2a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:22.836088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417d6e5-b39e-4746-a531-bb85449b2a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:22.836975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417d6e5-b39e-4746-a531-bb85449b2a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:22.838797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:22.839848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417d6e5-b39e-4746-a531-bb85449b2a4d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:22.852499 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1105/2207] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:53:22.856383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417d6e5-b39e-4746-a531-bb85449b2a4d admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:22.861552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0172e6-eb6e-4337-8009-ca23220c0b6f None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:22.865961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417d6e5-b39e-4746-a531-bb85449b2a4d admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:22.867227 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c76d5-037e-4ca3-a5ac-6e51d8a5995b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94555ff897d94c90968c470d82ff9e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:22.867923 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c76d5-037e-4ca3-a5ac-6e51d8a5995b service swift] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:22.872864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c76d5-037e-4ca3-a5ac-6e51d8a5995b service swift] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:22.872864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c76d5-037e-4ca3-a5ac-6e51d8a5995b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:22.873065 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74661360-7865-4f13-a55e-4274b1f31c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:22.873065 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74661360-7865-4f13-a55e-4274b1f31c49 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:22.873065 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74661360-7865-4f13-a55e-4274b1f31c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:22.873065 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74661360-7865-4f13-a55e-4274b1f31c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:22.873431 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74661360-7865-4f13-a55e-4274b1f31c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:22.874783 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74661360-7865-4f13-a55e-4274b1f31c49 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:22.877646 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c76d5-037e-4ca3-a5ac-6e51d8a5995b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:22.879259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c76d5-037e-4ca3-a5ac-6e51d8a5995b service swift] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:22.885441 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1106/2208] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:53:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:53:22.887306 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1103/2209] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jun 27 18:53:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 18:53:22.892595 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74661360-7865-4f13-a55e-4274b1f31c49 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:22.902690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74661360-7865-4f13-a55e-4274b1f31c49 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:22.907824 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f424f48-eccd-4870-8cac-afd388e41a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:22.908913 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f424f48-eccd-4870-8cac-afd388e41a25 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:22.909195 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f424f48-eccd-4870-8cac-afd388e41a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:22.909470 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f424f48-eccd-4870-8cac-afd388e41a25 admin admin] PATH_INFO: `/v3/projects/05da0b9c2cf042069e61cd9e6033cf1c/users/514e653622554ad5be13d7c43bd05499/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:22.925928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f424f48-eccd-4870-8cac-afd388e41a25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05da0b9c2cf042069e61cd9e6033cf1c, user_id=514e653622554ad5be13d7c43bd05499, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:22.929830 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f424f48-eccd-4870-8cac-afd388e41a25 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:23.031139 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1107/2210] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:53:22 2022] PUT /identity/v3/projects/05da0b9c2cf042069e61cd9e6033cf1c/users/514e653622554ad5be13d7c43bd05499/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:53:23.044647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9064-c0dd-4561-b2c0-da8c318267ed None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:23.045304 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9064-c0dd-4561-b2c0-da8c318267ed None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:23.045764 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9064-c0dd-4561-b2c0-da8c318267ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:23.075315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-8d5e9064-c0dd-4561-b2c0-da8c318267ed None None] MFA Rules not processed for user `514e653622554ad5be13d7c43bd05499`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:23.080580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-8d5e9064-c0dd-4561-b2c0-da8c318267ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:23.141249 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1104/2211] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:53:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:23.156125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f424f48-eccd-4870-8cac-afd388e41a25 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:23.157845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0f424f48-eccd-4870-8cac-afd388e41a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:23.215007 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f424f48-eccd-4870-8cac-afd388e41a25 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:23.218670 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b248ca-1d64-4a3b-94cb-08147c93f5f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e59193e90e240f6b9876d0455eea355', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:23.219314 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b248ca-1d64-4a3b-94cb-08147c93f5f1 service glance] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:23.219629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b248ca-1d64-4a3b-94cb-08147c93f5f1 service glance] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:23.219908 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b248ca-1d64-4a3b-94cb-08147c93f5f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:23.229188 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b248ca-1d64-4a3b-94cb-08147c93f5f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:23.230620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b248ca-1d64-4a3b-94cb-08147c93f5f1 service glance] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:23.239523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1108/2212] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:53:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:53:25.188189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b54b91-b737-4216-b5d4-df651cb841e7 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:25.188765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b54b91-b737-4216-b5d4-df651cb841e7 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:25.188765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b54b91-b737-4216-b5d4-df651cb841e7 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:25.190206 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1105/2213] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jun 27 18:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:53:25.196352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93cc6d-cec6-4d56-a082-f71194c3173a None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:25.196783 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93cc6d-cec6-4d56-a082-f71194c3173a None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:25.196926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e93cc6d-cec6-4d56-a082-f71194c3173a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:25.215250 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-3e93cc6d-cec6-4d56-a082-f71194c3173a None None] MFA Rules not processed for user `da1746d29f9e4e8b8626ad4b11931cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:25.217031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3e93cc6d-cec6-4d56-a082-f71194c3173a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:25.271386 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:25.305773 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1109/2214] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jun 27 18:53:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:53:25.317347 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b54b91-b737-4216-b5d4-df651cb841e7 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:25.319015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-11b54b91-b737-4216-b5d4-df651cb841e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:25.333048 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b54b91-b737-4216-b5d4-df651cb841e7 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:25.337080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3df5a-0ebe-4b8c-ab45-535a1335be87 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e59193e90e240f6b9876d0455eea355', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:25.337726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3df5a-0ebe-4b8c-ab45-535a1335be87 service glance] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:25.338023 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3df5a-0ebe-4b8c-ab45-535a1335be87 service glance] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:25.338274 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3df5a-0ebe-4b8c-ab45-535a1335be87 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:25.348987 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3df5a-0ebe-4b8c-ab45-535a1335be87 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:25.350663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3df5a-0ebe-4b8c-ab45-535a1335be87 service glance] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:25.362090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1106/2215] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:53:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:53:25.630559 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedd027-0628-45c9-b83b-280420123aaa None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:25.631219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedd027-0628-45c9-b83b-280420123aaa None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:25.631219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedd027-0628-45c9-b83b-280420123aaa None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:25.632714 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1110/2216] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jun 27 18:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:53:25.638192 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fb63c-5f99-43d7-9a48-c7e19cdc542f None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:25.638620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fb63c-5f99-43d7-9a48-c7e19cdc542f None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:25.638905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924fb63c-5f99-43d7-9a48-c7e19cdc542f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:25.673205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-924fb63c-5f99-43d7-9a48-c7e19cdc542f None None] MFA Rules not processed for user `1e684ee875464138abc4e89060902100`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:25.674440 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-924fb63c-5f99-43d7-9a48-c7e19cdc542f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:25.735346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1107/2217] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jun 27 18:53:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:25.747153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedd027-0628-45c9-b83b-280420123aaa None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:25.748864 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-9fedd027-0628-45c9-b83b-280420123aaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:25.763227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedd027-0628-45c9-b83b-280420123aaa None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:25.767109 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608cfb4-f6b1-4a32-8f50-0b1da948766b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:25.767821 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608cfb4-f6b1-4a32-8f50-0b1da948766b service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:25.768136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608cfb4-f6b1-4a32-8f50-0b1da948766b service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:25.768418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608cfb4-f6b1-4a32-8f50-0b1da948766b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:25.776068 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608cfb4-f6b1-4a32-8f50-0b1da948766b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:25.777527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608cfb4-f6b1-4a32-8f50-0b1da948766b service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:25.786916 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1111/2218] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:53:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:53:25.911494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a0ed8-8026-4ad4-acfa-e8dd3dd64b90 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:25.911781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a0ed8-8026-4ad4-acfa-e8dd3dd64b90 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:25.912076 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a0ed8-8026-4ad4-acfa-e8dd3dd64b90 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:25.913511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1108/2219] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jun 27 18:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:53:25.918772 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1f9f3-d7aa-4abf-b98e-f8dd2ab7170b None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:25.919181 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1f9f3-d7aa-4abf-b98e-f8dd2ab7170b None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:25.919580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1f9f3-d7aa-4abf-b98e-f8dd2ab7170b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:25.941559 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-62c1f9f3-d7aa-4abf-b98e-f8dd2ab7170b None None] MFA Rules not processed for user `da1746d29f9e4e8b8626ad4b11931cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:25.942868 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-62c1f9f3-d7aa-4abf-b98e-f8dd2ab7170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:25.953646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1112/2220] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jun 27 18:53:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:25.964599 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a0ed8-8026-4ad4-acfa-e8dd3dd64b90 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:25.966643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-4b8a0ed8-8026-4ad4-acfa-e8dd3dd64b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:25.982712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a0ed8-8026-4ad4-acfa-e8dd3dd64b90 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:25.986373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb055b-64b4-42db-a0c2-d81a8a575c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:25.987094 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb055b-64b4-42db-a0c2-d81a8a575c0c service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:25.987377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb055b-64b4-42db-a0c2-d81a8a575c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:25.987876 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb055b-64b4-42db-a0c2-d81a8a575c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:25.999933 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb055b-64b4-42db-a0c2-d81a8a575c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:26.001647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb055b-64b4-42db-a0c2-d81a8a575c0c service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:26.014502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1109/2221] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:53:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:53:26.252216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1f9f3-d7aa-4abf-b98e-f8dd2ab7170b None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:26.253794 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-62c1f9f3-d7aa-4abf-b98e-f8dd2ab7170b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:26.342126 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1f9f3-d7aa-4abf-b98e-f8dd2ab7170b None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:26.347864 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47312ac9-2155-434c-bfad-fca36920f5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:26.348863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47312ac9-2155-434c-bfad-fca36920f5b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:26.349266 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47312ac9-2155-434c-bfad-fca36920f5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:26.349641 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47312ac9-2155-434c-bfad-fca36920f5b2 admin admin] PATH_INFO: `/v3/users/fa8b9968425f40189532fc5ca2daf5e4` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:26.351119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47312ac9-2155-434c-bfad-fca36920f5b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa8b9968425f40189532fc5ca2daf5e4)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:26.354068 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47312ac9-2155-434c-bfad-fca36920f5b2 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:26.530622 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-47312ac9-2155-434c-bfad-fca36920f5b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa8b9968425f40189532fc5ca2daf5e4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:26.634259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-47312ac9-2155-434c-bfad-fca36920f5b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa8b9968425f40189532fc5ca2daf5e4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:26.649741 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-47312ac9-2155-434c-bfad-fca36920f5b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa8b9968425f40189532fc5ca2daf5e4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:26.650381 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-47312ac9-2155-434c-bfad-fca36920f5b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa8b9968425f40189532fc5ca2daf5e4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:26.657396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-47312ac9-2155-434c-bfad-fca36920f5b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa8b9968425f40189532fc5ca2daf5e4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:26.663368 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1113/2222] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:53:26 2022] DELETE /identity/v3/users/fa8b9968425f40189532fc5ca2daf5e4 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:53:26.939986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb055b-64b4-42db-a0c2-d81a8a575c0c service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:26.951265 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb055b-64b4-42db-a0c2-d81a8a575c0c service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:26.988779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:27.017354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef28af4-b743-4c11-89e6-2dc9561fbf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:27.018235 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef28af4-b743-4c11-89e6-2dc9561fbf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:27.018519 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef28af4-b743-4c11-89e6-2dc9561fbf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:27.018798 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef28af4-b743-4c11-89e6-2dc9561fbf0e admin admin] PATH_INFO: `/v3/projects/9bf0f25dcc0641488bd4b10472a61a8d` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:27.020051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef28af4-b743-4c11-89e6-2dc9561fbf0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bf0f25dcc0641488bd4b10472a61a8d)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:27.021981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef28af4-b743-4c11-89e6-2dc9561fbf0e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:27.145651 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-eef28af4-b743-4c11-89e6-2dc9561fbf0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bf0f25dcc0641488bd4b10472a61a8d', 'request_id': 'req-eef28af4-b743-4c11-89e6-2dc9561fbf0e'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:27.153946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-eef28af4-b743-4c11-89e6-2dc9561fbf0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bf0f25dcc0641488bd4b10472a61a8d', 'request_id': 'req-eef28af4-b743-4c11-89e6-2dc9561fbf0e'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:27.217149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-eef28af4-b743-4c11-89e6-2dc9561fbf0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bf0f25dcc0641488bd4b10472a61a8d', 'request_id': 'req-eef28af4-b743-4c11-89e6-2dc9561fbf0e'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:27.229532 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-eef28af4-b743-4c11-89e6-2dc9561fbf0e admin admin] The token cache is being invalidate because project 9bf0f25dcc0641488bd4b10472a61a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:53:27.229805 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-eef28af4-b743-4c11-89e6-2dc9561fbf0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:27.230472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-eef28af4-b743-4c11-89e6-2dc9561fbf0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:27.232068 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1110/2223] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:53:26 2022] DELETE /identity/v3/projects/9bf0f25dcc0641488bd4b10472a61a8d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:53:27.237086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4364079-9aad-4771-ac5a-61346f30d996 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:27.237463 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4364079-9aad-4771-ac5a-61346f30d996 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:27.237844 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4364079-9aad-4771-ac5a-61346f30d996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:27.257685 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-d4364079-9aad-4771-ac5a-61346f30d996 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:27.258907 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d4364079-9aad-4771-ac5a-61346f30d996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:27.287282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:27.321361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1114/2224] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:27.328869 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ff638-664c-4d50-9a3c-a64c6ca4fe55 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:27.329160 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ff638-664c-4d50-9a3c-a64c6ca4fe55 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:27.333752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3ff638-664c-4d50-9a3c-a64c6ca4fe55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:27.347601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-ec3ff638-664c-4d50-9a3c-a64c6ca4fe55 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:27.348805 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ec3ff638-664c-4d50-9a3c-a64c6ca4fe55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:27.357321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1111/2225] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:27.361403 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4364079-9aad-4771-ac5a-61346f30d996 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:27.373189 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4364079-9aad-4771-ac5a-61346f30d996 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:27.378346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f2357-ab08-4869-a973-c4882e4be066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:27.379802 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f2357-ab08-4869-a973-c4882e4be066 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:27.379802 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f2357-ab08-4869-a973-c4882e4be066 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:27.379802 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f2357-ab08-4869-a973-c4882e4be066 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:27.380551 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f2357-ab08-4869-a973-c4882e4be066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:53:27.380916 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f2357-ab08-4869-a973-c4882e4be066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:27.382528 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f2357-ab08-4869-a973-c4882e4be066 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:27.394533 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1115/2226] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:53:27.398894 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ff638-664c-4d50-9a3c-a64c6ca4fe55 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:27.408099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3ff638-664c-4d50-9a3c-a64c6ca4fe55 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:27.412825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f6a34-97da-43b6-a985-d1bb63916980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:27.413476 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f6a34-97da-43b6-a985-d1bb63916980 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:27.413764 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f6a34-97da-43b6-a985-d1bb63916980 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:27.414046 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496f6a34-97da-43b6-a985-d1bb63916980 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:27.414743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f6a34-97da-43b6-a985-d1bb63916980 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:27.417208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496f6a34-97da-43b6-a985-d1bb63916980 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:27.525053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1112/2227] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:53:27 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:53:27.529218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f2357-ab08-4869-a973-c4882e4be066 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:27.541425 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f2357-ab08-4869-a973-c4882e4be066 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:27.611128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d6346-927b-4234-be36-d143310eabd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:27.611855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d6346-927b-4234-be36-d143310eabd1 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:27.612138 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d6346-927b-4234-be36-d143310eabd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:27.612413 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d6346-927b-4234-be36-d143310eabd1 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:27.613154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d6346-927b-4234-be36-d143310eabd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:27.615095 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d6346-927b-4234-be36-d143310eabd1 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:27.734246 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1116/2228] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:53:27 2022] POST /identity/v3/users => generated 291 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:53:27.738589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f6a34-97da-43b6-a985-d1bb63916980 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:27.749602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496f6a34-97da-43b6-a985-d1bb63916980 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:27.754169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4d983-7b83-415f-84e5-fc719e7c195c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:27.754808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4d983-7b83-415f-84e5-fc719e7c195c admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:27.755116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4d983-7b83-415f-84e5-fc719e7c195c admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:27.755392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4d983-7b83-415f-84e5-fc719e7c195c admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:27.756147 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4d983-7b83-415f-84e5-fc719e7c195c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:27.757743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4d983-7b83-415f-84e5-fc719e7c195c admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:27.769498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1113/2229] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:53:27.773545 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d6346-927b-4234-be36-d143310eabd1 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:27.784058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d6346-927b-4234-be36-d143310eabd1 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:27.788879 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fb4c4-346c-4441-9a7a-5b09206f7d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:27.789589 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fb4c4-346c-4441-9a7a-5b09206f7d86 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:27.789880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fb4c4-346c-4441-9a7a-5b09206f7d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:27.790190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fb4c4-346c-4441-9a7a-5b09206f7d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:27.790943 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fb4c4-346c-4441-9a7a-5b09206f7d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:27.792635 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fb4c4-346c-4441-9a7a-5b09206f7d86 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:27.803094 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1117/2230] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:53:27.807821 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4d983-7b83-415f-84e5-fc719e7c195c admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:27.818241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4d983-7b83-415f-84e5-fc719e7c195c admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:27.823686 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad9571-9159-41af-a4a3-3a50f12c259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:27.828392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad9571-9159-41af-a4a3-3a50f12c259a admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:27.828392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad9571-9159-41af-a4a3-3a50f12c259a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:27.828392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad9571-9159-41af-a4a3-3a50f12c259a admin admin] PATH_INFO: `/v3/projects/aebe1760a9014f68b0a4c25bd04e19e5/users/cf3f71b3974245979beef804ecea006d/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:27.839924 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad9571-9159-41af-a4a3-3a50f12c259a admin admin] RBAC: Authorizing `identity:create_grant(project_id=aebe1760a9014f68b0a4c25bd04e19e5, user_id=cf3f71b3974245979beef804ecea006d, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:27.842633 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfad9571-9159-41af-a4a3-3a50f12c259a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:27.944693 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1114/2231] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:53:27 2022] PUT /identity/v3/projects/aebe1760a9014f68b0a4c25bd04e19e5/users/cf3f71b3974245979beef804ecea006d/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:53:27.950012 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c58f4b-5595-4a02-b84c-57155d71a88b None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:27.950306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c58f4b-5595-4a02-b84c-57155d71a88b None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:27.950595 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c58f4b-5595-4a02-b84c-57155d71a88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:27.968813 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-35c58f4b-5595-4a02-b84c-57155d71a88b None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:27.970197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-35c58f4b-5595-4a02-b84c-57155d71a88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:28.037526 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1118/2232] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:28.048773 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad9571-9159-41af-a4a3-3a50f12c259a admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:28.050694 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-bfad9571-9159-41af-a4a3-3a50f12c259a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:28.109561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfad9571-9159-41af-a4a3-3a50f12c259a admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:28.113463 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf237db-bbf7-42d6-9a50-cd8142f7865b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:28.114110 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf237db-bbf7-42d6-9a50-cd8142f7865b service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:28.114389 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf237db-bbf7-42d6-9a50-cd8142f7865b service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:28.114666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf237db-bbf7-42d6-9a50-cd8142f7865b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:28.124950 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf237db-bbf7-42d6-9a50-cd8142f7865b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:28.126489 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf237db-bbf7-42d6-9a50-cd8142f7865b service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:28.131681 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:28.136587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1115/2233] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:53:29.513812 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad895f4-5b7a-46b3-a02a-01934cfdbc5f None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:29.513812 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad895f4-5b7a-46b3-a02a-01934cfdbc5f None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:29.513812 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad895f4-5b7a-46b3-a02a-01934cfdbc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:29.548981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-fad895f4-5b7a-46b3-a02a-01934cfdbc5f None None] MFA Rules not processed for user `cf3f71b3974245979beef804ecea006d`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:29.550457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-fad895f4-5b7a-46b3-a02a-01934cfdbc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:29.585302 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:29.633048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1119/2234] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:53:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:29.651560 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf237db-bbf7-42d6-9a50-cd8142f7865b service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:29.653213 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-4bf237db-bbf7-42d6-9a50-cd8142f7865b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:29.712827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf237db-bbf7-42d6-9a50-cd8142f7865b service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:29.716467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7106d1-2082-4447-9e1d-a9fa83ea222c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:29.717111 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7106d1-2082-4447-9e1d-a9fa83ea222c service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:29.717484 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7106d1-2082-4447-9e1d-a9fa83ea222c service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:29.717772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7106d1-2082-4447-9e1d-a9fa83ea222c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:29.726392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7106d1-2082-4447-9e1d-a9fa83ea222c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:29.727884 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7106d1-2082-4447-9e1d-a9fa83ea222c service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:29.736939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1116/2235] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:53:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:53:29.934663 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823173b-49af-4d93-b325-52e4e2f2e225 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:29.935057 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823173b-49af-4d93-b325-52e4e2f2e225 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:29.935409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823173b-49af-4d93-b325-52e4e2f2e225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:29.955015 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-0823173b-49af-4d93-b325-52e4e2f2e225 None None] MFA Rules not processed for user `6e6313c444eb4a788b6559eff17959f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:29.956472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0823173b-49af-4d93-b325-52e4e2f2e225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:30.023342 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1120/2236] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jun 27 18:53:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:30.036031 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7106d1-2082-4447-9e1d-a9fa83ea222c service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:30.037451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-da7106d1-2082-4447-9e1d-a9fa83ea222c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:30.109321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7106d1-2082-4447-9e1d-a9fa83ea222c service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:30.114357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7d698-ce55-40d7-90d6-3e8ea2c548e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94555ff897d94c90968c470d82ff9e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:30.115020 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7d698-ce55-40d7-90d6-3e8ea2c548e4 service swift] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:30.115281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7d698-ce55-40d7-90d6-3e8ea2c548e4 service swift] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:30.115578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7d698-ce55-40d7-90d6-3e8ea2c548e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:30.124173 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7d698-ce55-40d7-90d6-3e8ea2c548e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:30.125941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7d698-ce55-40d7-90d6-3e8ea2c548e4 service swift] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:30.134390 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1117/2237] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jun 27 18:53:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 18:53:31.533654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664415c-037e-4b8b-8592-6ea916e09009 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:31.533654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664415c-037e-4b8b-8592-6ea916e09009 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:31.533654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6664415c-037e-4b8b-8592-6ea916e09009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:31.569274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-6664415c-037e-4b8b-8592-6ea916e09009 None None] MFA Rules not processed for user `cf3f71b3974245979beef804ecea006d`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:31.571058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-6664415c-037e-4b8b-8592-6ea916e09009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:31.579001 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1121/2238] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:53:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:40.130799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=58 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:41.563194 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=46 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:41.797612 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7d698-ce55-40d7-90d6-3e8ea2c548e4 service swift] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:41.799161 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-60a7d698-ce55-40d7-90d6-3e8ea2c548e4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:41.813628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7d698-ce55-40d7-90d6-3e8ea2c548e4 service swift] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:41.818317 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5712d1-fd2d-44d7-a217-313a46eb42d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:41.819179 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5712d1-fd2d-44d7-a217-313a46eb42d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:41.819843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5712d1-fd2d-44d7-a217-313a46eb42d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:41.819843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5712d1-fd2d-44d7-a217-313a46eb42d7 admin admin] PATH_INFO: `/v3/users/514e653622554ad5be13d7c43bd05499` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:41.820909 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5712d1-fd2d-44d7-a217-313a46eb42d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=514e653622554ad5be13d7c43bd05499)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:41.823513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5712d1-fd2d-44d7-a217-313a46eb42d7 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:42.012520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ee5712d1-fd2d-44d7-a217-313a46eb42d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '514e653622554ad5be13d7c43bd05499'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:42.101635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ee5712d1-fd2d-44d7-a217-313a46eb42d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '514e653622554ad5be13d7c43bd05499'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:42.113976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ee5712d1-fd2d-44d7-a217-313a46eb42d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '514e653622554ad5be13d7c43bd05499'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:42.121325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ee5712d1-fd2d-44d7-a217-313a46eb42d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '514e653622554ad5be13d7c43bd05499'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:42.121958 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ee5712d1-fd2d-44d7-a217-313a46eb42d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '514e653622554ad5be13d7c43bd05499'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:42.127852 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1118/2239] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:53:41 2022] DELETE /identity/v3/users/514e653622554ad5be13d7c43bd05499 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:53:42.132273 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e03518-b4e1-4d3b-904d-67d893edbf4c None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:42.132592 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e03518-b4e1-4d3b-904d-67d893edbf4c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:42.132874 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e03518-b4e1-4d3b-904d-67d893edbf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:42.150004 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-73e03518-b4e1-4d3b-904d-67d893edbf4c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:42.151205 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-73e03518-b4e1-4d3b-904d-67d893edbf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:42.208666 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1122/2240] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:42.218141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5712d1-fd2d-44d7-a217-313a46eb42d7 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:42.219862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ee5712d1-fd2d-44d7-a217-313a46eb42d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:42.277608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5712d1-fd2d-44d7-a217-313a46eb42d7 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:42.281242 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b1f52-50c1-4440-a7b1-6eb54af7c6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:42.281890 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b1f52-50c1-4440-a7b1-6eb54af7c6dc service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:42.282174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b1f52-50c1-4440-a7b1-6eb54af7c6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:42.282451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b1f52-50c1-4440-a7b1-6eb54af7c6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:42.292166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b1f52-50c1-4440-a7b1-6eb54af7c6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:42.293607 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b1f52-50c1-4440-a7b1-6eb54af7c6dc service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:42.303325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1119/2241] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:53:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:53:42.700582 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e03518-b4e1-4d3b-904d-67d893edbf4c None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:42.701116 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-73e03518-b4e1-4d3b-904d-67d893edbf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:42.714734 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e03518-b4e1-4d3b-904d-67d893edbf4c None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:42.719905 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacc5ecc-f437-4737-917d-5b1f1597dc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:42.720787 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc5ecc-f437-4737-917d-5b1f1597dc14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:42.721179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc5ecc-f437-4737-917d-5b1f1597dc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:42.721517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacc5ecc-f437-4737-917d-5b1f1597dc14 admin admin] PATH_INFO: `/v3/projects/05da0b9c2cf042069e61cd9e6033cf1c` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:42.722896 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc5ecc-f437-4737-917d-5b1f1597dc14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05da0b9c2cf042069e61cd9e6033cf1c)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:42.725365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacc5ecc-f437-4737-917d-5b1f1597dc14 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:42.876790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-dacc5ecc-f437-4737-917d-5b1f1597dc14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05da0b9c2cf042069e61cd9e6033cf1c', 'request_id': 'req-dacc5ecc-f437-4737-917d-5b1f1597dc14'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:42.977084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-dacc5ecc-f437-4737-917d-5b1f1597dc14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05da0b9c2cf042069e61cd9e6033cf1c', 'request_id': 'req-dacc5ecc-f437-4737-917d-5b1f1597dc14'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:42.984367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-dacc5ecc-f437-4737-917d-5b1f1597dc14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05da0b9c2cf042069e61cd9e6033cf1c', 'request_id': 'req-dacc5ecc-f437-4737-917d-5b1f1597dc14'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:42.996391 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-dacc5ecc-f437-4737-917d-5b1f1597dc14 admin admin] The token cache is being invalidate because project 05da0b9c2cf042069e61cd9e6033cf1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:53:42.996682 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-dacc5ecc-f437-4737-917d-5b1f1597dc14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:42.997346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-dacc5ecc-f437-4737-917d-5b1f1597dc14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:42.999121 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1123/2242] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:53:42 2022] DELETE /identity/v3/projects/05da0b9c2cf042069e61cd9e6033cf1c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:53:43.003896 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f84a0-ed7e-4f90-9daa-827ba2f3169b None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:43.004304 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f84a0-ed7e-4f90-9daa-827ba2f3169b None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:43.004443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f84a0-ed7e-4f90-9daa-827ba2f3169b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:43.023739 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-9b2f84a0-ed7e-4f90-9daa-827ba2f3169b None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:43.024970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9b2f84a0-ed7e-4f90-9daa-827ba2f3169b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:43.084400 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1120/2243] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:43.092630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e4402-3f6a-41d9-aa94-db4db6c50367 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:43.092923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e4402-3f6a-41d9-aa94-db4db6c50367 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:43.093233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e4402-3f6a-41d9-aa94-db4db6c50367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:43.112306 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-797e4402-3f6a-41d9-aa94-db4db6c50367 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:43.113631 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-797e4402-3f6a-41d9-aa94-db4db6c50367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:43.121521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1124/2244] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:43.125701 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f84a0-ed7e-4f90-9daa-827ba2f3169b None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:43.136190 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f84a0-ed7e-4f90-9daa-827ba2f3169b None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:43.141854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cfd89-dc03-4e00-b103-b0e91c155731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:43.141854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cfd89-dc03-4e00-b103-b0e91c155731 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:43.142079 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cfd89-dc03-4e00-b103-b0e91c155731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:43.142228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cfd89-dc03-4e00-b103-b0e91c155731 admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:43.142962 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cfd89-dc03-4e00-b103-b0e91c155731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:53:43.143272 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cfd89-dc03-4e00-b103-b0e91c155731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:43.144909 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cfd89-dc03-4e00-b103-b0e91c155731 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:43.157363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1121/2245] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:53:43.161483 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e4402-3f6a-41d9-aa94-db4db6c50367 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:43.170774 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e4402-3f6a-41d9-aa94-db4db6c50367 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:43.175450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adf704-dd57-47bd-97ea-8533904147bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:43.176137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adf704-dd57-47bd-97ea-8533904147bd admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:43.176454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adf704-dd57-47bd-97ea-8533904147bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:43.176733 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33adf704-dd57-47bd-97ea-8533904147bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:43.177426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adf704-dd57-47bd-97ea-8533904147bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:43.179372 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33adf704-dd57-47bd-97ea-8533904147bd admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:43.270470 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1125/2246] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:53:43 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:53:43.274549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cfd89-dc03-4e00-b103-b0e91c155731 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:43.279664 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:43.284901 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cfd89-dc03-4e00-b103-b0e91c155731 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:43.340617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6b02a-109a-412e-a01a-a8bcb13ca599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:43.341282 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6b02a-109a-412e-a01a-a8bcb13ca599 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:43.341568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6b02a-109a-412e-a01a-a8bcb13ca599 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:43.341848 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6b02a-109a-412e-a01a-a8bcb13ca599 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:43.342548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6b02a-109a-412e-a01a-a8bcb13ca599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:43.344525 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6b02a-109a-412e-a01a-a8bcb13ca599 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:43.442716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1122/2247] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:53:43 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:53:43.443262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adf704-dd57-47bd-97ea-8533904147bd admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:43.455182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33adf704-dd57-47bd-97ea-8533904147bd admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:43.460264 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c9222-9880-4dcb-80c6-aa02a6ad9e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:43.460935 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c9222-9880-4dcb-80c6-aa02a6ad9e96 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:43.461225 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c9222-9880-4dcb-80c6-aa02a6ad9e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:43.461507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c9222-9880-4dcb-80c6-aa02a6ad9e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:43.462287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c9222-9880-4dcb-80c6-aa02a6ad9e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:43.463912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c9222-9880-4dcb-80c6-aa02a6ad9e96 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:43.476166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1126/2248] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:53:43.480149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6b02a-109a-412e-a01a-a8bcb13ca599 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:43.490093 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6b02a-109a-412e-a01a-a8bcb13ca599 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:43.495397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2ac6a-cae2-42ec-9e18-61324829301c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:43.496093 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2ac6a-cae2-42ec-9e18-61324829301c admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:43.496399 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2ac6a-cae2-42ec-9e18-61324829301c admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:43.496721 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2ac6a-cae2-42ec-9e18-61324829301c admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:43.497458 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2ac6a-cae2-42ec-9e18-61324829301c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:43.499067 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2ac6a-cae2-42ec-9e18-61324829301c admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:43.511570 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1123/2249] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:53:43.514465 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c9222-9880-4dcb-80c6-aa02a6ad9e96 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:43.525083 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c9222-9880-4dcb-80c6-aa02a6ad9e96 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:43.531732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3271131-ba17-4395-9d45-0f8bf486e097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:43.532649 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3271131-ba17-4395-9d45-0f8bf486e097 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:43.532936 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3271131-ba17-4395-9d45-0f8bf486e097 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:43.533236 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3271131-ba17-4395-9d45-0f8bf486e097 admin admin] PATH_INFO: `/v3/projects/b76323cc52324952a4418d4cfb559371/users/ed1a729b9b64472daf340d4f865e0a81/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:43.549499 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3271131-ba17-4395-9d45-0f8bf486e097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76323cc52324952a4418d4cfb559371, user_id=ed1a729b9b64472daf340d4f865e0a81, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:43.552268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3271131-ba17-4395-9d45-0f8bf486e097 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:43.629525 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1127/2250] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:53:43 2022] PUT /identity/v3/projects/b76323cc52324952a4418d4cfb559371/users/ed1a729b9b64472daf340d4f865e0a81/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:53:43.640450 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec8ee6-49ef-42ee-9ea3-123c3d6c3616 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:43.640746 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec8ee6-49ef-42ee-9ea3-123c3d6c3616 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:43.641031 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec8ee6-49ef-42ee-9ea3-123c3d6c3616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:43.668422 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-4eec8ee6-49ef-42ee-9ea3-123c3d6c3616 None None] MFA Rules not processed for user `ed1a729b9b64472daf340d4f865e0a81`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:43.669666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-4eec8ee6-49ef-42ee-9ea3-123c3d6c3616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:43.734955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1124/2251] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:53:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:43.746991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3271131-ba17-4395-9d45-0f8bf486e097 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:43.749467 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c3271131-ba17-4395-9d45-0f8bf486e097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:43.774756 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:43.830857 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3271131-ba17-4395-9d45-0f8bf486e097 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:43.836884 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feacaf4-8003-4d53-a636-c0f30214df8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:43.839486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feacaf4-8003-4d53-a636-c0f30214df8a service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:43.839486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feacaf4-8003-4d53-a636-c0f30214df8a service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:43.839486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feacaf4-8003-4d53-a636-c0f30214df8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:43.847905 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feacaf4-8003-4d53-a636-c0f30214df8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:43.849533 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feacaf4-8003-4d53-a636-c0f30214df8a service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:43.859312 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1128/2252] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:53:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:53:46.883999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec8ee6-49ef-42ee-9ea3-123c3d6c3616 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:46.951359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec8ee6-49ef-42ee-9ea3-123c3d6c3616 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:46.955885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9b046-8197-4907-8aa4-3738e9e3ec78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:46.956752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9b046-8197-4907-8aa4-3738e9e3ec78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:46.957044 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9b046-8197-4907-8aa4-3738e9e3ec78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:46.957324 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9b046-8197-4907-8aa4-3738e9e3ec78 admin admin] PATH_INFO: `/v3/users/ed1a729b9b64472daf340d4f865e0a81` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:46.958507 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9b046-8197-4907-8aa4-3738e9e3ec78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed1a729b9b64472daf340d4f865e0a81)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:46.960475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9b046-8197-4907-8aa4-3738e9e3ec78 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:46.972682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:47.136515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9fc9b046-8197-4907-8aa4-3738e9e3ec78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed1a729b9b64472daf340d4f865e0a81'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:47.205848 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9fc9b046-8197-4907-8aa4-3738e9e3ec78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed1a729b9b64472daf340d4f865e0a81'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:47.218943 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9fc9b046-8197-4907-8aa4-3738e9e3ec78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed1a729b9b64472daf340d4f865e0a81'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:47.226045 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9fc9b046-8197-4907-8aa4-3738e9e3ec78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed1a729b9b64472daf340d4f865e0a81'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:47.226715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9fc9b046-8197-4907-8aa4-3738e9e3ec78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed1a729b9b64472daf340d4f865e0a81'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:47.232592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1125/2253] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:53:46 2022] DELETE /identity/v3/users/ed1a729b9b64472daf340d4f865e0a81 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:53:47.236946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a4aac-8381-48e5-b488-6888f95c99f0 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:47.237411 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a4aac-8381-48e5-b488-6888f95c99f0 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:47.237507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a4aac-8381-48e5-b488-6888f95c99f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:47.256327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-b75a4aac-8381-48e5-b488-6888f95c99f0 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:47.257527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b75a4aac-8381-48e5-b488-6888f95c99f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:47.316092 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1129/2254] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:53:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:47.325561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9b046-8197-4907-8aa4-3738e9e3ec78 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:47.326935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9fc9b046-8197-4907-8aa4-3738e9e3ec78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:47.383284 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9b046-8197-4907-8aa4-3738e9e3ec78 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:47.386943 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085d990-0fa5-4ffc-b0fe-376cf59685e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:47.387522 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085d990-0fa5-4ffc-b0fe-376cf59685e6 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:47.387831 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085d990-0fa5-4ffc-b0fe-376cf59685e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:47.388106 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085d990-0fa5-4ffc-b0fe-376cf59685e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:47.397357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085d990-0fa5-4ffc-b0fe-376cf59685e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:47.398791 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085d990-0fa5-4ffc-b0fe-376cf59685e6 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:47.408532 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1126/2255] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:53:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:53:47.842308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a4aac-8381-48e5-b488-6888f95c99f0 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:47.845083 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b75a4aac-8381-48e5-b488-6888f95c99f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:47.857902 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a4aac-8381-48e5-b488-6888f95c99f0 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:47.862578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319516c0-f045-44a0-8452-c861232c2cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:47.863431 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319516c0-f045-44a0-8452-c861232c2cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:47.863751 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319516c0-f045-44a0-8452-c861232c2cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:47.864034 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319516c0-f045-44a0-8452-c861232c2cd3 admin admin] PATH_INFO: `/v3/projects/b76323cc52324952a4418d4cfb559371` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:47.865223 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319516c0-f045-44a0-8452-c861232c2cd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76323cc52324952a4418d4cfb559371)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:47.867139 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319516c0-f045-44a0-8452-c861232c2cd3 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:47.971037 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-319516c0-f045-44a0-8452-c861232c2cd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76323cc52324952a4418d4cfb559371', 'request_id': 'req-319516c0-f045-44a0-8452-c861232c2cd3'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:47.992326 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085d990-0fa5-4ffc-b0fe-376cf59685e6 service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:47.993892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-6085d990-0fa5-4ffc-b0fe-376cf59685e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:48.040596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-319516c0-f045-44a0-8452-c861232c2cd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76323cc52324952a4418d4cfb559371', 'request_id': 'req-319516c0-f045-44a0-8452-c861232c2cd3'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:48.046651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-319516c0-f045-44a0-8452-c861232c2cd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76323cc52324952a4418d4cfb559371', 'request_id': 'req-319516c0-f045-44a0-8452-c861232c2cd3'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:48.058715 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-319516c0-f045-44a0-8452-c861232c2cd3 admin admin] The token cache is being invalidate because project b76323cc52324952a4418d4cfb559371 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:53:48.059157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-319516c0-f045-44a0-8452-c861232c2cd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:48.059818 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-319516c0-f045-44a0-8452-c861232c2cd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:53:48.061362 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1130/2256] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:53:47 2022] DELETE /identity/v3/projects/b76323cc52324952a4418d4cfb559371 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:53:48.091751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085d990-0fa5-4ffc-b0fe-376cf59685e6 service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:48.105005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:48.158068 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b269a0-7791-4883-8226-38e6f6dbd289 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af6ef16884604753972c916f74271f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:48.158728 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b269a0-7791-4883-8226-38e6f6dbd289 service placement] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:48.159038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b269a0-7791-4883-8226-38e6f6dbd289 service placement] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:48.159310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b269a0-7791-4883-8226-38e6f6dbd289 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:48.161264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-66b269a0-7791-4883-8226-38e6f6dbd289 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:48.173969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b269a0-7791-4883-8226-38e6f6dbd289 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:48.175639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b269a0-7791-4883-8226-38e6f6dbd289 service placement] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:48.186796 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1127/2257] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:53:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:53:49.863808 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bac0bf-734a-404e-9586-ed3161ca0fca None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:49.864265 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bac0bf-734a-404e-9586-ed3161ca0fca None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:49.864360 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bac0bf-734a-404e-9586-ed3161ca0fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:49.881921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-e8bac0bf-734a-404e-9586-ed3161ca0fca None None] MFA Rules not processed for user `6e6313c444eb4a788b6559eff17959f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:53:49.883129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e8bac0bf-734a-404e-9586-ed3161ca0fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:49.906249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:53:49.941864 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1131/2258] 10.222.0.36 () {58 vars in 967 bytes} [Mon Jun 27 18:53:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:53:49.971720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b269a0-7791-4883-8226-38e6f6dbd289 service placement] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:53:49.975560 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-66b269a0-7791-4883-8226-38e6f6dbd289 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:53:50.048367 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b269a0-7791-4883-8226-38e6f6dbd289 service placement] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:53:50.053277 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8abe0b-9595-4c04-9f49-85aa36a6ca7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94555ff897d94c90968c470d82ff9e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:53:50.053954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8abe0b-9595-4c04-9f49-85aa36a6ca7e service swift] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:53:50.054237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8abe0b-9595-4c04-9f49-85aa36a6ca7e service swift] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:53:50.054635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8abe0b-9595-4c04-9f49-85aa36a6ca7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:53:50.063250 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8abe0b-9595-4c04-9f49-85aa36a6ca7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:53:50.064876 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8abe0b-9595-4c04-9f49-85aa36a6ca7e service swift] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:53:50.073471 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1128/2259] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jun 27 18:53:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 18:54:00.045875 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=13 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:54:00.069568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=57 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:54:16.298561 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f78ac2-ff76-42ea-b764-26b73bdc1d9a None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:54:16.299131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f78ac2-ff76-42ea-b764-26b73bdc1d9a None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:54:16.299332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f78ac2-ff76-42ea-b764-26b73bdc1d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:54:16.317468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-a2f78ac2-ff76-42ea-b764-26b73bdc1d9a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:54:16.318694 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-a2f78ac2-ff76-42ea-b764-26b73bdc1d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:54:16.382316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1132/2260] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jun 27 18:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:54:16.397284 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8abe0b-9595-4c04-9f49-85aa36a6ca7e service swift] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:54:16.398676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-0f8abe0b-9595-4c04-9f49-85aa36a6ca7e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:54:16.469565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726552e7-cdfa-4c8d-853b-4063d25dfc6f None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:54:16.469860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726552e7-cdfa-4c8d-853b-4063d25dfc6f None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:54:16.470391 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726552e7-cdfa-4c8d-853b-4063d25dfc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:54:16.488897 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-726552e7-cdfa-4c8d-853b-4063d25dfc6f None None] MFA Rules not processed for user `f455a84e20834cec8b84aa88ef263b56`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:54:16.490195 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-726552e7-cdfa-4c8d-853b-4063d25dfc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:54:16.496996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8abe0b-9595-4c04-9f49-85aa36a6ca7e service swift] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:54:16.502752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48580e6a-6540-4ae1-b805-5890bec578ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:54:16.504849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580e6a-6540-4ae1-b805-5890bec578ac service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:54:16.504849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580e6a-6540-4ae1-b805-5890bec578ac service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:54:16.504849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580e6a-6540-4ae1-b805-5890bec578ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:54:16.515730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48580e6a-6540-4ae1-b805-5890bec578ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:54:16.515730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48580e6a-6540-4ae1-b805-5890bec578ac service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:54:16.524421 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1129/2261] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:54:16.548235 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1133/2262] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:54:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:54:21.667714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55140b15-1195-42d0-a7fa-1589745f1d64 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:54:21.668195 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55140b15-1195-42d0-a7fa-1589745f1d64 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:54:21.668291 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55140b15-1195-42d0-a7fa-1589745f1d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:54:21.687197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-55140b15-1195-42d0-a7fa-1589745f1d64 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:54:21.688499 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-55140b15-1195-42d0-a7fa-1589745f1d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:54:21.696525 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1130/2263] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jun 27 18:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:54:21.711035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726552e7-cdfa-4c8d-853b-4063d25dfc6f None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:54:21.712612 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-726552e7-cdfa-4c8d-853b-4063d25dfc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:54:21.732050 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726552e7-cdfa-4c8d-853b-4063d25dfc6f None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:54:21.738218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019892ef-c87a-4b70-83d1-29f6b0bc7e20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:54:21.738920 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019892ef-c87a-4b70-83d1-29f6b0bc7e20 service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:54:21.739207 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019892ef-c87a-4b70-83d1-29f6b0bc7e20 service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:54:21.739513 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019892ef-c87a-4b70-83d1-29f6b0bc7e20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:54:21.748918 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019892ef-c87a-4b70-83d1-29f6b0bc7e20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:54:21.750519 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019892ef-c87a-4b70-83d1-29f6b0bc7e20 service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:54:21.760596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1134/2264] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:54:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:54:21.922338 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67d2a8-309a-4846-b904-1af7df4d2889 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:54:21.922639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67d2a8-309a-4846-b904-1af7df4d2889 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:54:21.922925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67d2a8-309a-4846-b904-1af7df4d2889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:54:21.941026 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-be67d2a8-309a-4846-b904-1af7df4d2889 None None] MFA Rules not processed for user `89794cd59f4d44318aff08fe38de3dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:54:21.942250 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-be67d2a8-309a-4846-b904-1af7df4d2889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:54:22.000209 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1131/2265] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:54:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:54:25.175192 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32bcbf-8259-4b49-a060-4cbb6acda2f3 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:54:25.175192 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32bcbf-8259-4b49-a060-4cbb6acda2f3 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:54:25.175192 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32bcbf-8259-4b49-a060-4cbb6acda2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:54:25.191362 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-3b32bcbf-8259-4b49-a060-4cbb6acda2f3 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:54:25.194718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3b32bcbf-8259-4b49-a060-4cbb6acda2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:54:25.201420 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1135/2266] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jun 27 18:54:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:54:25.215499 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67d2a8-309a-4846-b904-1af7df4d2889 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:54:25.228144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67d2a8-309a-4846-b904-1af7df4d2889 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:54:25.233622 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adea0b-9102-40cb-9d7f-2789392df896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:54:25.234262 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adea0b-9102-40cb-9d7f-2789392df896 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:54:25.234545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adea0b-9102-40cb-9d7f-2789392df896 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:54:25.234823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adea0b-9102-40cb-9d7f-2789392df896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:54:25.243576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adea0b-9102-40cb-9d7f-2789392df896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:54:25.245736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5adea0b-9102-40cb-9d7f-2789392df896 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:54:25.255605 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1132/2267] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:54:30.068774 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c0381-45f4-4b58-80a7-613705e8274d None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:54:30.069261 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c0381-45f4-4b58-80a7-613705e8274d None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:54:30.069378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c0381-45f4-4b58-80a7-613705e8274d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:54:30.087605 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-047c0381-45f4-4b58-80a7-613705e8274d None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:54:30.088744 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-047c0381-45f4-4b58-80a7-613705e8274d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:54:30.097232 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1136/2268] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jun 27 18:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:54:30.113492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adea0b-9102-40cb-9d7f-2789392df896 service nova] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:54:30.124424 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adea0b-9102-40cb-9d7f-2789392df896 service nova] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:54:30.129864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42dc20-a7cd-4db5-8ff9-f2b9f6976c70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:54:30.130489 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42dc20-a7cd-4db5-8ff9-f2b9f6976c70 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:54:30.130773 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42dc20-a7cd-4db5-8ff9-f2b9f6976c70 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:54:30.131049 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42dc20-a7cd-4db5-8ff9-f2b9f6976c70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:54:30.139642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42dc20-a7cd-4db5-8ff9-f2b9f6976c70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:54:30.141224 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42dc20-a7cd-4db5-8ff9-f2b9f6976c70 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:54:30.150664 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1133/2269] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:54:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:54:33.301447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1676ed1-8b38-4567-9774-bf2e4750e06c None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:54:33.305529 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1676ed1-8b38-4567-9774-bf2e4750e06c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:54:33.305529 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1676ed1-8b38-4567-9774-bf2e4750e06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:54:33.321458 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-a1676ed1-8b38-4567-9774-bf2e4750e06c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:54:33.322709 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-a1676ed1-8b38-4567-9774-bf2e4750e06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:54:33.331276 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1137/2270] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jun 27 18:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:54:33.352699 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42dc20-a7cd-4db5-8ff9-f2b9f6976c70 service nova] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:54:33.363607 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42dc20-a7cd-4db5-8ff9-f2b9f6976c70 service nova] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:54:33.369190 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2674362-b378-45b3-976e-1f10df56bb23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:54:33.369844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2674362-b378-45b3-976e-1f10df56bb23 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:54:33.370127 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2674362-b378-45b3-976e-1f10df56bb23 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:54:33.370431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2674362-b378-45b3-976e-1f10df56bb23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:54:33.379463 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2674362-b378-45b3-976e-1f10df56bb23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:54:33.381083 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2674362-b378-45b3-976e-1f10df56bb23 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:54:33.391254 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1134/2271] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:54:37.565042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a23b5b-286f-4e80-9681-6f7950d5e056 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:54:37.565572 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a23b5b-286f-4e80-9681-6f7950d5e056 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:54:37.565572 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a23b5b-286f-4e80-9681-6f7950d5e056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:54:37.588790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-c3a23b5b-286f-4e80-9681-6f7950d5e056 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:54:37.590954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c3a23b5b-286f-4e80-9681-6f7950d5e056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:54:37.601276 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1138/2272] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jun 27 18:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:54:37.616354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2674362-b378-45b3-976e-1f10df56bb23 service nova] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:54:37.628443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2674362-b378-45b3-976e-1f10df56bb23 service nova] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:54:37.634319 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9634bd-5ab6-497d-97c9-d9323d4cb520 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:54:37.635040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9634bd-5ab6-497d-97c9-d9323d4cb520 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:54:37.635329 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9634bd-5ab6-497d-97c9-d9323d4cb520 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:54:37.635658 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9634bd-5ab6-497d-97c9-d9323d4cb520 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:54:37.645293 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9634bd-5ab6-497d-97c9-d9323d4cb520 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:54:37.647011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9634bd-5ab6-497d-97c9-d9323d4cb520 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:54:37.658401 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1135/2273] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:54:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:54:47.079993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768c8c2-11bf-4930-9229-3aa1e7fc4991 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:54:47.080538 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768c8c2-11bf-4930-9229-3aa1e7fc4991 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:54:47.080538 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0768c8c2-11bf-4930-9229-3aa1e7fc4991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:54:47.086222 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=71 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:54:47.098026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-0768c8c2-11bf-4930-9229-3aa1e7fc4991 None None] MFA Rules not processed for user `798c13c87b814d1182c6df3b29ec5986`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:54:47.101222 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0768c8c2-11bf-4930-9229-3aa1e7fc4991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:54:47.153129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1139/2274] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:54:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:54:47.653840 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=95 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:54:56.869411 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92be72-3c61-4c73-a760-90d82626d344 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:54:56.869968 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92be72-3c61-4c73-a760-90d82626d344 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:54:56.870085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea92be72-3c61-4c73-a760-90d82626d344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:54:56.888216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-ea92be72-3c61-4c73-a760-90d82626d344 None None] MFA Rules not processed for user `cf3f71b3974245979beef804ecea006d`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:54:56.889404 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ea92be72-3c61-4c73-a760-90d82626d344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:54:56.942397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1136/2275] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:54:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:54:57.146472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=24 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:06.935971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=25 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:16.402227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3c71-2181-4105-9bf2-11700437f9b3 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:16.402828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3c71-2181-4105-9bf2-11700437f9b3 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:16.402828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c3c71-2181-4105-9bf2-11700437f9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:16.420976 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-241c3c71-2181-4105-9bf2-11700437f9b3 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:55:16.422225 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-241c3c71-2181-4105-9bf2-11700437f9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:16.429976 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1140/2276] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jun 27 18:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:55:16.447910 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92be72-3c61-4c73-a760-90d82626d344 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:16.461253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea92be72-3c61-4c73-a760-90d82626d344 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:16.467570 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b5ae0-2a46-4d2c-8274-32939e4b579c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:16.468200 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b5ae0-2a46-4d2c-8274-32939e4b579c service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:16.468577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b5ae0-2a46-4d2c-8274-32939e4b579c service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:16.468861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b5ae0-2a46-4d2c-8274-32939e4b579c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:16.477294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b5ae0-2a46-4d2c-8274-32939e4b579c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:16.484590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b5ae0-2a46-4d2c-8274-32939e4b579c service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:16.488329 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1137/2277] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:55:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:55:21.997699 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1d15e-9e9c-4dae-ae1d-10db93062e17 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:21.998302 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1d15e-9e9c-4dae-ae1d-10db93062e17 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:21.998302 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1d15e-9e9c-4dae-ae1d-10db93062e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:22.015962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-e7a1d15e-9e9c-4dae-ae1d-10db93062e17 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:55:22.017156 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e7a1d15e-9e9c-4dae-ae1d-10db93062e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:22.025002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1141/2278] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jun 27 18:55:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:55:22.059056 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b5ae0-2a46-4d2c-8274-32939e4b579c service nova] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:22.065750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b5ae0-2a46-4d2c-8274-32939e4b579c service nova] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:22.071310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb609c-2868-4db5-89be-45bd06f06b27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:22.071988 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb609c-2868-4db5-89be-45bd06f06b27 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:22.072279 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb609c-2868-4db5-89be-45bd06f06b27 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:22.072561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb609c-2868-4db5-89be-45bd06f06b27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:22.081065 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb609c-2868-4db5-89be-45bd06f06b27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:22.082646 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb609c-2868-4db5-89be-45bd06f06b27 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:22.092602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1138/2279] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:55:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:55:25.841504 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccc520-bea1-45e9-a638-5268f887cd3d None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:25.842593 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccc520-bea1-45e9-a638-5268f887cd3d None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:25.842593 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccc520-bea1-45e9-a638-5268f887cd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:25.868227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-d8ccc520-bea1-45e9-a638-5268f887cd3d None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:55:25.869450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d8ccc520-bea1-45e9-a638-5268f887cd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:25.877444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1142/2280] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jun 27 18:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:55:25.892066 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb609c-2868-4db5-89be-45bd06f06b27 service nova] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:25.903218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb609c-2868-4db5-89be-45bd06f06b27 service nova] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:25.909499 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779e675-ae8d-446d-92e0-9636d06a0291 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:25.910224 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779e675-ae8d-446d-92e0-9636d06a0291 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:25.910509 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779e675-ae8d-446d-92e0-9636d06a0291 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:25.910791 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779e675-ae8d-446d-92e0-9636d06a0291 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:25.921301 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779e675-ae8d-446d-92e0-9636d06a0291 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:25.923640 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779e675-ae8d-446d-92e0-9636d06a0291 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:25.934891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1139/2281] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:55:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:55:28.269098 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0a408-2c8a-4f89-9e30-d95658221cca None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:28.269617 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0a408-2c8a-4f89-9e30-d95658221cca None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:28.269716 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0a408-2c8a-4f89-9e30-d95658221cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:28.286949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-ccd0a408-2c8a-4f89-9e30-d95658221cca None None] MFA Rules not processed for user `ded25521da0d425ea95e7763d7161ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:55:28.288405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ccd0a408-2c8a-4f89-9e30-d95658221cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:28.342560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1143/2282] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:55:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:55:32.254948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f612b7-c987-470d-9cb9-2da227ae2548 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:32.255605 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f612b7-c987-470d-9cb9-2da227ae2548 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:32.255605 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f612b7-c987-470d-9cb9-2da227ae2548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:32.274609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-a1f612b7-c987-470d-9cb9-2da227ae2548 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:55:32.275842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a1f612b7-c987-470d-9cb9-2da227ae2548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:32.285201 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1140/2283] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jun 27 18:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:55:32.316587 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0a408-2c8a-4f89-9e30-d95658221cca None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:32.332171 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0a408-2c8a-4f89-9e30-d95658221cca None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:32.337724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206ea42-4886-4112-844d-2a00596b870e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:32.338384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206ea42-4886-4112-844d-2a00596b870e service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:32.338651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206ea42-4886-4112-844d-2a00596b870e service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:32.338929 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206ea42-4886-4112-844d-2a00596b870e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:32.348218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206ea42-4886-4112-844d-2a00596b870e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:32.349815 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e206ea42-4886-4112-844d-2a00596b870e service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:32.359976 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1144/2284] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:55:37.601231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4587e5-93fc-45c3-8077-595dfe2ce457 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:37.601231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4587e5-93fc-45c3-8077-595dfe2ce457 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:37.601231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4587e5-93fc-45c3-8077-595dfe2ce457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:37.607839 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=22 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:37.644653 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-fc4587e5-93fc-45c3-8077-595dfe2ce457 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:55:37.646465 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-fc4587e5-93fc-45c3-8077-595dfe2ce457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:37.660421 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1141/2285] 10.222.0.27 () {58 vars in 1016 bytes} [Mon Jun 27 18:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:55:37.678445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206ea42-4886-4112-844d-2a00596b870e service nova] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:37.702903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=41 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:37.716889 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206ea42-4886-4112-844d-2a00596b870e service nova] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:37.723457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cedf4-a458-4144-a26b-42e1febcbe87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:37.724371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cedf4-a458-4144-a26b-42e1febcbe87 service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:37.728128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cedf4-a458-4144-a26b-42e1febcbe87 service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:37.728128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cedf4-a458-4144-a26b-42e1febcbe87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:37.736093 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cedf4-a458-4144-a26b-42e1febcbe87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:37.738546 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cedf4-a458-4144-a26b-42e1febcbe87 service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:37.751035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1145/2286] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:55:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:55:40.806665 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4587e5-93fc-45c3-8077-595dfe2ce457 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:40.809097 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-fc4587e5-93fc-45c3-8077-595dfe2ce457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:40.824069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4587e5-93fc-45c3-8077-595dfe2ce457 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:40.829525 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb8369-03e1-4f0f-80e8-67fb58fd132a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:40.831756 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb8369-03e1-4f0f-80e8-67fb58fd132a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:40.831756 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb8369-03e1-4f0f-80e8-67fb58fd132a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:40.831756 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb8369-03e1-4f0f-80e8-67fb58fd132a admin admin] PATH_INFO: `/v3/users/89794cd59f4d44318aff08fe38de3dc5` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:40.832337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb8369-03e1-4f0f-80e8-67fb58fd132a admin admin] RBAC: Authorizing `identity:delete_user(user_id=89794cd59f4d44318aff08fe38de3dc5)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:40.834264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb8369-03e1-4f0f-80e8-67fb58fd132a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:41.048062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65420d5c-757c-424c-a570-0cb14e45cbb3 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:41.048547 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65420d5c-757c-424c-a570-0cb14e45cbb3 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:41.048664 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65420d5c-757c-424c-a570-0cb14e45cbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:41.068036 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-65420d5c-757c-424c-a570-0cb14e45cbb3 None None] MFA Rules not processed for user `f455a84e20834cec8b84aa88ef263b56`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:55:41.069334 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-65420d5c-757c-424c-a570-0cb14e45cbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:41.073561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e9bb8369-03e1-4f0f-80e8-67fb58fd132a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89794cd59f4d44318aff08fe38de3dc5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:41.077027 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1146/2287] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:55:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:55:41.153232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e9bb8369-03e1-4f0f-80e8-67fb58fd132a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89794cd59f4d44318aff08fe38de3dc5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:41.168941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e9bb8369-03e1-4f0f-80e8-67fb58fd132a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89794cd59f4d44318aff08fe38de3dc5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:41.178267 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e9bb8369-03e1-4f0f-80e8-67fb58fd132a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89794cd59f4d44318aff08fe38de3dc5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:41.179107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e9bb8369-03e1-4f0f-80e8-67fb58fd132a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89794cd59f4d44318aff08fe38de3dc5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:41.185833 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1142/2288] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:55:40 2022] DELETE /identity/v3/users/89794cd59f4d44318aff08fe38de3dc5 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:55:41.715419 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65420d5c-757c-424c-a570-0cb14e45cbb3 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:41.735903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65420d5c-757c-424c-a570-0cb14e45cbb3 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:41.796482 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d2f97-06a6-4ef1-8b8c-3e83bd5efc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:41.797909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d2f97-06a6-4ef1-8b8c-3e83bd5efc4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:41.798197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d2f97-06a6-4ef1-8b8c-3e83bd5efc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:41.798478 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d2f97-06a6-4ef1-8b8c-3e83bd5efc4b admin admin] PATH_INFO: `/v3/projects/7279325b304d4011a77435f338b63ca3` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:41.799745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d2f97-06a6-4ef1-8b8c-3e83bd5efc4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7279325b304d4011a77435f338b63ca3)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:41.801705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d2f97-06a6-4ef1-8b8c-3e83bd5efc4b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:41.953053 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-952d2f97-06a6-4ef1-8b8c-3e83bd5efc4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7279325b304d4011a77435f338b63ca3', 'request_id': 'req-952d2f97-06a6-4ef1-8b8c-3e83bd5efc4b'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:42.039348 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-952d2f97-06a6-4ef1-8b8c-3e83bd5efc4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7279325b304d4011a77435f338b63ca3', 'request_id': 'req-952d2f97-06a6-4ef1-8b8c-3e83bd5efc4b'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:42.045864 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-952d2f97-06a6-4ef1-8b8c-3e83bd5efc4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7279325b304d4011a77435f338b63ca3', 'request_id': 'req-952d2f97-06a6-4ef1-8b8c-3e83bd5efc4b'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:42.058155 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-952d2f97-06a6-4ef1-8b8c-3e83bd5efc4b admin admin] The token cache is being invalidate because project 7279325b304d4011a77435f338b63ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:55:42.058729 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-952d2f97-06a6-4ef1-8b8c-3e83bd5efc4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:42.059127 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-952d2f97-06a6-4ef1-8b8c-3e83bd5efc4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:42.060849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1147/2289] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:55:41 2022] DELETE /identity/v3/projects/7279325b304d4011a77435f338b63ca3 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:55:42.066283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c96331-d24d-46a4-a31f-6c7c89fab535 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:42.066728 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c96331-d24d-46a4-a31f-6c7c89fab535 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:42.066827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c96331-d24d-46a4-a31f-6c7c89fab535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:42.085241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-51c96331-d24d-46a4-a31f-6c7c89fab535 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:55:42.086480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-51c96331-d24d-46a4-a31f-6c7c89fab535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:42.151679 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1143/2290] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:55:42.158376 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d3485-4aee-4f70-8cfe-42851dc3f330 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:42.158807 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d3485-4aee-4f70-8cfe-42851dc3f330 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:42.159089 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d3485-4aee-4f70-8cfe-42851dc3f330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:42.177691 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-678d3485-4aee-4f70-8cfe-42851dc3f330 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:55:42.178820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-678d3485-4aee-4f70-8cfe-42851dc3f330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:42.186704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1148/2291] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:55:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:55:42.191088 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c96331-d24d-46a4-a31f-6c7c89fab535 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:42.200774 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c96331-d24d-46a4-a31f-6c7c89fab535 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:42.205603 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcb6b4-e398-4d2f-8a5d-81e307ce67f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:42.206258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcb6b4-e398-4d2f-8a5d-81e307ce67f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:42.206545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcb6b4-e398-4d2f-8a5d-81e307ce67f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:42.206827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcb6b4-e398-4d2f-8a5d-81e307ce67f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:42.207636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcb6b4-e398-4d2f-8a5d-81e307ce67f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:55:42.207953 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcb6b4-e398-4d2f-8a5d-81e307ce67f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:42.209569 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcb6b4-e398-4d2f-8a5d-81e307ce67f0 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:42.221496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1144/2292] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:55:42.225739 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d3485-4aee-4f70-8cfe-42851dc3f330 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:42.235739 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d3485-4aee-4f70-8cfe-42851dc3f330 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:42.240870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27567d06-de61-4fbb-83bd-b66bf7a87fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:42.241562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27567d06-de61-4fbb-83bd-b66bf7a87fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:42.241840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27567d06-de61-4fbb-83bd-b66bf7a87fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:42.242120 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27567d06-de61-4fbb-83bd-b66bf7a87fe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:42.242823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27567d06-de61-4fbb-83bd-b66bf7a87fe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:42.244824 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27567d06-de61-4fbb-83bd-b66bf7a87fe7 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:42.355917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1149/2293] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:55:42 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:55:42.360152 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcb6b4-e398-4d2f-8a5d-81e307ce67f0 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:42.369887 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcb6b4-e398-4d2f-8a5d-81e307ce67f0 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:42.443801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:42.450750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a4096-b85b-4052-9956-baf235a4f6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:42.451433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a4096-b85b-4052-9956-baf235a4f6ea admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:42.451748 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a4096-b85b-4052-9956-baf235a4f6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:42.452039 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a4096-b85b-4052-9956-baf235a4f6ea admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:42.452755 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a4096-b85b-4052-9956-baf235a4f6ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:42.454753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a4096-b85b-4052-9956-baf235a4f6ea admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:42.569444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1145/2294] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:55:42 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:55:42.573566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27567d06-de61-4fbb-83bd-b66bf7a87fe7 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:42.585578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27567d06-de61-4fbb-83bd-b66bf7a87fe7 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:42.590334 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbff46c-f1b4-498d-a4f5-87098942d21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:42.591168 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbff46c-f1b4-498d-a4f5-87098942d21c admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:42.591362 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbff46c-f1b4-498d-a4f5-87098942d21c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:42.591898 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbff46c-f1b4-498d-a4f5-87098942d21c admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:42.592842 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbff46c-f1b4-498d-a4f5-87098942d21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:42.595067 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbff46c-f1b4-498d-a4f5-87098942d21c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:42.608468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1150/2295] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:55:42.613286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a4096-b85b-4052-9956-baf235a4f6ea admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:42.625233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a4096-b85b-4052-9956-baf235a4f6ea admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:42.631099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38240df6-b64a-4673-a942-7ec50a6829fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:42.631480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38240df6-b64a-4673-a942-7ec50a6829fc admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:42.632036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38240df6-b64a-4673-a942-7ec50a6829fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:42.632420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38240df6-b64a-4673-a942-7ec50a6829fc admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:42.633240 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38240df6-b64a-4673-a942-7ec50a6829fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:42.635107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38240df6-b64a-4673-a942-7ec50a6829fc admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:42.651061 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1146/2296] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:55:42.652707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbff46c-f1b4-498d-a4f5-87098942d21c admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:42.665057 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbff46c-f1b4-498d-a4f5-87098942d21c admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:42.669975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5185b2-37e2-4ce4-b714-e25ed82aa34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:42.670964 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5185b2-37e2-4ce4-b714-e25ed82aa34d admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:42.671138 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5185b2-37e2-4ce4-b714-e25ed82aa34d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:42.671413 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5185b2-37e2-4ce4-b714-e25ed82aa34d admin admin] PATH_INFO: `/v3/projects/0f2b3d179b014bd4bcfff2b5f7bf9434/users/591af9a817cd4667bc982a7af8796cf5/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:42.700734 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5185b2-37e2-4ce4-b714-e25ed82aa34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f2b3d179b014bd4bcfff2b5f7bf9434, user_id=591af9a817cd4667bc982a7af8796cf5, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:42.704066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5185b2-37e2-4ce4-b714-e25ed82aa34d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:42.794398 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1151/2297] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:55:42 2022] PUT /identity/v3/projects/0f2b3d179b014bd4bcfff2b5f7bf9434/users/591af9a817cd4667bc982a7af8796cf5/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:55:42.804016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8546f-4454-4fb8-9d8d-91039e23dcc2 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:42.804314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8546f-4454-4fb8-9d8d-91039e23dcc2 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:42.804599 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8546f-4454-4fb8-9d8d-91039e23dcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:42.832130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-abd8546f-4454-4fb8-9d8d-91039e23dcc2 None None] MFA Rules not processed for user `591af9a817cd4667bc982a7af8796cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:55:42.833361 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-abd8546f-4454-4fb8-9d8d-91039e23dcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:42.896873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1147/2298] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:55:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:55:42.908595 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5185b2-37e2-4ce4-b714-e25ed82aa34d admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:42.910300 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-8c5185b2-37e2-4ce4-b714-e25ed82aa34d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:42.921280 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:42.983901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5185b2-37e2-4ce4-b714-e25ed82aa34d admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:42.989453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b760d8-aa27-48c8-99d1-0bcdf437254d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:42.992032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b760d8-aa27-48c8-99d1-0bcdf437254d service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:42.992032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b760d8-aa27-48c8-99d1-0bcdf437254d service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:42.992032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b760d8-aa27-48c8-99d1-0bcdf437254d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:42.998632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b760d8-aa27-48c8-99d1-0bcdf437254d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:43.000818 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b760d8-aa27-48c8-99d1-0bcdf437254d service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:43.009638 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1152/2299] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:55:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:55:44.745834 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8546f-4454-4fb8-9d8d-91039e23dcc2 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:44.747269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-abd8546f-4454-4fb8-9d8d-91039e23dcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:44.755294 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b760d8-aa27-48c8-99d1-0bcdf437254d service nova] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:44.759828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d4b760d8-aa27-48c8-99d1-0bcdf437254d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:44.809657 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8546f-4454-4fb8-9d8d-91039e23dcc2 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:44.814036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffedee-4963-4742-b429-b7c66048aefa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:44.814784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffedee-4963-4742-b429-b7c66048aefa service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:44.815191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffedee-4963-4742-b429-b7c66048aefa service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:44.815586 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffedee-4963-4742-b429-b7c66048aefa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:44.817469 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b760d8-aa27-48c8-99d1-0bcdf437254d service nova] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:44.817649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f3ffedee-4963-4742-b429-b7c66048aefa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:44.821858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85685296-3d05-403a-a60f-def563314682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:44.826608 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85685296-3d05-403a-a60f-def563314682 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:44.826608 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85685296-3d05-403a-a60f-def563314682 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:44.826608 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85685296-3d05-403a-a60f-def563314682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:44.826608 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-85685296-3d05-403a-a60f-def563314682 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:44.832245 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffedee-4963-4742-b429-b7c66048aefa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:44.833760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffedee-4963-4742-b429-b7c66048aefa service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:44.839909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85685296-3d05-403a-a60f-def563314682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:44.841951 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85685296-3d05-403a-a60f-def563314682 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:44.846254 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1148/2300] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:55:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:55:44.855908 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1153/2301] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:55:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:55:46.356435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffedee-4963-4742-b429-b7c66048aefa service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:46.417333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffedee-4963-4742-b429-b7c66048aefa service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:46.422410 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d09074-4002-4c73-864e-8b663945df12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:46.423647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d09074-4002-4c73-864e-8b663945df12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:46.423928 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d09074-4002-4c73-864e-8b663945df12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:46.424200 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d09074-4002-4c73-864e-8b663945df12 admin admin] PATH_INFO: `/v3/users/591af9a817cd4667bc982a7af8796cf5` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:46.425388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d09074-4002-4c73-864e-8b663945df12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=591af9a817cd4667bc982a7af8796cf5)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:46.427304 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d09074-4002-4c73-864e-8b663945df12 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:46.432837 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:46.656919 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-37d09074-4002-4c73-864e-8b663945df12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '591af9a817cd4667bc982a7af8796cf5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:46.735201 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-37d09074-4002-4c73-864e-8b663945df12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '591af9a817cd4667bc982a7af8796cf5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:46.748418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-37d09074-4002-4c73-864e-8b663945df12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '591af9a817cd4667bc982a7af8796cf5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:46.755286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-37d09074-4002-4c73-864e-8b663945df12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '591af9a817cd4667bc982a7af8796cf5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:46.755960 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-37d09074-4002-4c73-864e-8b663945df12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '591af9a817cd4667bc982a7af8796cf5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:46.762015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1149/2302] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:55:46 2022] DELETE /identity/v3/users/591af9a817cd4667bc982a7af8796cf5 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:55:46.766522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ead55-fea8-4dfb-b09e-ca41732dc6ef None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:46.767017 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ead55-fea8-4dfb-b09e-ca41732dc6ef None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:46.767147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ead55-fea8-4dfb-b09e-ca41732dc6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:46.784477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-674ead55-fea8-4dfb-b09e-ca41732dc6ef None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:55:46.785668 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-674ead55-fea8-4dfb-b09e-ca41732dc6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:46.846249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1154/2303] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:55:46.856453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d09074-4002-4c73-864e-8b663945df12 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:46.858450 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-37d09074-4002-4c73-864e-8b663945df12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:46.920703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d09074-4002-4c73-864e-8b663945df12 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:46.925713 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfaa5e-de34-4f47-b74e-197347cc3346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:46.926366 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfaa5e-de34-4f47-b74e-197347cc3346 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:46.926651 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfaa5e-de34-4f47-b74e-197347cc3346 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:46.926932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfaa5e-de34-4f47-b74e-197347cc3346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:46.936523 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfaa5e-de34-4f47-b74e-197347cc3346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:46.938013 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bfaa5e-de34-4f47-b74e-197347cc3346 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:46.949416 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1150/2304] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:55:47.642507 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ead55-fea8-4dfb-b09e-ca41732dc6ef None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:47.644560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-674ead55-fea8-4dfb-b09e-ca41732dc6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:47.665354 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ead55-fea8-4dfb-b09e-ca41732dc6ef None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:47.670450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98cd53-dfdf-42e8-b560-eff44627ad7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:47.671506 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98cd53-dfdf-42e8-b560-eff44627ad7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:47.671918 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98cd53-dfdf-42e8-b560-eff44627ad7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:47.672302 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98cd53-dfdf-42e8-b560-eff44627ad7e admin admin] PATH_INFO: `/v3/projects/0f2b3d179b014bd4bcfff2b5f7bf9434` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:47.673844 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98cd53-dfdf-42e8-b560-eff44627ad7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f2b3d179b014bd4bcfff2b5f7bf9434)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:47.678065 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98cd53-dfdf-42e8-b560-eff44627ad7e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:47.804535 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:47.818687 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ca98cd53-dfdf-42e8-b560-eff44627ad7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f2b3d179b014bd4bcfff2b5f7bf9434', 'request_id': 'req-ca98cd53-dfdf-42e8-b560-eff44627ad7e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:47.914676 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ca98cd53-dfdf-42e8-b560-eff44627ad7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f2b3d179b014bd4bcfff2b5f7bf9434', 'request_id': 'req-ca98cd53-dfdf-42e8-b560-eff44627ad7e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:47.921022 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ca98cd53-dfdf-42e8-b560-eff44627ad7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f2b3d179b014bd4bcfff2b5f7bf9434', 'request_id': 'req-ca98cd53-dfdf-42e8-b560-eff44627ad7e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:47.933219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ca98cd53-dfdf-42e8-b560-eff44627ad7e admin admin] The token cache is being invalidate because project 0f2b3d179b014bd4bcfff2b5f7bf9434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:55:47.933512 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ca98cd53-dfdf-42e8-b560-eff44627ad7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:47.934160 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ca98cd53-dfdf-42e8-b560-eff44627ad7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:47.935739 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1155/2305] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:55:47 2022] DELETE /identity/v3/projects/0f2b3d179b014bd4bcfff2b5f7bf9434 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:55:47.941271 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dbdda-00fc-49b2-87b7-116798862836 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:47.941744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dbdda-00fc-49b2-87b7-116798862836 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:47.941844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372dbdda-00fc-49b2-87b7-116798862836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:47.959229 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-372dbdda-00fc-49b2-87b7-116798862836 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:55:47.960836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-372dbdda-00fc-49b2-87b7-116798862836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:48.022560 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1151/2306] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:55:48.031375 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0b637-d701-4e11-ade5-869730857bba None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:48.031698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0b637-d701-4e11-ade5-869730857bba None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:48.031990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0b637-d701-4e11-ade5-869730857bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:48.050607 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-cab0b637-d701-4e11-ade5-869730857bba None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:55:48.051848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-cab0b637-d701-4e11-ade5-869730857bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:48.059863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1156/2307] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:55:48.064720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dbdda-00fc-49b2-87b7-116798862836 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:48.074467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372dbdda-00fc-49b2-87b7-116798862836 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:48.079786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2071a2d-c983-43be-a7d2-093aa6af0812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:48.081620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2071a2d-c983-43be-a7d2-093aa6af0812 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:48.081620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2071a2d-c983-43be-a7d2-093aa6af0812 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:48.081620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2071a2d-c983-43be-a7d2-093aa6af0812 admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:48.081908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2071a2d-c983-43be-a7d2-093aa6af0812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:55:48.082093 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2071a2d-c983-43be-a7d2-093aa6af0812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:48.083745 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2071a2d-c983-43be-a7d2-093aa6af0812 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:48.095482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1152/2308] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:55:48.099875 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0b637-d701-4e11-ade5-869730857bba None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:48.109260 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0b637-d701-4e11-ade5-869730857bba None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:48.114429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ef594-3242-45bf-9a9e-13aed268dfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:48.115983 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ef594-3242-45bf-9a9e-13aed268dfbe admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:48.115983 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ef594-3242-45bf-9a9e-13aed268dfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:48.115983 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ef594-3242-45bf-9a9e-13aed268dfbe admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:48.116316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ef594-3242-45bf-9a9e-13aed268dfbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:48.118225 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ef594-3242-45bf-9a9e-13aed268dfbe admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:48.194156 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1157/2309] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:55:48 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:55:48.198548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2071a2d-c983-43be-a7d2-093aa6af0812 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:48.208823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2071a2d-c983-43be-a7d2-093aa6af0812 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:48.220846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:48.265343 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032f010-eaec-4c09-a56f-4a73f8fa86e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:48.266006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032f010-eaec-4c09-a56f-4a73f8fa86e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:48.266289 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032f010-eaec-4c09-a56f-4a73f8fa86e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:48.266566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032f010-eaec-4c09-a56f-4a73f8fa86e1 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:48.267257 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032f010-eaec-4c09-a56f-4a73f8fa86e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:48.269196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032f010-eaec-4c09-a56f-4a73f8fa86e1 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:48.354475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1153/2310] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:55:48 2022] POST /identity/v3/users => generated 283 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:55:48.358820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ef594-3242-45bf-9a9e-13aed268dfbe admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:48.370188 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ef594-3242-45bf-9a9e-13aed268dfbe admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:48.375745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c623eb-1b90-47c6-9f24-346d33710e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:48.381960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c623eb-1b90-47c6-9f24-346d33710e25 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:48.381960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c623eb-1b90-47c6-9f24-346d33710e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:48.381960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c623eb-1b90-47c6-9f24-346d33710e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:48.381960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c623eb-1b90-47c6-9f24-346d33710e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:48.381960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c623eb-1b90-47c6-9f24-346d33710e25 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:48.391851 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1158/2311] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:55:48.395825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032f010-eaec-4c09-a56f-4a73f8fa86e1 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:48.406660 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032f010-eaec-4c09-a56f-4a73f8fa86e1 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:48.411942 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cfcca-71d6-4d55-9b28-6885f7c5ac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:48.412597 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cfcca-71d6-4d55-9b28-6885f7c5ac3b admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:48.412889 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cfcca-71d6-4d55-9b28-6885f7c5ac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:48.413196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cfcca-71d6-4d55-9b28-6885f7c5ac3b admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:48.413925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cfcca-71d6-4d55-9b28-6885f7c5ac3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:48.415606 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cfcca-71d6-4d55-9b28-6885f7c5ac3b admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:48.426068 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1154/2312] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:55:48.430193 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c623eb-1b90-47c6-9f24-346d33710e25 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:48.440428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c623eb-1b90-47c6-9f24-346d33710e25 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:48.445646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28119a55-2150-47ea-b5d3-327cd47bf387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:48.446708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28119a55-2150-47ea-b5d3-327cd47bf387 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:48.446987 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28119a55-2150-47ea-b5d3-327cd47bf387 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:48.447263 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28119a55-2150-47ea-b5d3-327cd47bf387 admin admin] PATH_INFO: `/v3/projects/abb69a30e4b14c98944c66f3b31dbd1e/users/d40ae1619334418c928e120747be6182/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:48.466505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28119a55-2150-47ea-b5d3-327cd47bf387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abb69a30e4b14c98944c66f3b31dbd1e, user_id=d40ae1619334418c928e120747be6182, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:48.469518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28119a55-2150-47ea-b5d3-327cd47bf387 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:48.559907 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1159/2313] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:55:48 2022] PUT /identity/v3/projects/abb69a30e4b14c98944c66f3b31dbd1e/users/d40ae1619334418c928e120747be6182/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:55:48.561743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e751c8-041f-47a3-8a8f-b99c030a8fd9 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:48.562037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e751c8-041f-47a3-8a8f-b99c030a8fd9 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:48.562339 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e751c8-041f-47a3-8a8f-b99c030a8fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:48.596692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-a3e751c8-041f-47a3-8a8f-b99c030a8fd9 None None] MFA Rules not processed for user `d40ae1619334418c928e120747be6182`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:55:48.597933 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a3e751c8-041f-47a3-8a8f-b99c030a8fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:48.691645 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1155/2314] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:55:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:55:48.701643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28119a55-2150-47ea-b5d3-327cd47bf387 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:48.704929 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-28119a55-2150-47ea-b5d3-327cd47bf387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:48.769779 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28119a55-2150-47ea-b5d3-327cd47bf387 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:48.773530 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9c8937-b3ac-48d8-b0c1-73138e86c7c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:48.774203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c8937-b3ac-48d8-b0c1-73138e86c7c3 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:48.774489 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c8937-b3ac-48d8-b0c1-73138e86c7c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:48.774819 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9c8937-b3ac-48d8-b0c1-73138e86c7c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:48.783129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c8937-b3ac-48d8-b0c1-73138e86c7c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:48.784607 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9c8937-b3ac-48d8-b0c1-73138e86c7c3 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:48.793226 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1160/2315] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:55:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:55:58.686326 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=59,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:58.747292 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e751c8-041f-47a3-8a8f-b99c030a8fd9 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:58.789291 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:55:58.809785 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e751c8-041f-47a3-8a8f-b99c030a8fd9 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:58.814322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e82390-cc76-42f6-a835-8f889c71a33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:58.824511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e82390-cc76-42f6-a835-8f889c71a33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:58.824511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e82390-cc76-42f6-a835-8f889c71a33f admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:58.824511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e82390-cc76-42f6-a835-8f889c71a33f admin admin] PATH_INFO: `/v3/users/d40ae1619334418c928e120747be6182` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:58.824511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e82390-cc76-42f6-a835-8f889c71a33f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d40ae1619334418c928e120747be6182)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:58.824511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e82390-cc76-42f6-a835-8f889c71a33f admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:59.012617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-96e82390-cc76-42f6-a835-8f889c71a33f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd40ae1619334418c928e120747be6182'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:59.124722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-96e82390-cc76-42f6-a835-8f889c71a33f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd40ae1619334418c928e120747be6182'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:59.137241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-96e82390-cc76-42f6-a835-8f889c71a33f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd40ae1619334418c928e120747be6182'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:59.144373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-96e82390-cc76-42f6-a835-8f889c71a33f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd40ae1619334418c928e120747be6182'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:59.145080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-96e82390-cc76-42f6-a835-8f889c71a33f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd40ae1619334418c928e120747be6182'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:55:59.151334 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1156/2316] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:55:58 2022] DELETE /identity/v3/users/d40ae1619334418c928e120747be6182 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:55:59.155764 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32564ea-6b3b-4ab1-b608-204b3ff576db None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:59.156056 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32564ea-6b3b-4ab1-b608-204b3ff576db None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:59.156369 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32564ea-6b3b-4ab1-b608-204b3ff576db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:59.174798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-b32564ea-6b3b-4ab1-b608-204b3ff576db None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:55:59.176104 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b32564ea-6b3b-4ab1-b608-204b3ff576db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:59.247560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1161/2317] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:55:59.273009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e82390-cc76-42f6-a835-8f889c71a33f admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:59.275029 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-96e82390-cc76-42f6-a835-8f889c71a33f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:59.342783 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e82390-cc76-42f6-a835-8f889c71a33f admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:59.348468 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75724636-ced5-4a46-a190-6c5077b20eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:59.349196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75724636-ced5-4a46-a190-6c5077b20eee service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:59.349414 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75724636-ced5-4a46-a190-6c5077b20eee service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:59.349690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75724636-ced5-4a46-a190-6c5077b20eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:59.359790 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75724636-ced5-4a46-a190-6c5077b20eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:59.361280 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75724636-ced5-4a46-a190-6c5077b20eee service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:59.371395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1157/2318] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:55:59.424020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32564ea-6b3b-4ab1-b608-204b3ff576db None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:59.425450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b32564ea-6b3b-4ab1-b608-204b3ff576db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:59.438440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32564ea-6b3b-4ab1-b608-204b3ff576db None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:59.443162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d303606-87d6-4505-bfb9-8e073e95ec32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:59.443844 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d303606-87d6-4505-bfb9-8e073e95ec32 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:59.444131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d303606-87d6-4505-bfb9-8e073e95ec32 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:59.444412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d303606-87d6-4505-bfb9-8e073e95ec32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:59.446335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-6d303606-87d6-4505-bfb9-8e073e95ec32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:59.507335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d303606-87d6-4505-bfb9-8e073e95ec32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:59.508833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d303606-87d6-4505-bfb9-8e073e95ec32 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:59.519175 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1162/2319] 10.222.0.36 () {60 vars in 1396 bytes} [Mon Jun 27 18:55:59 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:55:59.846022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75724636-ced5-4a46-a190-6c5077b20eee service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:55:59.847706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-75724636-ced5-4a46-a190-6c5077b20eee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:55:59.864444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75724636-ced5-4a46-a190-6c5077b20eee service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:55:59.875008 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad1fd5-a0e5-4179-9145-1ded705d9b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:55:59.876603 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1fd5-a0e5-4179-9145-1ded705d9b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:55:59.876994 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1fd5-a0e5-4179-9145-1ded705d9b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:55:59.877388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1fd5-a0e5-4179-9145-1ded705d9b2d admin admin] PATH_INFO: `/v3/projects/abb69a30e4b14c98944c66f3b31dbd1e` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:55:59.879311 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad1fd5-a0e5-4179-9145-1ded705d9b2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=abb69a30e4b14c98944c66f3b31dbd1e)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:55:59.882163 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad1fd5-a0e5-4179-9145-1ded705d9b2d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:55:59.910767 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:00.025171 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bcad1fd5-a0e5-4179-9145-1ded705d9b2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abb69a30e4b14c98944c66f3b31dbd1e', 'request_id': 'req-bcad1fd5-a0e5-4179-9145-1ded705d9b2d'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:00.031830 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bcad1fd5-a0e5-4179-9145-1ded705d9b2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abb69a30e4b14c98944c66f3b31dbd1e', 'request_id': 'req-bcad1fd5-a0e5-4179-9145-1ded705d9b2d'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:00.119218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bcad1fd5-a0e5-4179-9145-1ded705d9b2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abb69a30e4b14c98944c66f3b31dbd1e', 'request_id': 'req-bcad1fd5-a0e5-4179-9145-1ded705d9b2d'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:00.131869 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bcad1fd5-a0e5-4179-9145-1ded705d9b2d admin admin] The token cache is being invalidate because project abb69a30e4b14c98944c66f3b31dbd1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:56:00.132191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bcad1fd5-a0e5-4179-9145-1ded705d9b2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:00.132869 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-bcad1fd5-a0e5-4179-9145-1ded705d9b2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:00.134461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1158/2320] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:55:59 2022] DELETE /identity/v3/projects/abb69a30e4b14c98944c66f3b31dbd1e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:00.139416 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94df92-d135-4236-9416-096e65970bd4 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:00.140091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94df92-d135-4236-9416-096e65970bd4 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:00.140091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94df92-d135-4236-9416-096e65970bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:00.159715 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-8b94df92-d135-4236-9416-096e65970bd4 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:00.160979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-8b94df92-d135-4236-9416-096e65970bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:00.222874 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1163/2321] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:56:00.231059 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef546676-bd7e-4fd8-9e82-4af89df01d43 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:00.231349 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef546676-bd7e-4fd8-9e82-4af89df01d43 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:00.231667 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef546676-bd7e-4fd8-9e82-4af89df01d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:00.252650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-ef546676-bd7e-4fd8-9e82-4af89df01d43 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:00.253903 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ef546676-bd7e-4fd8-9e82-4af89df01d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:00.262875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1159/2322] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:00.266991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94df92-d135-4236-9416-096e65970bd4 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:00.277493 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94df92-d135-4236-9416-096e65970bd4 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:00.282179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025eb18-be35-4d73-abbe-567410c71843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:00.282836 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025eb18-be35-4d73-abbe-567410c71843 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:00.283121 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025eb18-be35-4d73-abbe-567410c71843 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:00.283395 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025eb18-be35-4d73-abbe-567410c71843 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:00.284159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025eb18-be35-4d73-abbe-567410c71843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:56:00.284566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025eb18-be35-4d73-abbe-567410c71843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:00.286059 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025eb18-be35-4d73-abbe-567410c71843 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:00.297999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1164/2323] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:56:00.303377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef546676-bd7e-4fd8-9e82-4af89df01d43 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:00.312768 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef546676-bd7e-4fd8-9e82-4af89df01d43 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:00.318156 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354a65e-30f6-46e3-a1f8-26c086abf1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:00.318814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354a65e-30f6-46e3-a1f8-26c086abf1e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:00.319103 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354a65e-30f6-46e3-a1f8-26c086abf1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:00.319384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354a65e-30f6-46e3-a1f8-26c086abf1e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:00.320115 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354a65e-30f6-46e3-a1f8-26c086abf1e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:00.322040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354a65e-30f6-46e3-a1f8-26c086abf1e8 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:00.434506 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1160/2324] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:56:00 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:56:00.438703 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025eb18-be35-4d73-abbe-567410c71843 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:00.449188 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025eb18-be35-4d73-abbe-567410c71843 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:00.475367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:00.509335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4069ffb-2a2a-44d9-bfeb-abd42f06fa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:00.509942 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4069ffb-2a2a-44d9-bfeb-abd42f06fa9b admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:00.510240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4069ffb-2a2a-44d9-bfeb-abd42f06fa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:00.515443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4069ffb-2a2a-44d9-bfeb-abd42f06fa9b admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:00.515443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4069ffb-2a2a-44d9-bfeb-abd42f06fa9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:00.515443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4069ffb-2a2a-44d9-bfeb-abd42f06fa9b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:00.616757 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1165/2325] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:56:00 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:56:00.617957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354a65e-30f6-46e3-a1f8-26c086abf1e8 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:00.629166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354a65e-30f6-46e3-a1f8-26c086abf1e8 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:00.633865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d752ba-55ab-4333-bf9b-47c7cdefdaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:00.634519 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d752ba-55ab-4333-bf9b-47c7cdefdaba admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:00.634800 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d752ba-55ab-4333-bf9b-47c7cdefdaba admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:00.635170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d752ba-55ab-4333-bf9b-47c7cdefdaba admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:00.635938 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d752ba-55ab-4333-bf9b-47c7cdefdaba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:00.637605 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d752ba-55ab-4333-bf9b-47c7cdefdaba admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:00.648151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1161/2326] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:56:00.652143 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4069ffb-2a2a-44d9-bfeb-abd42f06fa9b admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:00.662874 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4069ffb-2a2a-44d9-bfeb-abd42f06fa9b admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:00.668043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b5a52-6b46-4b55-ba09-0bcf98b4e4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:00.668748 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b5a52-6b46-4b55-ba09-0bcf98b4e4bf admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:00.669034 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b5a52-6b46-4b55-ba09-0bcf98b4e4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:00.669396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b5a52-6b46-4b55-ba09-0bcf98b4e4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:00.670167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b5a52-6b46-4b55-ba09-0bcf98b4e4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:00.671798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b5a52-6b46-4b55-ba09-0bcf98b4e4bf admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:00.682620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1166/2327] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:56:00.688683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d752ba-55ab-4333-bf9b-47c7cdefdaba admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:00.699693 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d752ba-55ab-4333-bf9b-47c7cdefdaba admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:00.704528 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7a550-d6e4-417d-a25c-0be0f6137d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:00.706130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7a550-d6e4-417d-a25c-0be0f6137d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:00.706130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7a550-d6e4-417d-a25c-0be0f6137d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:00.706130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7a550-d6e4-417d-a25c-0be0f6137d2d admin admin] PATH_INFO: `/v3/projects/a532914233184399bd6a70d5257921f7/users/7c72410df3f94360a8995efc8279f42f/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:00.721079 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7a550-d6e4-417d-a25c-0be0f6137d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a532914233184399bd6a70d5257921f7, user_id=7c72410df3f94360a8995efc8279f42f, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:00.723850 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7a550-d6e4-417d-a25c-0be0f6137d2d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:00.822842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1162/2328] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:56:00 2022] PUT /identity/v3/projects/a532914233184399bd6a70d5257921f7/users/7c72410df3f94360a8995efc8279f42f/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:00.833614 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75331e-a69c-4281-9378-d3d30587727f None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:00.833614 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75331e-a69c-4281-9378-d3d30587727f None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:00.833781 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75331e-a69c-4281-9378-d3d30587727f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:00.866944 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-0e75331e-a69c-4281-9378-d3d30587727f None None] MFA Rules not processed for user `7c72410df3f94360a8995efc8279f42f`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:00.867996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0e75331e-a69c-4281-9378-d3d30587727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:00.984983 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1167/2329] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:00.987136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7a550-d6e4-417d-a25c-0be0f6137d2d admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:01.062526 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7a550-d6e4-417d-a25c-0be0f6137d2d admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:01.068772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49705284-8e73-486d-a05e-a11a2925274e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:01.069746 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49705284-8e73-486d-a05e-a11a2925274e admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:01.070138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49705284-8e73-486d-a05e-a11a2925274e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:01.070515 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49705284-8e73-486d-a05e-a11a2925274e admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:01.071467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49705284-8e73-486d-a05e-a11a2925274e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:01.073769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49705284-8e73-486d-a05e-a11a2925274e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:01.180424 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1163/2330] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:56:00 2022] POST /identity/v3/projects => generated 383 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:56:01.184549 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75331e-a69c-4281-9378-d3d30587727f None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:01.197788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75331e-a69c-4281-9378-d3d30587727f None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:01.270578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85978374-76bd-4def-861c-3630108df5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:01.271362 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85978374-76bd-4def-861c-3630108df5ef admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:01.271740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85978374-76bd-4def-861c-3630108df5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:01.272100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85978374-76bd-4def-861c-3630108df5ef admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:01.272884 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85978374-76bd-4def-861c-3630108df5ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:01.275272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85978374-76bd-4def-861c-3630108df5ef admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:01.398023 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1168/2331] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:56:01 2022] POST /identity/v3/users => generated 298 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:56:01.401485 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49705284-8e73-486d-a05e-a11a2925274e admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:01.413255 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49705284-8e73-486d-a05e-a11a2925274e admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:01.418374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d34d1-7f63-40f4-9f2b-737fe1ce5bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:01.419104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d34d1-7f63-40f4-9f2b-737fe1ce5bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:01.420601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d34d1-7f63-40f4-9f2b-737fe1ce5bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:01.420601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d34d1-7f63-40f4-9f2b-737fe1ce5bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:01.420601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d34d1-7f63-40f4-9f2b-737fe1ce5bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:01.422055 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d34d1-7f63-40f4-9f2b-737fe1ce5bf2 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:01.434004 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1164/2332] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:56:01.438687 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85978374-76bd-4def-861c-3630108df5ef admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:01.449760 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85978374-76bd-4def-861c-3630108df5ef admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:01.456424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ab646-7e53-480e-a3c1-cedbca14d115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:01.458058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ab646-7e53-480e-a3c1-cedbca14d115 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:01.459911 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ab646-7e53-480e-a3c1-cedbca14d115 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:01.460885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ab646-7e53-480e-a3c1-cedbca14d115 admin admin] PATH_INFO: `/v3/projects/f5722086d4d9459f84c541152c3adf92/users/e7475d1ebfa9462ab136932938ae041a/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:01.482600 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ab646-7e53-480e-a3c1-cedbca14d115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5722086d4d9459f84c541152c3adf92, user_id=e7475d1ebfa9462ab136932938ae041a, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:01.485924 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598ab646-7e53-480e-a3c1-cedbca14d115 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:01.584503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:01.589670 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1169/2333] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:56:01 2022] PUT /identity/v3/projects/f5722086d4d9459f84c541152c3adf92/users/e7475d1ebfa9462ab136932938ae041a/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:01.594063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d34d1-7f63-40f4-9f2b-737fe1ce5bf2 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:01.604786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d34d1-7f63-40f4-9f2b-737fe1ce5bf2 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:01.617296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:01.662157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cd9f7-b0a5-4878-9371-6117eaeaf91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:01.662834 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cd9f7-b0a5-4878-9371-6117eaeaf91f admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:01.663120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cd9f7-b0a5-4878-9371-6117eaeaf91f admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:01.663400 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cd9f7-b0a5-4878-9371-6117eaeaf91f admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:01.664203 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cd9f7-b0a5-4878-9371-6117eaeaf91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:01.665819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cd9f7-b0a5-4878-9371-6117eaeaf91f admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:01.676014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1165/2334] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:56:01.680314 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ab646-7e53-480e-a3c1-cedbca14d115 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:01.691969 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598ab646-7e53-480e-a3c1-cedbca14d115 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:01.698298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c1b58-bf3d-40c0-b1ae-3ad8daac47c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:01.699669 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c1b58-bf3d-40c0-b1ae-3ad8daac47c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:01.699669 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c1b58-bf3d-40c0-b1ae-3ad8daac47c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:01.699959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c1b58-bf3d-40c0-b1ae-3ad8daac47c2 admin admin] PATH_INFO: `/v3/projects/f5722086d4d9459f84c541152c3adf92/users/e7475d1ebfa9462ab136932938ae041a/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:01.702945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c1b58-bf3d-40c0-b1ae-3ad8daac47c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5722086d4d9459f84c541152c3adf92, user_id=e7475d1ebfa9462ab136932938ae041a, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:01.707257 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c1b58-bf3d-40c0-b1ae-3ad8daac47c2 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:01.718255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1170/2335] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:56:01 2022] PUT /identity/v3/projects/f5722086d4d9459f84c541152c3adf92/users/e7475d1ebfa9462ab136932938ae041a/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:01.728920 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99cf7a-f9b3-418a-b071-60500c05872c None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:01.729237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99cf7a-f9b3-418a-b071-60500c05872c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:01.729518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99cf7a-f9b3-418a-b071-60500c05872c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:01.756880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-bc99cf7a-f9b3-418a-b071-60500c05872c None None] MFA Rules not processed for user `e7475d1ebfa9462ab136932938ae041a`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:01.758112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-bc99cf7a-f9b3-418a-b071-60500c05872c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:01.830556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1166/2336] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:01.841632 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c1b58-bf3d-40c0-b1ae-3ad8daac47c2 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:01.843442 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-833c1b58-bf3d-40c0-b1ae-3ad8daac47c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:01.904101 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c1b58-bf3d-40c0-b1ae-3ad8daac47c2 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:01.907818 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c497c89-4cbf-4c14-aeb8-2b027a476d22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:01.908470 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c497c89-4cbf-4c14-aeb8-2b027a476d22 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:01.908754 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c497c89-4cbf-4c14-aeb8-2b027a476d22 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:01.909029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c497c89-4cbf-4c14-aeb8-2b027a476d22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:01.973953 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c497c89-4cbf-4c14-aeb8-2b027a476d22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:01.975400 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c497c89-4cbf-4c14-aeb8-2b027a476d22 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:01.986475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1171/2337] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:05.633865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99cf7a-f9b3-418a-b071-60500c05872c None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:05.635323 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-bc99cf7a-f9b3-418a-b071-60500c05872c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:05.710011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99cf7a-f9b3-418a-b071-60500c05872c None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:05.715647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b12bc2-c34b-4e2b-8f8f-528695142176 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:05.716292 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b12bc2-c34b-4e2b-8f8f-528695142176 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:05.716580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b12bc2-c34b-4e2b-8f8f-528695142176 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:05.716862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b12bc2-c34b-4e2b-8f8f-528695142176 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:05.718809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-87b12bc2-c34b-4e2b-8f8f-528695142176 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:05.754258 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:05.778688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b12bc2-c34b-4e2b-8f8f-528695142176 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:05.780362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b12bc2-c34b-4e2b-8f8f-528695142176 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:05.790165 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1167/2338] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:05 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:07.282317 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c497c89-4cbf-4c14-aeb8-2b027a476d22 service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:07.284660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-2c497c89-4cbf-4c14-aeb8-2b027a476d22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:07.295993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c497c89-4cbf-4c14-aeb8-2b027a476d22 service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:07.299666 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8988f0-f815-4c0b-97e3-8870b63e3f96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:07.300309 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8988f0-f815-4c0b-97e3-8870b63e3f96 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:07.300597 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8988f0-f815-4c0b-97e3-8870b63e3f96 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:07.300880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8988f0-f815-4c0b-97e3-8870b63e3f96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:07.309960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8988f0-f815-4c0b-97e3-8870b63e3f96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:07.311446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8988f0-f815-4c0b-97e3-8870b63e3f96 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:07.321055 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1172/2339] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:08.331828 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82917fe-6935-4199-a19f-3ee58a94fbd5 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:08.332236 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82917fe-6935-4199-a19f-3ee58a94fbd5 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:08.332388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82917fe-6935-4199-a19f-3ee58a94fbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:08.381336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-c82917fe-6935-4199-a19f-3ee58a94fbd5 None None] MFA Rules not processed for user `6e6313c444eb4a788b6559eff17959f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:08.382583 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-c82917fe-6935-4199-a19f-3ee58a94fbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:08.445758 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1168/2340] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jun 27 18:56:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:08.598314 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8988f0-f815-4c0b-97e3-8870b63e3f96 service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:08.599786 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-6a8988f0-f815-4c0b-97e3-8870b63e3f96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:08.690164 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8988f0-f815-4c0b-97e3-8870b63e3f96 service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:08.695774 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c872c-7217-4272-8a11-b38484880b7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94555ff897d94c90968c470d82ff9e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:08.696421 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c872c-7217-4272-8a11-b38484880b7f service swift] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:08.696704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c872c-7217-4272-8a11-b38484880b7f service swift] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:08.697493 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c872c-7217-4272-8a11-b38484880b7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:08.706072 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c872c-7217-4272-8a11-b38484880b7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:08.707826 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c872c-7217-4272-8a11-b38484880b7f service swift] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:08.711705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:08.717538 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1173/2341] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jun 27 18:56:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 18:56:10.488590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82917fe-6935-4199-a19f-3ee58a94fbd5 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:10.490256 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-c82917fe-6935-4199-a19f-3ee58a94fbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:10.615591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82917fe-6935-4199-a19f-3ee58a94fbd5 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:10.629191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b0588-22f8-4090-85db-4219e1d62ce8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af6ef16884604753972c916f74271f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:10.630630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b0588-22f8-4090-85db-4219e1d62ce8 service placement] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:10.630630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b0588-22f8-4090-85db-4219e1d62ce8 service placement] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:10.630630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b0588-22f8-4090-85db-4219e1d62ce8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:10.639925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-d29b0588-22f8-4090-85db-4219e1d62ce8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:10.640743 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c872c-7217-4272-8a11-b38484880b7f service swift] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:10.643433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-cc0c872c-7217-4272-8a11-b38484880b7f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:10.664737 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b0588-22f8-4090-85db-4219e1d62ce8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:10.666615 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b0588-22f8-4090-85db-4219e1d62ce8 service placement] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:10.690467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1169/2342] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:10.761756 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c872c-7217-4272-8a11-b38484880b7f service swift] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:10.766502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b786f4-586b-4f46-88de-9894dd172bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:10.767960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b786f4-586b-4f46-88de-9894dd172bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:10.768279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b786f4-586b-4f46-88de-9894dd172bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:10.768531 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b786f4-586b-4f46-88de-9894dd172bfd admin admin] PATH_INFO: `/v3/users/cf3f71b3974245979beef804ecea006d` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:10.769740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b786f4-586b-4f46-88de-9894dd172bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf3f71b3974245979beef804ecea006d)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:10.771762 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b786f4-586b-4f46-88de-9894dd172bfd admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:11.008255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-50b786f4-586b-4f46-88de-9894dd172bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf3f71b3974245979beef804ecea006d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:11.073037 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-50b786f4-586b-4f46-88de-9894dd172bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf3f71b3974245979beef804ecea006d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:11.097894 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-50b786f4-586b-4f46-88de-9894dd172bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf3f71b3974245979beef804ecea006d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:11.099094 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-50b786f4-586b-4f46-88de-9894dd172bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf3f71b3974245979beef804ecea006d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:11.121183 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-50b786f4-586b-4f46-88de-9894dd172bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf3f71b3974245979beef804ecea006d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:11.129995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1174/2343] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:56:10 2022] DELETE /identity/v3/users/cf3f71b3974245979beef804ecea006d => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:11.424351 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b0588-22f8-4090-85db-4219e1d62ce8 service placement] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:11.436522 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b0588-22f8-4090-85db-4219e1d62ce8 service placement] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:11.477901 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:11.503731 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a11f3-e8d7-4a12-a048-6a25afceac29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:11.504617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a11f3-e8d7-4a12-a048-6a25afceac29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:11.504906 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a11f3-e8d7-4a12-a048-6a25afceac29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:11.505210 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a11f3-e8d7-4a12-a048-6a25afceac29 admin admin] PATH_INFO: `/v3/projects/aebe1760a9014f68b0a4c25bd04e19e5` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:11.506463 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a11f3-e8d7-4a12-a048-6a25afceac29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aebe1760a9014f68b0a4c25bd04e19e5)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:11.508459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a11f3-e8d7-4a12-a048-6a25afceac29 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:11.737153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9c5a11f3-e8d7-4a12-a048-6a25afceac29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aebe1760a9014f68b0a4c25bd04e19e5', 'request_id': 'req-9c5a11f3-e8d7-4a12-a048-6a25afceac29'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:11.743387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9c5a11f3-e8d7-4a12-a048-6a25afceac29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aebe1760a9014f68b0a4c25bd04e19e5', 'request_id': 'req-9c5a11f3-e8d7-4a12-a048-6a25afceac29'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:12.215682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9c5a11f3-e8d7-4a12-a048-6a25afceac29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aebe1760a9014f68b0a4c25bd04e19e5', 'request_id': 'req-9c5a11f3-e8d7-4a12-a048-6a25afceac29'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:12.226826 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9c5a11f3-e8d7-4a12-a048-6a25afceac29 admin admin] The token cache is being invalidate because project aebe1760a9014f68b0a4c25bd04e19e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:56:12.227132 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9c5a11f3-e8d7-4a12-a048-6a25afceac29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:12.228013 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9c5a11f3-e8d7-4a12-a048-6a25afceac29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:12.229547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1170/2344] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:56:11 2022] DELETE /identity/v3/projects/aebe1760a9014f68b0a4c25bd04e19e5 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:12.234470 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a8c15-fbf5-4348-9f96-8511d9d034f7 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:12.234951 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a8c15-fbf5-4348-9f96-8511d9d034f7 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:12.235066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a8c15-fbf5-4348-9f96-8511d9d034f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:12.254814 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-bd8a8c15-fbf5-4348-9f96-8511d9d034f7 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:12.256050 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-bd8a8c15-fbf5-4348-9f96-8511d9d034f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:12.322535 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1175/2345] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:12.339118 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c9a9b-227b-4ab3-b42c-12afab49c6c0 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:12.339419 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c9a9b-227b-4ab3-b42c-12afab49c6c0 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:12.339731 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c9a9b-227b-4ab3-b42c-12afab49c6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:12.360785 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-110c9a9b-227b-4ab3-b42c-12afab49c6c0 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:12.363269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-110c9a9b-227b-4ab3-b42c-12afab49c6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:12.371609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1171/2346] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:12.375976 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a8c15-fbf5-4348-9f96-8511d9d034f7 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:12.387374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a8c15-fbf5-4348-9f96-8511d9d034f7 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:12.393149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2283d9-789b-428f-a3a5-879390edecfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:12.396996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2283d9-789b-428f-a3a5-879390edecfe admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:12.396996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2283d9-789b-428f-a3a5-879390edecfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:12.396996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2283d9-789b-428f-a3a5-879390edecfe admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:12.396996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2283d9-789b-428f-a3a5-879390edecfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:56:12.396996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2283d9-789b-428f-a3a5-879390edecfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:12.397401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2283d9-789b-428f-a3a5-879390edecfe admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:12.417795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c9a9b-227b-4ab3-b42c-12afab49c6c0 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:12.422661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1176/2347] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:56:12.432092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110c9a9b-227b-4ab3-b42c-12afab49c6c0 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:12.437270 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4de1f-db21-4bc5-a78b-2d2e52efedb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:12.443999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4de1f-db21-4bc5-a78b-2d2e52efedb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:12.443999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4de1f-db21-4bc5-a78b-2d2e52efedb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:12.443999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b4de1f-db21-4bc5-a78b-2d2e52efedb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:12.443999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4de1f-db21-4bc5-a78b-2d2e52efedb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:12.443999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b4de1f-db21-4bc5-a78b-2d2e52efedb2 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:12.536453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1172/2348] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:56:12 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:56:12.537852 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2283d9-789b-428f-a3a5-879390edecfe admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:12.549498 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2283d9-789b-428f-a3a5-879390edecfe admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:12.555495 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:12.621868 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a6189-1ac4-49d6-b16a-65cd726f1417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:12.622621 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a6189-1ac4-49d6-b16a-65cd726f1417 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:12.622916 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a6189-1ac4-49d6-b16a-65cd726f1417 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:12.623203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a6189-1ac4-49d6-b16a-65cd726f1417 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:12.623972 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a6189-1ac4-49d6-b16a-65cd726f1417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:12.631963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a6189-1ac4-49d6-b16a-65cd726f1417 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:12.736026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1177/2349] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:56:12 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:56:12.737711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4de1f-db21-4bc5-a78b-2d2e52efedb2 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:12.749263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b4de1f-db21-4bc5-a78b-2d2e52efedb2 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:12.754807 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaea27b-e91e-41f9-8e1a-e8c78baf5006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:12.755484 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaea27b-e91e-41f9-8e1a-e8c78baf5006 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:12.756990 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaea27b-e91e-41f9-8e1a-e8c78baf5006 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:12.756990 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaea27b-e91e-41f9-8e1a-e8c78baf5006 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:12.759805 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaea27b-e91e-41f9-8e1a-e8c78baf5006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:12.761474 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaea27b-e91e-41f9-8e1a-e8c78baf5006 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:12.777227 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1173/2350] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:56:12.781696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a6189-1ac4-49d6-b16a-65cd726f1417 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:12.796143 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a6189-1ac4-49d6-b16a-65cd726f1417 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:12.802426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace9f51-7759-4fd5-9ae7-d6d9c9828bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:12.803341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace9f51-7759-4fd5-9ae7-d6d9c9828bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:12.803895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace9f51-7759-4fd5-9ae7-d6d9c9828bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:12.804353 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace9f51-7759-4fd5-9ae7-d6d9c9828bf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:12.805308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace9f51-7759-4fd5-9ae7-d6d9c9828bf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:12.807096 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace9f51-7759-4fd5-9ae7-d6d9c9828bf0 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:12.819954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1178/2351] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:56:12.823779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaea27b-e91e-41f9-8e1a-e8c78baf5006 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:12.838501 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaea27b-e91e-41f9-8e1a-e8c78baf5006 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:12.843795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb45170-1179-4a53-87d9-7c18154c9d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:12.844688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45170-1179-4a53-87d9-7c18154c9d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:12.844973 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45170-1179-4a53-87d9-7c18154c9d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:12.845255 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb45170-1179-4a53-87d9-7c18154c9d9b admin admin] PATH_INFO: `/v3/projects/4fc8b638d0644da8931adbf4ca0229e0/users/8e3ca26b66be4f5cab84485228ce4252/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:12.868733 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb45170-1179-4a53-87d9-7c18154c9d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc8b638d0644da8931adbf4ca0229e0, user_id=8e3ca26b66be4f5cab84485228ce4252, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:12.872283 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb45170-1179-4a53-87d9-7c18154c9d9b admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:12.980198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1174/2352] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:56:12 2022] PUT /identity/v3/projects/4fc8b638d0644da8931adbf4ca0229e0/users/8e3ca26b66be4f5cab84485228ce4252/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:12.985325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aecbd1-6765-48c4-82f9-8cf9eb9d54ca None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:12.985618 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aecbd1-6765-48c4-82f9-8cf9eb9d54ca None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:12.985898 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aecbd1-6765-48c4-82f9-8cf9eb9d54ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:13.016033 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-c8aecbd1-6765-48c4-82f9-8cf9eb9d54ca None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:13.016321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c8aecbd1-6765-48c4-82f9-8cf9eb9d54ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:13.099574 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1179/2353] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:56:13.111857 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb45170-1179-4a53-87d9-7c18154c9d9b admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:13.113743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-acb45170-1179-4a53-87d9-7c18154c9d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:13.192203 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb45170-1179-4a53-87d9-7c18154c9d9b admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:13.196064 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7eea28-ceaf-4c04-aa2b-04bfd2fb395e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:13.197484 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eea28-ceaf-4c04-aa2b-04bfd2fb395e service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:13.197879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eea28-ceaf-4c04-aa2b-04bfd2fb395e service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:13.198382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eea28-ceaf-4c04-aa2b-04bfd2fb395e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:13.209533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7eea28-ceaf-4c04-aa2b-04bfd2fb395e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:13.211029 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7eea28-ceaf-4c04-aa2b-04bfd2fb395e service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:13.221476 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1175/2354] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:13.587931 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aecbd1-6765-48c4-82f9-8cf9eb9d54ca None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:13.589438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c8aecbd1-6765-48c4-82f9-8cf9eb9d54ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:13.605729 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aecbd1-6765-48c4-82f9-8cf9eb9d54ca None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:13.611915 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd38786-ee4e-45f4-9597-2860645e3b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:13.612802 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd38786-ee4e-45f4-9597-2860645e3b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:13.613088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd38786-ee4e-45f4-9597-2860645e3b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:13.613493 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd38786-ee4e-45f4-9597-2860645e3b84 admin admin] PATH_INFO: `/v3/users/7c72410df3f94360a8995efc8279f42f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:13.614760 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd38786-ee4e-45f4-9597-2860645e3b84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c72410df3f94360a8995efc8279f42f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:13.617320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd38786-ee4e-45f4-9597-2860645e3b84 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:13.841271 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-dbd38786-ee4e-45f4-9597-2860645e3b84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c72410df3f94360a8995efc8279f42f'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:13.914440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-dbd38786-ee4e-45f4-9597-2860645e3b84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c72410df3f94360a8995efc8279f42f'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:13.941359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-dbd38786-ee4e-45f4-9597-2860645e3b84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c72410df3f94360a8995efc8279f42f'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:13.942125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-dbd38786-ee4e-45f4-9597-2860645e3b84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c72410df3f94360a8995efc8279f42f'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:13.952780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:13.959232 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-dbd38786-ee4e-45f4-9597-2860645e3b84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c72410df3f94360a8995efc8279f42f'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:13.976789 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1180/2355] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:56:13 2022] DELETE /identity/v3/users/7c72410df3f94360a8995efc8279f42f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:13.979207 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42775dcd-8b4e-4b4c-8071-25a444998da9 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:13.979741 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42775dcd-8b4e-4b4c-8071-25a444998da9 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:13.979833 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42775dcd-8b4e-4b4c-8071-25a444998da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:13.987432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:14.001058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-42775dcd-8b4e-4b4c-8071-25a444998da9 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:14.002449 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-42775dcd-8b4e-4b4c-8071-25a444998da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:14.087882 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1176/2356] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:14.094350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd38786-ee4e-45f4-9597-2860645e3b84 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:14.096671 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-dbd38786-ee4e-45f4-9597-2860645e3b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:14.172013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd38786-ee4e-45f4-9597-2860645e3b84 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:14.176791 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d37d82-81de-4089-a4eb-9ed13cce9167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:14.177498 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d37d82-81de-4089-a4eb-9ed13cce9167 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:14.177785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d37d82-81de-4089-a4eb-9ed13cce9167 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:14.178066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d37d82-81de-4089-a4eb-9ed13cce9167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:14.188915 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d37d82-81de-4089-a4eb-9ed13cce9167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:14.190994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d37d82-81de-4089-a4eb-9ed13cce9167 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:14.202612 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1181/2357] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:14.830758 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42775dcd-8b4e-4b4c-8071-25a444998da9 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:14.835239 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-42775dcd-8b4e-4b4c-8071-25a444998da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:14.862479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42775dcd-8b4e-4b4c-8071-25a444998da9 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:14.866551 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b17cb-b480-486d-bd6e-974f0ca048bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:14.867739 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b17cb-b480-486d-bd6e-974f0ca048bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:14.868023 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b17cb-b480-486d-bd6e-974f0ca048bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:14.868313 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b17cb-b480-486d-bd6e-974f0ca048bb admin admin] PATH_INFO: `/v3/projects/a532914233184399bd6a70d5257921f7` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:14.869508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b17cb-b480-486d-bd6e-974f0ca048bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a532914233184399bd6a70d5257921f7)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:14.874185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b17cb-b480-486d-bd6e-974f0ca048bb admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:15.025044 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1c8b17cb-b480-486d-bd6e-974f0ca048bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a532914233184399bd6a70d5257921f7', 'request_id': 'req-1c8b17cb-b480-486d-bd6e-974f0ca048bb'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:15.036241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1c8b17cb-b480-486d-bd6e-974f0ca048bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a532914233184399bd6a70d5257921f7', 'request_id': 'req-1c8b17cb-b480-486d-bd6e-974f0ca048bb'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:15.268632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1c8b17cb-b480-486d-bd6e-974f0ca048bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a532914233184399bd6a70d5257921f7', 'request_id': 'req-1c8b17cb-b480-486d-bd6e-974f0ca048bb'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:15.279511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1c8b17cb-b480-486d-bd6e-974f0ca048bb admin admin] The token cache is being invalidate because project a532914233184399bd6a70d5257921f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:56:15.279819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1c8b17cb-b480-486d-bd6e-974f0ca048bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:15.280462 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1c8b17cb-b480-486d-bd6e-974f0ca048bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:15.282235 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1177/2358] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:56:14 2022] DELETE /identity/v3/projects/a532914233184399bd6a70d5257921f7 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:15.286199 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d37d82-81de-4089-a4eb-9ed13cce9167 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:15.296332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d37d82-81de-4089-a4eb-9ed13cce9167 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:15.381220 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00161d53-c9d3-4b12-aa83-08a4d6c5a23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:15.381220 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161d53-c9d3-4b12-aa83-08a4d6c5a23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:15.381220 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161d53-c9d3-4b12-aa83-08a4d6c5a23c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:15.381220 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00161d53-c9d3-4b12-aa83-08a4d6c5a23c admin admin] PATH_INFO: `/v3/users/e7475d1ebfa9462ab136932938ae041a` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:15.381941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00161d53-c9d3-4b12-aa83-08a4d6c5a23c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7475d1ebfa9462ab136932938ae041a)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:15.381941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00161d53-c9d3-4b12-aa83-08a4d6c5a23c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:15.727513 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-00161d53-c9d3-4b12-aa83-08a4d6c5a23c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7475d1ebfa9462ab136932938ae041a'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:15.822650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-00161d53-c9d3-4b12-aa83-08a4d6c5a23c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7475d1ebfa9462ab136932938ae041a'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:15.885540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-00161d53-c9d3-4b12-aa83-08a4d6c5a23c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7475d1ebfa9462ab136932938ae041a'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:15.887652 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-00161d53-c9d3-4b12-aa83-08a4d6c5a23c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7475d1ebfa9462ab136932938ae041a'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:15.913118 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-00161d53-c9d3-4b12-aa83-08a4d6c5a23c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7475d1ebfa9462ab136932938ae041a'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:15.943943 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1182/2359] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:56:15 2022] DELETE /identity/v3/users/e7475d1ebfa9462ab136932938ae041a => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:16.465627 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b17cb-b480-486d-bd6e-974f0ca048bb admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:16.466926 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-1c8b17cb-b480-486d-bd6e-974f0ca048bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:16.501203 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b17cb-b480-486d-bd6e-974f0ca048bb admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:16.605948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ec044-ded1-4de5-878b-923f46a3f759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:16.607009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ec044-ded1-4de5-878b-923f46a3f759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:16.607397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ec044-ded1-4de5-878b-923f46a3f759 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:16.607801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ec044-ded1-4de5-878b-923f46a3f759 admin admin] PATH_INFO: `/v3/projects/f5722086d4d9459f84c541152c3adf92` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:16.610151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ec044-ded1-4de5-878b-923f46a3f759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5722086d4d9459f84c541152c3adf92)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:16.612772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ec044-ded1-4de5-878b-923f46a3f759 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:16.708742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:16.737930 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-d07ec044-ded1-4de5-878b-923f46a3f759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5722086d4d9459f84c541152c3adf92', 'request_id': 'req-d07ec044-ded1-4de5-878b-923f46a3f759'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:16.747557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-d07ec044-ded1-4de5-878b-923f46a3f759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5722086d4d9459f84c541152c3adf92', 'request_id': 'req-d07ec044-ded1-4de5-878b-923f46a3f759'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:16.817177 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-d07ec044-ded1-4de5-878b-923f46a3f759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5722086d4d9459f84c541152c3adf92', 'request_id': 'req-d07ec044-ded1-4de5-878b-923f46a3f759'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:16.833852 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-d07ec044-ded1-4de5-878b-923f46a3f759 admin admin] The token cache is being invalidate because project f5722086d4d9459f84c541152c3adf92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:56:16.834308 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-d07ec044-ded1-4de5-878b-923f46a3f759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:16.837470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-d07ec044-ded1-4de5-878b-923f46a3f759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:16.840968 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1178/2360] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:56:16 2022] DELETE /identity/v3/projects/f5722086d4d9459f84c541152c3adf92 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:16.850395 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38a6dc-6bdf-4f40-ac8d-84fd62b839d0 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:16.850395 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38a6dc-6bdf-4f40-ac8d-84fd62b839d0 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:16.850395 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c38a6dc-6bdf-4f40-ac8d-84fd62b839d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:16.874633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-4c38a6dc-6bdf-4f40-ac8d-84fd62b839d0 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:16.874633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-4c38a6dc-6bdf-4f40-ac8d-84fd62b839d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:16.898384 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:16.971641 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1183/2361] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:16.980998 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22a9aa-6506-49ed-97fd-43f3470c6d75 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:16.981355 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22a9aa-6506-49ed-97fd-43f3470c6d75 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:16.981721 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22a9aa-6506-49ed-97fd-43f3470c6d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:17.002503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-eb22a9aa-6506-49ed-97fd-43f3470c6d75 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:17.003947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-eb22a9aa-6506-49ed-97fd-43f3470c6d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:17.012622 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1179/2362] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:17.018716 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38a6dc-6bdf-4f40-ac8d-84fd62b839d0 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:17.051404 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c38a6dc-6bdf-4f40-ac8d-84fd62b839d0 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:17.066315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a865019-2efc-4614-89ce-f7b16219da36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:17.067055 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a865019-2efc-4614-89ce-f7b16219da36 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:17.067342 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a865019-2efc-4614-89ce-f7b16219da36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:17.067648 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a865019-2efc-4614-89ce-f7b16219da36 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:17.068392 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a865019-2efc-4614-89ce-f7b16219da36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:56:17.068705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a865019-2efc-4614-89ce-f7b16219da36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:17.070325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a865019-2efc-4614-89ce-f7b16219da36 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:17.102382 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1184/2363] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:56:17.106827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22a9aa-6506-49ed-97fd-43f3470c6d75 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:17.118552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22a9aa-6506-49ed-97fd-43f3470c6d75 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:17.127365 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef58cc1-1aa0-4b6a-af4b-88954fe0b513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:17.128613 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef58cc1-1aa0-4b6a-af4b-88954fe0b513 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:17.129003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef58cc1-1aa0-4b6a-af4b-88954fe0b513 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:17.129387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef58cc1-1aa0-4b6a-af4b-88954fe0b513 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:17.130208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef58cc1-1aa0-4b6a-af4b-88954fe0b513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:17.132576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef58cc1-1aa0-4b6a-af4b-88954fe0b513 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:17.272173 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1180/2364] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:56:17 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:56:17.276224 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a865019-2efc-4614-89ce-f7b16219da36 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:17.296012 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a865019-2efc-4614-89ce-f7b16219da36 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:17.402519 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4c995-e306-41ba-8302-91e06b34f367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:17.403348 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4c995-e306-41ba-8302-91e06b34f367 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:17.403511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4c995-e306-41ba-8302-91e06b34f367 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:17.409873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4c995-e306-41ba-8302-91e06b34f367 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:17.409873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4c995-e306-41ba-8302-91e06b34f367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:17.412823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4c995-e306-41ba-8302-91e06b34f367 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:17.543294 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1185/2365] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:56:17 2022] POST /identity/v3/users => generated 292 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:56:17.544434 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef58cc1-1aa0-4b6a-af4b-88954fe0b513 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:17.563219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef58cc1-1aa0-4b6a-af4b-88954fe0b513 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:17.570838 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440ef8a-4327-4ddf-b933-7272dfb0f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:17.571611 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ef8a-4327-4ddf-b933-7272dfb0f14f admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:17.572050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ef8a-4327-4ddf-b933-7272dfb0f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:17.572341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440ef8a-4327-4ddf-b933-7272dfb0f14f admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:17.573566 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440ef8a-4327-4ddf-b933-7272dfb0f14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:17.575256 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440ef8a-4327-4ddf-b933-7272dfb0f14f admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:17.600386 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1181/2366] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:56:17.601667 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4c995-e306-41ba-8302-91e06b34f367 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:17.621665 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4c995-e306-41ba-8302-91e06b34f367 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:17.632063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533972e0-2a0d-4490-9f31-5dbfa3839722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:17.632063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533972e0-2a0d-4490-9f31-5dbfa3839722 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:17.632063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533972e0-2a0d-4490-9f31-5dbfa3839722 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:17.632063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533972e0-2a0d-4490-9f31-5dbfa3839722 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:17.633215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533972e0-2a0d-4490-9f31-5dbfa3839722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:17.634624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533972e0-2a0d-4490-9f31-5dbfa3839722 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:17.651150 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1186/2367] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:56:17.655796 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440ef8a-4327-4ddf-b933-7272dfb0f14f admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:17.674828 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440ef8a-4327-4ddf-b933-7272dfb0f14f admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:17.680056 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca21e6-e8bc-4f90-9596-4bed1c4fa26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:17.690910 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca21e6-e8bc-4f90-9596-4bed1c4fa26d admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:17.691309 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca21e6-e8bc-4f90-9596-4bed1c4fa26d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:17.691565 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca21e6-e8bc-4f90-9596-4bed1c4fa26d admin admin] PATH_INFO: `/v3/projects/9508670f10324785b405fd464603be05/users/772e172aebcc4466b8347338c9ca11a5/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:17.715143 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca21e6-e8bc-4f90-9596-4bed1c4fa26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9508670f10324785b405fd464603be05, user_id=772e172aebcc4466b8347338c9ca11a5, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:17.718127 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca21e6-e8bc-4f90-9596-4bed1c4fa26d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:17.824105 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1182/2368] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:56:17 2022] PUT /identity/v3/projects/9508670f10324785b405fd464603be05/users/772e172aebcc4466b8347338c9ca11a5/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:17.838011 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1811f-f284-491c-b059-e586c4224902 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:17.838759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1811f-f284-491c-b059-e586c4224902 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:17.839065 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1811f-f284-491c-b059-e586c4224902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:17.890096 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-cda1811f-f284-491c-b059-e586c4224902 None None] MFA Rules not processed for user `772e172aebcc4466b8347338c9ca11a5`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:17.892204 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-cda1811f-f284-491c-b059-e586c4224902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:18.061462 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1187/2369] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:18.066324 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca21e6-e8bc-4f90-9596-4bed1c4fa26d admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:18.182751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca21e6-e8bc-4f90-9596-4bed1c4fa26d admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:18.188118 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ab99a-3571-477a-9ba4-0ed362c25db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:18.188797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ab99a-3571-477a-9ba4-0ed362c25db9 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:18.189178 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ab99a-3571-477a-9ba4-0ed362c25db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:18.189466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ab99a-3571-477a-9ba4-0ed362c25db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:18.190401 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ab99a-3571-477a-9ba4-0ed362c25db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:18.192382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ab99a-3571-477a-9ba4-0ed362c25db9 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:18.280337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1183/2370] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:56:18 2022] POST /identity/v3/projects => generated 383 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:56:18.284862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1811f-f284-491c-b059-e586c4224902 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:18.304466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1811f-f284-491c-b059-e586c4224902 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:18.320933 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:18.430806 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e94c1-d7c1-4091-a8fb-ef59e7e1324d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:18.432649 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e94c1-d7c1-4091-a8fb-ef59e7e1324d admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:18.433621 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e94c1-d7c1-4091-a8fb-ef59e7e1324d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:18.434063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e94c1-d7c1-4091-a8fb-ef59e7e1324d admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:18.435009 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e94c1-d7c1-4091-a8fb-ef59e7e1324d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:18.437360 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e94c1-d7c1-4091-a8fb-ef59e7e1324d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:18.544555 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1188/2371] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:56:18 2022] POST /identity/v3/users => generated 292 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:56:18.545107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ab99a-3571-477a-9ba4-0ed362c25db9 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:18.561975 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ab99a-3571-477a-9ba4-0ed362c25db9 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:18.577716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa69a9d-0724-40a6-a511-3b0069087c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:18.577716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69a9d-0724-40a6-a511-3b0069087c1e admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:18.577716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69a9d-0724-40a6-a511-3b0069087c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:18.579296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69a9d-0724-40a6-a511-3b0069087c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:18.581935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa69a9d-0724-40a6-a511-3b0069087c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:18.586081 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa69a9d-0724-40a6-a511-3b0069087c1e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:18.617552 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e94c1-d7c1-4091-a8fb-ef59e7e1324d admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:18.633337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1184/2372] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:56:18.635585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e94c1-d7c1-4091-a8fb-ef59e7e1324d admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:18.647102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67236b-3259-481c-be5c-3fe68f35e10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:18.648733 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67236b-3259-481c-be5c-3fe68f35e10b admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:18.649017 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67236b-3259-481c-be5c-3fe68f35e10b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:18.652268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67236b-3259-481c-be5c-3fe68f35e10b admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:18.652268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67236b-3259-481c-be5c-3fe68f35e10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:18.654500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67236b-3259-481c-be5c-3fe68f35e10b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:18.681354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa69a9d-0724-40a6-a511-3b0069087c1e admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:18.687858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1189/2373] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:56:18.696462 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa69a9d-0724-40a6-a511-3b0069087c1e admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:18.704314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beeaca-00b7-4b7e-83ac-323ec09382d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:18.706399 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beeaca-00b7-4b7e-83ac-323ec09382d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:18.706689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beeaca-00b7-4b7e-83ac-323ec09382d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:18.708513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20beeaca-00b7-4b7e-83ac-323ec09382d2 admin admin] PATH_INFO: `/v3/projects/39a45e06520440bebc0fc0b4ee503c41/users/60061ee248094c6883696c3becdb650c/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:18.729544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20beeaca-00b7-4b7e-83ac-323ec09382d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a45e06520440bebc0fc0b4ee503c41, user_id=60061ee248094c6883696c3becdb650c, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:18.733154 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20beeaca-00b7-4b7e-83ac-323ec09382d2 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:18.817036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1185/2374] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:56:18 2022] PUT /identity/v3/projects/39a45e06520440bebc0fc0b4ee503c41/users/60061ee248094c6883696c3becdb650c/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:18.827118 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f50050-eb03-49d5-9ad2-837dbe3a37a2 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:18.827471 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f50050-eb03-49d5-9ad2-837dbe3a37a2 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:18.827714 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f50050-eb03-49d5-9ad2-837dbe3a37a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:18.863243 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-76f50050-eb03-49d5-9ad2-837dbe3a37a2 None None] MFA Rules not processed for user `60061ee248094c6883696c3becdb650c`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:18.865513 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-76f50050-eb03-49d5-9ad2-837dbe3a37a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:18.970666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beeaca-00b7-4b7e-83ac-323ec09382d2 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:18.973807 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1190/2375] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:18.977587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:19.059954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20beeaca-00b7-4b7e-83ac-323ec09382d2 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:19.066743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c5399-657d-458e-a3d3-bc93fa0a5474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:19.067492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c5399-657d-458e-a3d3-bc93fa0a5474 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:19.067813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c5399-657d-458e-a3d3-bc93fa0a5474 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:19.068096 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c5399-657d-458e-a3d3-bc93fa0a5474 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:19.068797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c5399-657d-458e-a3d3-bc93fa0a5474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:19.070821 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c5399-657d-458e-a3d3-bc93fa0a5474 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:19.187015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1186/2376] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:56:18 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:56:19.191124 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f50050-eb03-49d5-9ad2-837dbe3a37a2 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:19.212750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f50050-eb03-49d5-9ad2-837dbe3a37a2 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:19.314020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82099e-6ceb-4f8b-8b58-e6a40fae865b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:19.321708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82099e-6ceb-4f8b-8b58-e6a40fae865b admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:19.322911 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82099e-6ceb-4f8b-8b58-e6a40fae865b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:19.323414 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82099e-6ceb-4f8b-8b58-e6a40fae865b admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:19.324370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82099e-6ceb-4f8b-8b58-e6a40fae865b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:19.326611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82099e-6ceb-4f8b-8b58-e6a40fae865b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:19.428485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1191/2377] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:56:19 2022] POST /identity/v3/users => generated 299 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:56:19.434177 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c5399-657d-458e-a3d3-bc93fa0a5474 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:19.445899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c5399-657d-458e-a3d3-bc93fa0a5474 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:19.463438 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4dbb1-87fa-43f6-8063-220cbefe3204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:19.473760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4dbb1-87fa-43f6-8063-220cbefe3204 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:19.474064 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4dbb1-87fa-43f6-8063-220cbefe3204 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:19.475866 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4dbb1-87fa-43f6-8063-220cbefe3204 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:19.479089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4dbb1-87fa-43f6-8063-220cbefe3204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:19.481123 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4dbb1-87fa-43f6-8063-220cbefe3204 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:19.520899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1187/2378] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:56:19.525084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82099e-6ceb-4f8b-8b58-e6a40fae865b admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:19.542555 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82099e-6ceb-4f8b-8b58-e6a40fae865b admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:19.556244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de67e4-2492-43ce-994e-13cb56f4e423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:19.557482 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de67e4-2492-43ce-994e-13cb56f4e423 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:19.557933 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de67e4-2492-43ce-994e-13cb56f4e423 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:19.559095 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de67e4-2492-43ce-994e-13cb56f4e423 admin admin] PATH_INFO: `/v3/projects/b291e38003f747edabdce92574020e85/users/5de88c65f94844da93f68db2f4808dbb/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:19.574955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:19.585171 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de67e4-2492-43ce-994e-13cb56f4e423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b291e38003f747edabdce92574020e85, user_id=5de88c65f94844da93f68db2f4808dbb, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:19.595681 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0de67e4-2492-43ce-994e-13cb56f4e423 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:19.710761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1192/2379] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:56:19 2022] PUT /identity/v3/projects/b291e38003f747edabdce92574020e85/users/5de88c65f94844da93f68db2f4808dbb/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:56:19.712222 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4dbb1-87fa-43f6-8063-220cbefe3204 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:19.752246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4dbb1-87fa-43f6-8063-220cbefe3204 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:19.912090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc44f5-bed2-4aa7-b8fe-4351e271c933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:19.912427 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc44f5-bed2-4aa7-b8fe-4351e271c933 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:19.913089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc44f5-bed2-4aa7-b8fe-4351e271c933 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:19.913089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc44f5-bed2-4aa7-b8fe-4351e271c933 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:19.913950 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc44f5-bed2-4aa7-b8fe-4351e271c933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:19.917808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc44f5-bed2-4aa7-b8fe-4351e271c933 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:19.928337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1188/2380] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:56:19.932234 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de67e4-2492-43ce-994e-13cb56f4e423 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:19.945470 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de67e4-2492-43ce-994e-13cb56f4e423 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:19.950952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134232b-0501-442c-80f7-a8c43c217c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:19.951985 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134232b-0501-442c-80f7-a8c43c217c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:19.952346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134232b-0501-442c-80f7-a8c43c217c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:19.952700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b134232b-0501-442c-80f7-a8c43c217c22 admin admin] PATH_INFO: `/v3/projects/b291e38003f747edabdce92574020e85/users/5de88c65f94844da93f68db2f4808dbb/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:19.956454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134232b-0501-442c-80f7-a8c43c217c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b291e38003f747edabdce92574020e85, user_id=5de88c65f94844da93f68db2f4808dbb, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:19.959888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b134232b-0501-442c-80f7-a8c43c217c22 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:20.018032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1193/2381] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:56:19 2022] PUT /identity/v3/projects/b291e38003f747edabdce92574020e85/users/5de88c65f94844da93f68db2f4808dbb/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:20.028122 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f835f0e-3c27-492a-9f2b-7ce06fc9e009 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:20.028551 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f835f0e-3c27-492a-9f2b-7ce06fc9e009 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:20.029069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f835f0e-3c27-492a-9f2b-7ce06fc9e009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:20.060834 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-3f835f0e-3c27-492a-9f2b-7ce06fc9e009 None None] MFA Rules not processed for user `5de88c65f94844da93f68db2f4808dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:20.062233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-3f835f0e-3c27-492a-9f2b-7ce06fc9e009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:20.152436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:20.155452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1189/2382] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:20.168882 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134232b-0501-442c-80f7-a8c43c217c22 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:20.172357 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b134232b-0501-442c-80f7-a8c43c217c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:20.242398 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b134232b-0501-442c-80f7-a8c43c217c22 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:20.246330 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4b8be-a06a-40e1-ad3b-2d1e07653832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:20.247002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4b8be-a06a-40e1-ad3b-2d1e07653832 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:20.247293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4b8be-a06a-40e1-ad3b-2d1e07653832 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:20.247615 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4b8be-a06a-40e1-ad3b-2d1e07653832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:20.322179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4b8be-a06a-40e1-ad3b-2d1e07653832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:20.330786 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4b8be-a06a-40e1-ad3b-2d1e07653832 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:20.343748 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1194/2383] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:20.822647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c286c-d6d7-4c02-b232-d006ba30d342 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:20.823217 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c286c-d6d7-4c02-b232-d006ba30d342 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:20.823217 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c286c-d6d7-4c02-b232-d006ba30d342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:20.878721 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-a22c286c-d6d7-4c02-b232-d006ba30d342 None None] MFA Rules not processed for user `8e3ca26b66be4f5cab84485228ce4252`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:20.880326 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a22c286c-d6d7-4c02-b232-d006ba30d342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:20.990309 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1190/2384] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:20.991972 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4b8be-a06a-40e1-ad3b-2d1e07653832 service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:20.993613 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e0f4b8be-a06a-40e1-ad3b-2d1e07653832 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:21.084461 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4b8be-a06a-40e1-ad3b-2d1e07653832 service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:21.094371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2d36a-406a-4342-8684-ef4159e529b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:21.096451 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2d36a-406a-4342-8684-ef4159e529b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:21.096744 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2d36a-406a-4342-8684-ef4159e529b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:21.097026 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2d36a-406a-4342-8684-ef4159e529b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:21.097810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2d36a-406a-4342-8684-ef4159e529b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:21.099973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2d36a-406a-4342-8684-ef4159e529b0 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:21.219335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c286c-d6d7-4c02-b232-d006ba30d342 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:21.220148 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1195/2385] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:56:20 2022] POST /identity/v3/projects => generated 373 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:56:21.238166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c286c-d6d7-4c02-b232-d006ba30d342 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:21.319559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d998b-73f5-4f23-93df-d6aadeaa6b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:21.320303 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d998b-73f5-4f23-93df-d6aadeaa6b57 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:21.320718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d998b-73f5-4f23-93df-d6aadeaa6b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:21.321000 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d998b-73f5-4f23-93df-d6aadeaa6b57 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:21.321749 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d998b-73f5-4f23-93df-d6aadeaa6b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:21.323788 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246d998b-73f5-4f23-93df-d6aadeaa6b57 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:21.495940 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1191/2386] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:56:21 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:56:21.499841 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2d36a-406a-4342-8684-ef4159e529b0 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:21.510422 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2d36a-406a-4342-8684-ef4159e529b0 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:21.520448 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55b544-c0ee-4377-afee-e0bd8fabbc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:21.530070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55b544-c0ee-4377-afee-e0bd8fabbc8e admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:21.530070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55b544-c0ee-4377-afee-e0bd8fabbc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:21.530070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a55b544-c0ee-4377-afee-e0bd8fabbc8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:21.530070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55b544-c0ee-4377-afee-e0bd8fabbc8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:21.530070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a55b544-c0ee-4377-afee-e0bd8fabbc8e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:21.540156 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1196/2387] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:56:21.542160 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d998b-73f5-4f23-93df-d6aadeaa6b57 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:21.552534 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d998b-73f5-4f23-93df-d6aadeaa6b57 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:21.557231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af7e55-8503-4c64-88e7-915ff4585c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:21.558248 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af7e55-8503-4c64-88e7-915ff4585c42 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:21.558527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af7e55-8503-4c64-88e7-915ff4585c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:21.558802 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af7e55-8503-4c64-88e7-915ff4585c42 admin admin] PATH_INFO: `/v3/projects/d4b12f6282454202bb0f4871ead214ee/users/fd53de9596454762a1f62156f69a8d7b/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:21.574243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af7e55-8503-4c64-88e7-915ff4585c42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b12f6282454202bb0f4871ead214ee, user_id=fd53de9596454762a1f62156f69a8d7b, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:21.577001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af7e55-8503-4c64-88e7-915ff4585c42 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:21.639537 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1192/2388] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:56:21 2022] PUT /identity/v3/projects/d4b12f6282454202bb0f4871ead214ee/users/fd53de9596454762a1f62156f69a8d7b/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:21.644030 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55b544-c0ee-4377-afee-e0bd8fabbc8e admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:21.649409 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:21.655072 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a55b544-c0ee-4377-afee-e0bd8fabbc8e admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:21.717806 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a757599-8cf1-4ac9-8677-013c42d0cc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:21.718611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a757599-8cf1-4ac9-8677-013c42d0cc7a admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:21.718901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a757599-8cf1-4ac9-8677-013c42d0cc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:21.719180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a757599-8cf1-4ac9-8677-013c42d0cc7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:21.719954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a757599-8cf1-4ac9-8677-013c42d0cc7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:21.722149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a757599-8cf1-4ac9-8677-013c42d0cc7a admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:21.733845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1197/2389] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:56:21.737998 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af7e55-8503-4c64-88e7-915ff4585c42 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:21.749063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af7e55-8503-4c64-88e7-915ff4585c42 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:21.753826 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc9fbd-d0ed-450e-ad1c-a297eef8ffc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:21.754736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc9fbd-d0ed-450e-ad1c-a297eef8ffc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:21.755011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc9fbd-d0ed-450e-ad1c-a297eef8ffc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:21.755287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc9fbd-d0ed-450e-ad1c-a297eef8ffc6 admin admin] PATH_INFO: `/v3/projects/d4b12f6282454202bb0f4871ead214ee/users/fd53de9596454762a1f62156f69a8d7b/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:21.757267 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc9fbd-d0ed-450e-ad1c-a297eef8ffc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b12f6282454202bb0f4871ead214ee, user_id=fd53de9596454762a1f62156f69a8d7b, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:21.759926 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc9fbd-d0ed-450e-ad1c-a297eef8ffc6 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:21.771216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1193/2390] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:56:21 2022] PUT /identity/v3/projects/d4b12f6282454202bb0f4871ead214ee/users/fd53de9596454762a1f62156f69a8d7b/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:56:22.523161 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a757599-8cf1-4ac9-8677-013c42d0cc7a admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:22.529349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5a757599-8cf1-4ac9-8677-013c42d0cc7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:22.534187 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc9fbd-d0ed-450e-ad1c-a297eef8ffc6 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:22.536675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ffcc9fbd-d0ed-450e-ad1c-a297eef8ffc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:22.604244 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:22.608052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a757599-8cf1-4ac9-8677-013c42d0cc7a admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:22.617184 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc9fbd-d0ed-450e-ad1c-a297eef8ffc6 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:22.621181 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50cd8d-e239-47d3-8317-e6085db2331a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:22.621831 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50cd8d-e239-47d3-8317-e6085db2331a service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:22.622161 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50cd8d-e239-47d3-8317-e6085db2331a service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:22.622457 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50cd8d-e239-47d3-8317-e6085db2331a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:22.683220 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15501a27-bd9a-4edd-8986-9a9150cc0e62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:22.683880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15501a27-bd9a-4edd-8986-9a9150cc0e62 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:22.684174 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15501a27-bd9a-4edd-8986-9a9150cc0e62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:22.684738 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15501a27-bd9a-4edd-8986-9a9150cc0e62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:22.686927 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-15501a27-bd9a-4edd-8986-9a9150cc0e62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:22.689280 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50cd8d-e239-47d3-8317-e6085db2331a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:22.691008 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50cd8d-e239-47d3-8317-e6085db2331a service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:22.701348 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15501a27-bd9a-4edd-8986-9a9150cc0e62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:22.702801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1194/2391] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:56:22.708757 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15501a27-bd9a-4edd-8986-9a9150cc0e62 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:22.721470 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1198/2392] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:56:24.280784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50cd8d-e239-47d3-8317-e6085db2331a service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:24.292690 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50cd8d-e239-47d3-8317-e6085db2331a service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:24.298546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82574098-7ca6-4744-a1be-e5d92d072495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:24.300039 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82574098-7ca6-4744-a1be-e5d92d072495 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:24.300393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82574098-7ca6-4744-a1be-e5d92d072495 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:24.300736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82574098-7ca6-4744-a1be-e5d92d072495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:24.394908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82574098-7ca6-4744-a1be-e5d92d072495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:24.400185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82574098-7ca6-4744-a1be-e5d92d072495 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:24.411759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1195/2393] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:56:27.817057 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15501a27-bd9a-4edd-8986-9a9150cc0e62 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:27.820462 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-15501a27-bd9a-4edd-8986-9a9150cc0e62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:27.966202 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:27.980098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0cfa7-a26e-4777-aedc-8a46e384f12a None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:27.980626 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0cfa7-a26e-4777-aedc-8a46e384f12a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:27.981558 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0cfa7-a26e-4777-aedc-8a46e384f12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:28.020733 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15501a27-bd9a-4edd-8986-9a9150cc0e62 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:28.021287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-3ea0cfa7-a26e-4777-aedc-8a46e384f12a None None] MFA Rules not processed for user `fd53de9596454762a1f62156f69a8d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:28.026086 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-3ea0cfa7-a26e-4777-aedc-8a46e384f12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:28.027364 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fa5c6-2727-40e0-b936-2e9f7fd140d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:28.028399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fa5c6-2727-40e0-b936-2e9f7fd140d8 service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:28.028848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fa5c6-2727-40e0-b936-2e9f7fd140d8 service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:28.029288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fa5c6-2727-40e0-b936-2e9f7fd140d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:28.031322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e98fa5c6-2727-40e0-b936-2e9f7fd140d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:28.100813 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fa5c6-2727-40e0-b936-2e9f7fd140d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:28.102552 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fa5c6-2727-40e0-b936-2e9f7fd140d8 service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:28.109136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1196/2394] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:28.109645 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0cfa7-a26e-4777-aedc-8a46e384f12a None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:28.119366 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0cfa7-a26e-4777-aedc-8a46e384f12a None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:28.119933 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1199/2395] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:28.127939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d11af3-ea87-4793-8b6d-ba2a53f4dc88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:28.128592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11af3-ea87-4793-8b6d-ba2a53f4dc88 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:28.128881 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11af3-ea87-4793-8b6d-ba2a53f4dc88 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:28.129162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11af3-ea87-4793-8b6d-ba2a53f4dc88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:28.131042 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-72d11af3-ea87-4793-8b6d-ba2a53f4dc88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:28.141797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d11af3-ea87-4793-8b6d-ba2a53f4dc88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:28.143956 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d11af3-ea87-4793-8b6d-ba2a53f4dc88 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:28.152969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1197/2396] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:28.184403 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fa5c6-2727-40e0-b936-2e9f7fd140d8 service nova] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:28.225709 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fa5c6-2727-40e0-b936-2e9f7fd140d8 service nova] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:28.242422 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceff87-9416-47df-a437-ec8c932971d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:28.246825 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceff87-9416-47df-a437-ec8c932971d7 service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:28.246825 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceff87-9416-47df-a437-ec8c932971d7 service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:28.246825 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceff87-9416-47df-a437-ec8c932971d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:28.362324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceff87-9416-47df-a437-ec8c932971d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:28.364267 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceff87-9416-47df-a437-ec8c932971d7 service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:28.379731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1200/2397] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:28.543723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec1d73-a988-4978-ba99-d9cec817d613 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:28.543723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec1d73-a988-4978-ba99-d9cec817d613 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:28.543723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec1d73-a988-4978-ba99-d9cec817d613 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:28.544130 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1198/2398] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jun 27 18:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:56:28.551441 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6314216-4cb1-4f91-b995-a4d35925a38b None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:28.551780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6314216-4cb1-4f91-b995-a4d35925a38b None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:28.552666 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6314216-4cb1-4f91-b995-a4d35925a38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:28.603738 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-c6314216-4cb1-4f91-b995-a4d35925a38b None None] MFA Rules not processed for user `da1746d29f9e4e8b8626ad4b11931cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:28.605378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c6314216-4cb1-4f91-b995-a4d35925a38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:28.617100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1201/2399] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jun 27 18:56:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:28.628790 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec1d73-a988-4978-ba99-d9cec817d613 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:28.630558 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-c8ec1d73-a988-4978-ba99-d9cec817d613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:28.634528 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:28.743974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec1d73-a988-4978-ba99-d9cec817d613 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:28.756957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e76b4-0550-4bc7-afb1-14a80c880a7d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e59193e90e240f6b9876d0455eea355', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:28.759338 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e76b4-0550-4bc7-afb1-14a80c880a7d service glance] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:28.759703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e76b4-0550-4bc7-afb1-14a80c880a7d service glance] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:28.760573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e76b4-0550-4bc7-afb1-14a80c880a7d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:28.778594 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e76b4-0550-4bc7-afb1-14a80c880a7d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:28.780143 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360e76b4-0550-4bc7-afb1-14a80c880a7d service glance] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:28.791395 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1199/2400] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:29.069736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d8794-79ba-4cdb-bb15-57df7f0e5699 None None] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:29.070264 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d8794-79ba-4cdb-bb15-57df7f0e5699 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:29.070437 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2d8794-79ba-4cdb-bb15-57df7f0e5699 None None] PATH_INFO: `/` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:29.071967 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1202/2401] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jun 27 18:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:56:29.077275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414936c-1374-4991-bbf2-a84621f5d78e None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:29.077773 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414936c-1374-4991-bbf2-a84621f5d78e None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:29.078097 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414936c-1374-4991-bbf2-a84621f5d78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:29.098332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-0414936c-1374-4991-bbf2-a84621f5d78e None None] MFA Rules not processed for user `1e684ee875464138abc4e89060902100`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:29.099838 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-0414936c-1374-4991-bbf2-a84621f5d78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:29.107120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1200/2402] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jun 27 18:56:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:56:29.119015 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d8794-79ba-4cdb-bb15-57df7f0e5699 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:29.120970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-9c2d8794-79ba-4cdb-bb15-57df7f0e5699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:29.135013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2d8794-79ba-4cdb-bb15-57df7f0e5699 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:29.139053 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d2364-9c50-46f8-9e6b-7d0e5ba7b654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:29.145173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d2364-9c50-46f8-9e6b-7d0e5ba7b654 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:29.145173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d2364-9c50-46f8-9e6b-7d0e5ba7b654 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:29.145173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d2364-9c50-46f8-9e6b-7d0e5ba7b654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:29.149777 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d2364-9c50-46f8-9e6b-7d0e5ba7b654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:29.151317 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d2364-9c50-46f8-9e6b-7d0e5ba7b654 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:29.162018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1203/2403] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:29.269631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf001b-fdbd-472f-944a-3565cf74e855 None None] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:29.270213 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf001b-fdbd-472f-944a-3565cf74e855 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:29.270562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf001b-fdbd-472f-944a-3565cf74e855 None None] PATH_INFO: `/` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:29.272595 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1201/2404] 10.222.0.36 () {54 vars in 921 bytes} [Mon Jun 27 18:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 27 18:56:29.284145 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a70e2-343d-462b-9c04-3d2c81ccd898 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:29.290393 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a70e2-343d-462b-9c04-3d2c81ccd898 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:29.290393 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a70e2-343d-462b-9c04-3d2c81ccd898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:29.308576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-349a70e2-343d-462b-9c04-3d2c81ccd898 None None] MFA Rules not processed for user `da1746d29f9e4e8b8626ad4b11931cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:29.310167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-349a70e2-343d-462b-9c04-3d2c81ccd898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:29.323728 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1204/2405] 10.222.0.36 () {58 vars in 1018 bytes} [Mon Jun 27 18:56:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:29.337987 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf001b-fdbd-472f-944a-3565cf74e855 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:29.339106 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a70e2-343d-462b-9c04-3d2c81ccd898 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:29.356308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a70e2-343d-462b-9c04-3d2c81ccd898 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:29.361371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5c83f-44a8-4db4-8882-0f028acccc80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:29.362163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5c83f-44a8-4db4-8882-0f028acccc80 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:29.362753 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5c83f-44a8-4db4-8882-0f028acccc80 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:29.363028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5c83f-44a8-4db4-8882-0f028acccc80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:29.382532 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5c83f-44a8-4db4-8882-0f028acccc80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:29.384368 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5c83f-44a8-4db4-8882-0f028acccc80 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:29.416746 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1205/2406] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:56:29.436692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf001b-fdbd-472f-944a-3565cf74e855 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:29.445759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a5010-f360-4ee1-ba81-e349b8e63dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:29.446656 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a5010-f360-4ee1-ba81-e349b8e63dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:29.446940 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a5010-f360-4ee1-ba81-e349b8e63dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:29.447214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a5010-f360-4ee1-ba81-e349b8e63dc3 admin admin] PATH_INFO: `/v3/users/772e172aebcc4466b8347338c9ca11a5` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:29.448465 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a5010-f360-4ee1-ba81-e349b8e63dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=772e172aebcc4466b8347338c9ca11a5)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:29.450583 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a5010-f360-4ee1-ba81-e349b8e63dc3 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:29.495084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5c83f-44a8-4db4-8882-0f028acccc80 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:29.496672 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-9ac5c83f-44a8-4db4-8882-0f028acccc80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:29.547082 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:29.573820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5c83f-44a8-4db4-8882-0f028acccc80 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:29.580358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c6aeac-6522-4121-aecd-61a412e67bd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af6ef16884604753972c916f74271f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:29.581008 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6aeac-6522-4121-aecd-61a412e67bd0 service placement] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:29.581296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6aeac-6522-4121-aecd-61a412e67bd0 service placement] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:29.581579 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c6aeac-6522-4121-aecd-61a412e67bd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:29.583410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-43c6aeac-6522-4121-aecd-61a412e67bd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:29.598039 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6aeac-6522-4121-aecd-61a412e67bd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:29.600291 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c6aeac-6522-4121-aecd-61a412e67bd0 service placement] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:29.612785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1206/2407] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:29.667599 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-dd0a5010-f360-4ee1-ba81-e349b8e63dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '772e172aebcc4466b8347338c9ca11a5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:29.786992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-dd0a5010-f360-4ee1-ba81-e349b8e63dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '772e172aebcc4466b8347338c9ca11a5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:29.803679 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-dd0a5010-f360-4ee1-ba81-e349b8e63dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '772e172aebcc4466b8347338c9ca11a5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:29.810627 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-dd0a5010-f360-4ee1-ba81-e349b8e63dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '772e172aebcc4466b8347338c9ca11a5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:29.811346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-dd0a5010-f360-4ee1-ba81-e349b8e63dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '772e172aebcc4466b8347338c9ca11a5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:29.812875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:29.821482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1202/2408] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:56:29 2022] DELETE /identity/v3/users/772e172aebcc4466b8347338c9ca11a5 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:29.823761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28423c57-ff8d-4251-86a3-c01ca4f6b269 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:29.824061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28423c57-ff8d-4251-86a3-c01ca4f6b269 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:29.824344 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28423c57-ff8d-4251-86a3-c01ca4f6b269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:29.842743 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-28423c57-ff8d-4251-86a3-c01ca4f6b269 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:29.844173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-28423c57-ff8d-4251-86a3-c01ca4f6b269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:29.910916 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1207/2409] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:29.920577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a5010-f360-4ee1-ba81-e349b8e63dc3 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:29.922037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-dd0a5010-f360-4ee1-ba81-e349b8e63dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:29.995339 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a5010-f360-4ee1-ba81-e349b8e63dc3 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:29.998982 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f932b53-830f-4a1f-b6f6-1e3111b41976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:29.999751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f932b53-830f-4a1f-b6f6-1e3111b41976 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:30.000129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f932b53-830f-4a1f-b6f6-1e3111b41976 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:30.000751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f932b53-830f-4a1f-b6f6-1e3111b41976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:30.011719 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f932b53-830f-4a1f-b6f6-1e3111b41976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:30.013594 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f932b53-830f-4a1f-b6f6-1e3111b41976 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:30.024694 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1203/2410] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:30.739673 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28423c57-ff8d-4251-86a3-c01ca4f6b269 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:30.739673 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-28423c57-ff8d-4251-86a3-c01ca4f6b269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:30.753530 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28423c57-ff8d-4251-86a3-c01ca4f6b269 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:30.759325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645df88-7bb8-476b-bee9-e90cd96005fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:30.760365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645df88-7bb8-476b-bee9-e90cd96005fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:30.760652 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645df88-7bb8-476b-bee9-e90cd96005fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:30.760928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645df88-7bb8-476b-bee9-e90cd96005fe admin admin] PATH_INFO: `/v3/projects/9508670f10324785b405fd464603be05` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:30.762153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645df88-7bb8-476b-bee9-e90cd96005fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9508670f10324785b405fd464603be05)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:30.764204 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645df88-7bb8-476b-bee9-e90cd96005fe admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:30.885355 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-c645df88-7bb8-476b-bee9-e90cd96005fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9508670f10324785b405fd464603be05', 'request_id': 'req-c645df88-7bb8-476b-bee9-e90cd96005fe'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:30.958704 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-c645df88-7bb8-476b-bee9-e90cd96005fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9508670f10324785b405fd464603be05', 'request_id': 'req-c645df88-7bb8-476b-bee9-e90cd96005fe'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:30.965141 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-c645df88-7bb8-476b-bee9-e90cd96005fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9508670f10324785b405fd464603be05', 'request_id': 'req-c645df88-7bb8-476b-bee9-e90cd96005fe'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:30.977268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-c645df88-7bb8-476b-bee9-e90cd96005fe admin admin] The token cache is being invalidate because project 9508670f10324785b405fd464603be05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:56:30.977555 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-c645df88-7bb8-476b-bee9-e90cd96005fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:30.978455 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-c645df88-7bb8-476b-bee9-e90cd96005fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:30.980038 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1208/2411] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:56:30 2022] DELETE /identity/v3/projects/9508670f10324785b405fd464603be05 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:56:30.984232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f932b53-830f-4a1f-b6f6-1e3111b41976 service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:31.007285 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f932b53-830f-4a1f-b6f6-1e3111b41976 service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:31.073876 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c8e37-73bb-43d3-a982-908194496ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:31.074751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c8e37-73bb-43d3-a982-908194496ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:31.075033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c8e37-73bb-43d3-a982-908194496ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:31.075313 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c8e37-73bb-43d3-a982-908194496ee7 admin admin] PATH_INFO: `/v3/users/60061ee248094c6883696c3becdb650c` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:31.076538 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c8e37-73bb-43d3-a982-908194496ee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60061ee248094c6883696c3becdb650c)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:31.078533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4c8e37-73bb-43d3-a982-908194496ee7 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:31.282002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9c4c8e37-73bb-43d3-a982-908194496ee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60061ee248094c6883696c3becdb650c'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:31.370628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9c4c8e37-73bb-43d3-a982-908194496ee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60061ee248094c6883696c3becdb650c'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:31.387004 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9c4c8e37-73bb-43d3-a982-908194496ee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60061ee248094c6883696c3becdb650c'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:31.399666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9c4c8e37-73bb-43d3-a982-908194496ee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60061ee248094c6883696c3becdb650c'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:31.400645 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-9c4c8e37-73bb-43d3-a982-908194496ee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60061ee248094c6883696c3becdb650c'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:31.411322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1204/2412] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:56:30 2022] DELETE /identity/v3/users/60061ee248094c6883696c3becdb650c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:31.636993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ee0ee-ce69-4d7a-8bbd-eb8359de1677 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:31.637294 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ee0ee-ce69-4d7a-8bbd-eb8359de1677 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:31.639598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558ee0ee-ce69-4d7a-8bbd-eb8359de1677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:31.659266 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-558ee0ee-ce69-4d7a-8bbd-eb8359de1677 None None] MFA Rules not processed for user `8e3ca26b66be4f5cab84485228ce4252`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:31.660590 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-558ee0ee-ce69-4d7a-8bbd-eb8359de1677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:31.726169 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:31.736931 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1209/2413] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:31.974346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c8e37-73bb-43d3-a982-908194496ee7 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:31.975986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9c4c8e37-73bb-43d3-a982-908194496ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:32.015886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:32.096910 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c8e37-73bb-43d3-a982-908194496ee7 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:32.103492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0acef-fbba-40ef-8912-e5b5081d121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:32.104835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0acef-fbba-40ef-8912-e5b5081d121f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:32.105518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0acef-fbba-40ef-8912-e5b5081d121f admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:32.106041 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0acef-fbba-40ef-8912-e5b5081d121f admin admin] PATH_INFO: `/v3/projects/39a45e06520440bebc0fc0b4ee503c41` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:32.107869 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0acef-fbba-40ef-8912-e5b5081d121f admin admin] RBAC: Authorizing `identity:delete_project(project_id=39a45e06520440bebc0fc0b4ee503c41)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:32.110151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0acef-fbba-40ef-8912-e5b5081d121f admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:32.252475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-34d0acef-fbba-40ef-8912-e5b5081d121f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39a45e06520440bebc0fc0b4ee503c41', 'request_id': 'req-34d0acef-fbba-40ef-8912-e5b5081d121f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:32.260062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-34d0acef-fbba-40ef-8912-e5b5081d121f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39a45e06520440bebc0fc0b4ee503c41', 'request_id': 'req-34d0acef-fbba-40ef-8912-e5b5081d121f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:32.348396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-34d0acef-fbba-40ef-8912-e5b5081d121f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39a45e06520440bebc0fc0b4ee503c41', 'request_id': 'req-34d0acef-fbba-40ef-8912-e5b5081d121f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:32.361842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-34d0acef-fbba-40ef-8912-e5b5081d121f admin admin] The token cache is being invalidate because project 39a45e06520440bebc0fc0b4ee503c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:56:32.362155 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-34d0acef-fbba-40ef-8912-e5b5081d121f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:32.362797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-34d0acef-fbba-40ef-8912-e5b5081d121f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:32.367627 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1205/2414] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:56:31 2022] DELETE /identity/v3/projects/39a45e06520440bebc0fc0b4ee503c41 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:32.368668 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ee0ee-ce69-4d7a-8bbd-eb8359de1677 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:32.383582 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558ee0ee-ce69-4d7a-8bbd-eb8359de1677 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:32.479281 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bc9e7-db9a-4553-82a4-518478b2d523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:32.480326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bc9e7-db9a-4553-82a4-518478b2d523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:32.480678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bc9e7-db9a-4553-82a4-518478b2d523 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:32.481072 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bc9e7-db9a-4553-82a4-518478b2d523 admin admin] PATH_INFO: `/v3/users/5de88c65f94844da93f68db2f4808dbb` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:32.482756 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bc9e7-db9a-4553-82a4-518478b2d523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de88c65f94844da93f68db2f4808dbb)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:32.484783 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bc9e7-db9a-4553-82a4-518478b2d523 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:32.767353 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-562bc9e7-db9a-4553-82a4-518478b2d523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de88c65f94844da93f68db2f4808dbb'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:32.823073 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fffa1-a8d7-4489-8268-6639618e3398 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:32.823073 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fffa1-a8d7-4489-8268-6639618e3398 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:32.823073 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873fffa1-a8d7-4489-8268-6639618e3398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:32.835456 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-562bc9e7-db9a-4553-82a4-518478b2d523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de88c65f94844da93f68db2f4808dbb'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:32.846085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-873fffa1-a8d7-4489-8268-6639618e3398 None None] MFA Rules not processed for user `6e6313c444eb4a788b6559eff17959f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:32.847468 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-873fffa1-a8d7-4489-8268-6639618e3398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:32.851686 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-562bc9e7-db9a-4553-82a4-518478b2d523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de88c65f94844da93f68db2f4808dbb'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:32.852836 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-562bc9e7-db9a-4553-82a4-518478b2d523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de88c65f94844da93f68db2f4808dbb'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:32.871066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-562bc9e7-db9a-4553-82a4-518478b2d523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de88c65f94844da93f68db2f4808dbb'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:32.882222 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1210/2415] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:56:32 2022] DELETE /identity/v3/users/5de88c65f94844da93f68db2f4808dbb => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:32.929627 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1206/2416] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jun 27 18:56:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:32.952970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bc9e7-db9a-4553-82a4-518478b2d523 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:32.954821 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-562bc9e7-db9a-4553-82a4-518478b2d523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:33.079211 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bc9e7-db9a-4553-82a4-518478b2d523 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:33.086982 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfac4d-c2ad-4331-b8c8-e0c5233b27a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94555ff897d94c90968c470d82ff9e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:33.087757 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfac4d-c2ad-4331-b8c8-e0c5233b27a4 service swift] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:33.088039 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfac4d-c2ad-4331-b8c8-e0c5233b27a4 service swift] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:33.088319 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfac4d-c2ad-4331-b8c8-e0c5233b27a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:33.115322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:33.190129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfac4d-c2ad-4331-b8c8-e0c5233b27a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:33.190129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfac4d-c2ad-4331-b8c8-e0c5233b27a4 service swift] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:33.238681 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1211/2417] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jun 27 18:56:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 18:56:33.608082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fffa1-a8d7-4489-8268-6639618e3398 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:33.610502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-873fffa1-a8d7-4489-8268-6639618e3398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:33.648885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873fffa1-a8d7-4489-8268-6639618e3398 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:33.772507 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:33.781039 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7dadc2-f522-493d-aa35-22233e2775da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:33.782356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dadc2-f522-493d-aa35-22233e2775da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:33.783419 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dadc2-f522-493d-aa35-22233e2775da admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:33.784016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7dadc2-f522-493d-aa35-22233e2775da admin admin] PATH_INFO: `/v3/projects/b291e38003f747edabdce92574020e85` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:33.789734 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dadc2-f522-493d-aa35-22233e2775da admin admin] RBAC: Authorizing `identity:delete_project(project_id=b291e38003f747edabdce92574020e85)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:33.791776 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7dadc2-f522-493d-aa35-22233e2775da admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:33.920368 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ea7dadc2-f522-493d-aa35-22233e2775da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b291e38003f747edabdce92574020e85', 'request_id': 'req-ea7dadc2-f522-493d-aa35-22233e2775da'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:33.942243 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ea7dadc2-f522-493d-aa35-22233e2775da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b291e38003f747edabdce92574020e85', 'request_id': 'req-ea7dadc2-f522-493d-aa35-22233e2775da'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:34.053387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ea7dadc2-f522-493d-aa35-22233e2775da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b291e38003f747edabdce92574020e85', 'request_id': 'req-ea7dadc2-f522-493d-aa35-22233e2775da'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:34.088383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ea7dadc2-f522-493d-aa35-22233e2775da admin admin] The token cache is being invalidate because project b291e38003f747edabdce92574020e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:56:34.089976 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ea7dadc2-f522-493d-aa35-22233e2775da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:34.090884 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ea7dadc2-f522-493d-aa35-22233e2775da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:34.092777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1207/2418] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:56:33 2022] DELETE /identity/v3/projects/b291e38003f747edabdce92574020e85 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:34.102500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828b213-9bb5-4b6c-a3bb-1ec0f69d9394 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:34.104094 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828b213-9bb5-4b6c-a3bb-1ec0f69d9394 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:34.104914 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828b213-9bb5-4b6c-a3bb-1ec0f69d9394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:34.147744 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-f828b213-9bb5-4b6c-a3bb-1ec0f69d9394 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:34.149513 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-f828b213-9bb5-4b6c-a3bb-1ec0f69d9394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:34.254769 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1212/2419] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:34.256981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ce8e7-0a4d-45dc-a116-2c29b370a400 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:34.257377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ce8e7-0a4d-45dc-a116-2c29b370a400 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:34.257539 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ce8e7-0a4d-45dc-a116-2c29b370a400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:34.305934 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-cf4ce8e7-0a4d-45dc-a116-2c29b370a400 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:34.308086 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-cf4ce8e7-0a4d-45dc-a116-2c29b370a400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:34.321751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1208/2420] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:56:34.322973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828b213-9bb5-4b6c-a3bb-1ec0f69d9394 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:34.338092 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828b213-9bb5-4b6c-a3bb-1ec0f69d9394 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:34.345494 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4c57d-3cfc-4900-a827-ddf710b58a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:34.346382 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4c57d-3cfc-4900-a827-ddf710b58a66 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:34.347336 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4c57d-3cfc-4900-a827-ddf710b58a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:34.355963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4c57d-3cfc-4900-a827-ddf710b58a66 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:34.357277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4c57d-3cfc-4900-a827-ddf710b58a66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:56:34.357741 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4c57d-3cfc-4900-a827-ddf710b58a66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:34.359596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac4c57d-3cfc-4900-a827-ddf710b58a66 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:34.374174 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1213/2421] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:56:34.380600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ce8e7-0a4d-45dc-a116-2c29b370a400 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:34.396784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ce8e7-0a4d-45dc-a116-2c29b370a400 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:34.402409 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49b813-ebc5-431e-8b4d-584fa2d4028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:34.403077 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49b813-ebc5-431e-8b4d-584fa2d4028d admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:34.403364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49b813-ebc5-431e-8b4d-584fa2d4028d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:34.403676 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e49b813-ebc5-431e-8b4d-584fa2d4028d admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:34.404977 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49b813-ebc5-431e-8b4d-584fa2d4028d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:34.408231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e49b813-ebc5-431e-8b4d-584fa2d4028d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:34.494782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1209/2422] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:56:34 2022] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:56:34.496634 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4c57d-3cfc-4900-a827-ddf710b58a66 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:34.513152 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac4c57d-3cfc-4900-a827-ddf710b58a66 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:34.599741 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a5b25-c7e0-46a4-9e77-2de728a3c569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:34.600645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5b25-c7e0-46a4-9e77-2de728a3c569 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:34.600932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5b25-c7e0-46a4-9e77-2de728a3c569 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:34.601289 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a5b25-c7e0-46a4-9e77-2de728a3c569 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:34.602066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a5b25-c7e0-46a4-9e77-2de728a3c569 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:34.604374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a5b25-c7e0-46a4-9e77-2de728a3c569 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:34.693995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1214/2423] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:56:34 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:56:34.695886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49b813-ebc5-431e-8b4d-584fa2d4028d admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:34.711871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e49b813-ebc5-431e-8b4d-584fa2d4028d admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:34.717424 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c5df3-3a60-4f19-91d2-aeb3bdea046d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:34.718232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c5df3-3a60-4f19-91d2-aeb3bdea046d admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:34.718532 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c5df3-3a60-4f19-91d2-aeb3bdea046d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:34.718802 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c5df3-3a60-4f19-91d2-aeb3bdea046d admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:34.719568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c5df3-3a60-4f19-91d2-aeb3bdea046d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:34.721758 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c5df3-3a60-4f19-91d2-aeb3bdea046d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:34.739793 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1210/2424] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:56:34.744006 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a5b25-c7e0-46a4-9e77-2de728a3c569 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:34.765979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a5b25-c7e0-46a4-9e77-2de728a3c569 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:34.779469 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e155926-d5bf-452c-99bd-b18ce542e941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:34.780193 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e155926-d5bf-452c-99bd-b18ce542e941 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:34.780504 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e155926-d5bf-452c-99bd-b18ce542e941 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:34.780901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e155926-d5bf-452c-99bd-b18ce542e941 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:34.781713 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e155926-d5bf-452c-99bd-b18ce542e941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:34.784202 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e155926-d5bf-452c-99bd-b18ce542e941 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:34.812218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1215/2425] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:56:34.816700 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c5df3-3a60-4f19-91d2-aeb3bdea046d admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:34.830075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c5df3-3a60-4f19-91d2-aeb3bdea046d admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:34.849322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fd93d-c7a9-4f3e-b920-0d4ac9048bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:34.850426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fd93d-c7a9-4f3e-b920-0d4ac9048bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:34.850736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fd93d-c7a9-4f3e-b920-0d4ac9048bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:34.851083 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fd93d-c7a9-4f3e-b920-0d4ac9048bcf admin admin] PATH_INFO: `/v3/projects/367475e638cc43608f45d092ade8f8c2/users/fa69e958bc59480f8288afe203c8e573/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:34.870628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fd93d-c7a9-4f3e-b920-0d4ac9048bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=367475e638cc43608f45d092ade8f8c2, user_id=fa69e958bc59480f8288afe203c8e573, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:34.873985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fd93d-c7a9-4f3e-b920-0d4ac9048bcf admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:34.958875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1211/2426] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:56:34 2022] PUT /identity/v3/projects/367475e638cc43608f45d092ade8f8c2/users/fa69e958bc59480f8288afe203c8e573/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:34.970663 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb839f9-6dff-4f58-8acb-865d7abaf1fc None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:34.970851 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb839f9-6dff-4f58-8acb-865d7abaf1fc None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:34.971055 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb839f9-6dff-4f58-8acb-865d7abaf1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:35.031368 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-dfb839f9-6dff-4f58-8acb-865d7abaf1fc None None] MFA Rules not processed for user `fa69e958bc59480f8288afe203c8e573`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:35.033565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-dfb839f9-6dff-4f58-8acb-865d7abaf1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:35.097464 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:35.244449 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1216/2427] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:35.271337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fd93d-c7a9-4f3e-b920-0d4ac9048bcf admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:35.271337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e26fd93d-c7a9-4f3e-b920-0d4ac9048bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:35.452963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fd93d-c7a9-4f3e-b920-0d4ac9048bcf admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:35.457992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0be93-28cd-4391-b38c-f1146a1a9e1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:35.459090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0be93-28cd-4391-b38c-f1146a1a9e1f service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:35.459764 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0be93-28cd-4391-b38c-f1146a1a9e1f service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:35.460592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b0be93-28cd-4391-b38c-f1146a1a9e1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:35.495303 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0be93-28cd-4391-b38c-f1146a1a9e1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:35.496914 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b0be93-28cd-4391-b38c-f1146a1a9e1f service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:35.533193 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1212/2428] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:35 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:45.233198 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=21 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:45.527996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:47.128349 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb839f9-6dff-4f58-8acb-865d7abaf1fc None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:47.129935 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-dfb839f9-6dff-4f58-8acb-865d7abaf1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:47.232844 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb839f9-6dff-4f58-8acb-865d7abaf1fc None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:47.241954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae7ca3-da64-4820-9eed-506e200fad1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:47.243055 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae7ca3-da64-4820-9eed-506e200fad1a service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:47.243444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae7ca3-da64-4820-9eed-506e200fad1a service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:47.243667 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae7ca3-da64-4820-9eed-506e200fad1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:47.245741 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e6ae7ca3-da64-4820-9eed-506e200fad1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:47.262779 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae7ca3-da64-4820-9eed-506e200fad1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:47.264817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae7ca3-da64-4820-9eed-506e200fad1a service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:47.288542 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1217/2429] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:48.965293 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0be93-28cd-4391-b38c-f1146a1a9e1f service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:49.042113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b0be93-28cd-4391-b38c-f1146a1a9e1f service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:49.048412 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba9593-7b3b-480b-8434-44d4d5a9e93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:49.049381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba9593-7b3b-480b-8434-44d4d5a9e93b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:49.049665 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba9593-7b3b-480b-8434-44d4d5a9e93b admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:49.049940 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba9593-7b3b-480b-8434-44d4d5a9e93b admin admin] PATH_INFO: `/v3/users/fa69e958bc59480f8288afe203c8e573` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:49.051184 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba9593-7b3b-480b-8434-44d4d5a9e93b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa69e958bc59480f8288afe203c8e573)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:49.053140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba9593-7b3b-480b-8434-44d4d5a9e93b admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:49.265500 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e2ba9593-7b3b-480b-8434-44d4d5a9e93b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa69e958bc59480f8288afe203c8e573'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:49.341646 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e2ba9593-7b3b-480b-8434-44d4d5a9e93b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa69e958bc59480f8288afe203c8e573'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:49.356973 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e2ba9593-7b3b-480b-8434-44d4d5a9e93b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa69e958bc59480f8288afe203c8e573'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:49.364128 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e2ba9593-7b3b-480b-8434-44d4d5a9e93b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa69e958bc59480f8288afe203c8e573'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:49.364933 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e2ba9593-7b3b-480b-8434-44d4d5a9e93b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa69e958bc59480f8288afe203c8e573'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:49.371171 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1213/2430] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:56:48 2022] DELETE /identity/v3/users/fa69e958bc59480f8288afe203c8e573 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:49.376308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e231a4-bf68-4180-887f-02c1aaa8d498 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:49.379334 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e231a4-bf68-4180-887f-02c1aaa8d498 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:49.379334 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e231a4-bf68-4180-887f-02c1aaa8d498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:49.396537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-45e231a4-bf68-4180-887f-02c1aaa8d498 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:49.397862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-45e231a4-bf68-4180-887f-02c1aaa8d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:49.426527 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a59f0-b25b-4bf9-b33e-965f1b013fe7 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:49.426821 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a59f0-b25b-4bf9-b33e-965f1b013fe7 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:49.427106 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a59f0-b25b-4bf9-b33e-965f1b013fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:49.451148 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-056a59f0-b25b-4bf9-b33e-965f1b013fe7 None None] MFA Rules not processed for user `6e6313c444eb4a788b6559eff17959f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:49.452665 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-056a59f0-b25b-4bf9-b33e-965f1b013fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:49.472919 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1218/2431] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:49.484129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e231a4-bf68-4180-887f-02c1aaa8d498 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:49.485624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-45e231a4-bf68-4180-887f-02c1aaa8d498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:49.520842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1214/2432] 10.222.0.36 () {58 vars in 967 bytes} [Mon Jun 27 18:56:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:56:49.537267 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a59f0-b25b-4bf9-b33e-965f1b013fe7 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:49.537544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-056a59f0-b25b-4bf9-b33e-965f1b013fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:49.549234 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e231a4-bf68-4180-887f-02c1aaa8d498 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:49.552957 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0893fd-b95b-408b-8648-7390a8137408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:49.553604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0893fd-b95b-408b-8648-7390a8137408 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:49.553890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0893fd-b95b-408b-8648-7390a8137408 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:49.554172 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0893fd-b95b-408b-8648-7390a8137408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:49.563817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0893fd-b95b-408b-8648-7390a8137408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:49.568383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:49.568521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0893fd-b95b-408b-8648-7390a8137408 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:49.575047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1219/2433] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:56:49.606811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a59f0-b25b-4bf9-b33e-965f1b013fe7 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:49.612814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e103dd-62dd-437b-b072-0785d46a8a84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94555ff897d94c90968c470d82ff9e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:49.614387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e103dd-62dd-437b-b072-0785d46a8a84 service swift] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:49.614387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e103dd-62dd-437b-b072-0785d46a8a84 service swift] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:49.614387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e103dd-62dd-437b-b072-0785d46a8a84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:49.622966 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e103dd-62dd-437b-b072-0785d46a8a84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:49.624612 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e103dd-62dd-437b-b072-0785d46a8a84 service swift] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:49.634964 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1215/2434] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jun 27 18:56:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 18:56:50.185759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0893fd-b95b-408b-8648-7390a8137408 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:50.192247 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-db0893fd-b95b-408b-8648-7390a8137408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:50.208945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0893fd-b95b-408b-8648-7390a8137408 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:50.217780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43124f-ed6a-48f3-9aea-fea333c3b77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:50.218490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43124f-ed6a-48f3-9aea-fea333c3b77c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:50.218875 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43124f-ed6a-48f3-9aea-fea333c3b77c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:50.219320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43124f-ed6a-48f3-9aea-fea333c3b77c admin admin] PATH_INFO: `/v3/projects/367475e638cc43608f45d092ade8f8c2` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:50.221753 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43124f-ed6a-48f3-9aea-fea333c3b77c admin admin] RBAC: Authorizing `identity:delete_project(project_id=367475e638cc43608f45d092ade8f8c2)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:50.224016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43124f-ed6a-48f3-9aea-fea333c3b77c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:50.265423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:50.388862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-1f43124f-ed6a-48f3-9aea-fea333c3b77c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '367475e638cc43608f45d092ade8f8c2', 'request_id': 'req-1f43124f-ed6a-48f3-9aea-fea333c3b77c'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:50.530692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-1f43124f-ed6a-48f3-9aea-fea333c3b77c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '367475e638cc43608f45d092ade8f8c2', 'request_id': 'req-1f43124f-ed6a-48f3-9aea-fea333c3b77c'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:50.542580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-1f43124f-ed6a-48f3-9aea-fea333c3b77c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '367475e638cc43608f45d092ade8f8c2', 'request_id': 'req-1f43124f-ed6a-48f3-9aea-fea333c3b77c'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:50.553935 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-1f43124f-ed6a-48f3-9aea-fea333c3b77c admin admin] The token cache is being invalidate because project 367475e638cc43608f45d092ade8f8c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:56:50.554226 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-1f43124f-ed6a-48f3-9aea-fea333c3b77c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:50.554872 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-1f43124f-ed6a-48f3-9aea-fea333c3b77c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:56:50.556446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1220/2435] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:56:50 2022] DELETE /identity/v3/projects/367475e638cc43608f45d092ade8f8c2 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:50.561530 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9685c-ea2f-4f3f-ae42-71b7ded50e29 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:50.562012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9685c-ea2f-4f3f-ae42-71b7ded50e29 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:50.562111 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9685c-ea2f-4f3f-ae42-71b7ded50e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:50.579820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-7ce9685c-ea2f-4f3f-ae42-71b7ded50e29 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:50.580962 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-7ce9685c-ea2f-4f3f-ae42-71b7ded50e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:50.697449 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1216/2436] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:50.705957 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecb83e-aca3-41f1-b753-d87817af635b None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:50.706248 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecb83e-aca3-41f1-b753-d87817af635b None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:50.706532 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecb83e-aca3-41f1-b753-d87817af635b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:50.727212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-beecb83e-aca3-41f1-b753-d87817af635b None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:50.728745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-beecb83e-aca3-41f1-b753-d87817af635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:50.738115 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1221/2437] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:50.742289 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9685c-ea2f-4f3f-ae42-71b7ded50e29 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:50.784866 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9685c-ea2f-4f3f-ae42-71b7ded50e29 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:50.789631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0717ca3-97a4-43cb-a9fc-935451e492f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:50.790293 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0717ca3-97a4-43cb-a9fc-935451e492f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:50.790590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0717ca3-97a4-43cb-a9fc-935451e492f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:50.790851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0717ca3-97a4-43cb-a9fc-935451e492f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:50.791605 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0717ca3-97a4-43cb-a9fc-935451e492f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:56:50.791916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0717ca3-97a4-43cb-a9fc-935451e492f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:50.793512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0717ca3-97a4-43cb-a9fc-935451e492f8 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:50.805441 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1217/2438] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:56:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:56:50.809874 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecb83e-aca3-41f1-b753-d87817af635b None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:50.819724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecb83e-aca3-41f1-b753-d87817af635b None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:50.824329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796fc07-75dc-4944-8424-3839f518dd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:50.824984 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796fc07-75dc-4944-8424-3839f518dd92 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:50.825268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796fc07-75dc-4944-8424-3839f518dd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:50.825544 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796fc07-75dc-4944-8424-3839f518dd92 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:50.826294 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796fc07-75dc-4944-8424-3839f518dd92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:50.828235 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796fc07-75dc-4944-8424-3839f518dd92 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:50.914646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1222/2439] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:56:50 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:56:50.918363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0717ca3-97a4-43cb-a9fc-935451e492f8 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:50.930504 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0717ca3-97a4-43cb-a9fc-935451e492f8 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:50.999385 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86311ca8-ccda-43cf-850f-e4b450bafcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:51.000281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86311ca8-ccda-43cf-850f-e4b450bafcb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:51.002180 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86311ca8-ccda-43cf-850f-e4b450bafcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:51.002180 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86311ca8-ccda-43cf-850f-e4b450bafcb2 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:51.002180 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86311ca8-ccda-43cf-850f-e4b450bafcb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:51.004653 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86311ca8-ccda-43cf-850f-e4b450bafcb2 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:51.109983 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1218/2440] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:56:50 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:56:51.118322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796fc07-75dc-4944-8424-3839f518dd92 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:51.132056 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796fc07-75dc-4944-8424-3839f518dd92 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:51.138599 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4fb3c-4e7b-4a6c-aa8e-85703ddef9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:51.141633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4fb3c-4e7b-4a6c-aa8e-85703ddef9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:51.141633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4fb3c-4e7b-4a6c-aa8e-85703ddef9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:51.141633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4fb3c-4e7b-4a6c-aa8e-85703ddef9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:51.141633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4fb3c-4e7b-4a6c-aa8e-85703ddef9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:51.142200 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4fb3c-4e7b-4a6c-aa8e-85703ddef9f9 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:51.153288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1223/2441] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:56:51.157432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86311ca8-ccda-43cf-850f-e4b450bafcb2 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:51.170465 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86311ca8-ccda-43cf-850f-e4b450bafcb2 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:51.177079 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf492f6-35f0-41ba-8931-f877be388ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:51.177772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf492f6-35f0-41ba-8931-f877be388ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:51.178059 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf492f6-35f0-41ba-8931-f877be388ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:51.178340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf492f6-35f0-41ba-8931-f877be388ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:51.179076 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf492f6-35f0-41ba-8931-f877be388ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:51.180916 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf492f6-35f0-41ba-8931-f877be388ea0 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:51.192063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1219/2442] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:56:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:56:51.196338 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4fb3c-4e7b-4a6c-aa8e-85703ddef9f9 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:51.206979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4fb3c-4e7b-4a6c-aa8e-85703ddef9f9 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:51.211658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228fb3b-a367-475e-b0b0-a22c6aa4d803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:51.212594 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228fb3b-a367-475e-b0b0-a22c6aa4d803 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:51.212884 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228fb3b-a367-475e-b0b0-a22c6aa4d803 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:51.213163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228fb3b-a367-475e-b0b0-a22c6aa4d803 admin admin] PATH_INFO: `/v3/projects/e28f236933c34203a389956b259bee23/users/77773d40a7a940819a99d11055439333/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:51.234821 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228fb3b-a367-475e-b0b0-a22c6aa4d803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28f236933c34203a389956b259bee23, user_id=77773d40a7a940819a99d11055439333, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:51.237915 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228fb3b-a367-475e-b0b0-a22c6aa4d803 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:51.331976 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1224/2443] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:56:51 2022] PUT /identity/v3/projects/e28f236933c34203a389956b259bee23/users/77773d40a7a940819a99d11055439333/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:56:51.337317 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02ef06-7325-4edc-858e-e6a33965c709 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:51.337603 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02ef06-7325-4edc-858e-e6a33965c709 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:51.337881 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02ef06-7325-4edc-858e-e6a33965c709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:51.361912 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-8a02ef06-7325-4edc-858e-e6a33965c709 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:51.363126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-8a02ef06-7325-4edc-858e-e6a33965c709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:51.376346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:51.439701 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1220/2444] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:51.447785 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228fb3b-a367-475e-b0b0-a22c6aa4d803 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:51.449659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e228fb3b-a367-475e-b0b0-a22c6aa4d803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:51.517016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228fb3b-a367-475e-b0b0-a22c6aa4d803 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:51.520831 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652c327-fd47-469a-8226-64faa1ec7805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:51.521476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c327-fd47-469a-8226-64faa1ec7805 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:51.521760 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c327-fd47-469a-8226-64faa1ec7805 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:51.522037 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c327-fd47-469a-8226-64faa1ec7805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:51.532592 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652c327-fd47-469a-8226-64faa1ec7805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:51.534560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652c327-fd47-469a-8226-64faa1ec7805 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:51.544256 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1225/2445] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:55.547122 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02ef06-7325-4edc-858e-e6a33965c709 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:55.549162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-8a02ef06-7325-4edc-858e-e6a33965c709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:55.676523 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02ef06-7325-4edc-858e-e6a33965c709 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:55.682859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f69fcf-a904-415c-adeb-26556970aa88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:55.683894 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f69fcf-a904-415c-adeb-26556970aa88 service nova] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:55.684218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f69fcf-a904-415c-adeb-26556970aa88 service nova] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:55.684475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f69fcf-a904-415c-adeb-26556970aa88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:55.686544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-20f69fcf-a904-415c-adeb-26556970aa88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:55.707659 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f69fcf-a904-415c-adeb-26556970aa88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:55.709384 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f69fcf-a904-415c-adeb-26556970aa88 service nova] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:55.733332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1221/2446] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:55.942760 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652c327-fd47-469a-8226-64faa1ec7805 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:55.944850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-a652c327-fd47-469a-8226-64faa1ec7805 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:55.967519 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652c327-fd47-469a-8226-64faa1ec7805 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:55.979230 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5e650-b3f5-480d-aaae-7dc451521075 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:55.981282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5e650-b3f5-480d-aaae-7dc451521075 service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:55.981282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5e650-b3f5-480d-aaae-7dc451521075 service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:55.981282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5e650-b3f5-480d-aaae-7dc451521075 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:55.985804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-efa5e650-b3f5-480d-aaae-7dc451521075 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:56.004287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5e650-b3f5-480d-aaae-7dc451521075 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:56.006486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5e650-b3f5-480d-aaae-7dc451521075 service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:56.030080 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1226/2447] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:56:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:56:59.533054 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626cd08-74ca-41bf-985f-b91017ee9da2 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:59.533590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626cd08-74ca-41bf-985f-b91017ee9da2 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:59.535472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626cd08-74ca-41bf-985f-b91017ee9da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:59.574760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-9626cd08-74ca-41bf-985f-b91017ee9da2 None None] MFA Rules not processed for user `77773d40a7a940819a99d11055439333`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:56:59.577138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9626cd08-74ca-41bf-985f-b91017ee9da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:56:59.678761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1222/2448] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:56:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:56:59.684086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5e650-b3f5-480d-aaae-7dc451521075 service nova] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:59.698870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5e650-b3f5-480d-aaae-7dc451521075 service nova] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:59.704784 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd07ba0-af7d-47b9-bfe9-ad7cbb974e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:59.705547 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd07ba0-af7d-47b9-bfe9-ad7cbb974e8c admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:59.705893 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd07ba0-af7d-47b9-bfe9-ad7cbb974e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:59.706757 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd07ba0-af7d-47b9-bfe9-ad7cbb974e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:59.707460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd07ba0-af7d-47b9-bfe9-ad7cbb974e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:59.709547 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd07ba0-af7d-47b9-bfe9-ad7cbb974e8c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:56:59.836175 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1227/2449] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:56:59 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:56:59.840045 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626cd08-74ca-41bf-985f-b91017ee9da2 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:56:59.851948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626cd08-74ca-41bf-985f-b91017ee9da2 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:56:59.889558 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:56:59.928683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae6b7a-917e-4634-84b1-8a3f6be5cf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:56:59.928683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae6b7a-917e-4634-84b1-8a3f6be5cf0e admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:56:59.928683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae6b7a-917e-4634-84b1-8a3f6be5cf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:56:59.928683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae6b7a-917e-4634-84b1-8a3f6be5cf0e admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:56:59.929063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae6b7a-917e-4634-84b1-8a3f6be5cf0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:56:59.929063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae6b7a-917e-4634-84b1-8a3f6be5cf0e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:00.009112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1223/2450] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:56:59 2022] POST /identity/v3/users => generated 299 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:00.013099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd07ba0-af7d-47b9-bfe9-ad7cbb974e8c admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:00.028548 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd07ba0-af7d-47b9-bfe9-ad7cbb974e8c admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:00.036687 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850cfc5-0a13-4af4-bdbb-d8957bde45e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:00.040117 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850cfc5-0a13-4af4-bdbb-d8957bde45e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:00.040117 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850cfc5-0a13-4af4-bdbb-d8957bde45e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:00.040117 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7850cfc5-0a13-4af4-bdbb-d8957bde45e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:00.040117 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850cfc5-0a13-4af4-bdbb-d8957bde45e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:00.042607 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7850cfc5-0a13-4af4-bdbb-d8957bde45e1 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:00.044448 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:00.065792 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1228/2451] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:00.078212 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae6b7a-917e-4634-84b1-8a3f6be5cf0e admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:00.104139 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae6b7a-917e-4634-84b1-8a3f6be5cf0e admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:00.113735 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965a687-618a-4785-985b-3cb0670cd6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:00.115717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965a687-618a-4785-985b-3cb0670cd6fd admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:00.116355 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965a687-618a-4785-985b-3cb0670cd6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:00.117421 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965a687-618a-4785-985b-3cb0670cd6fd admin admin] PATH_INFO: `/v3/projects/b262838a98254041806923c66e11e1a8/users/edd7e26bebdc4e06a35fd3b65d51ed5f/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:00.156028 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965a687-618a-4785-985b-3cb0670cd6fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b262838a98254041806923c66e11e1a8, user_id=edd7e26bebdc4e06a35fd3b65d51ed5f, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:00.163457 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c965a687-618a-4785-985b-3cb0670cd6fd admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:00.250300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1224/2452] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:00 2022] PUT /identity/v3/projects/b262838a98254041806923c66e11e1a8/users/edd7e26bebdc4e06a35fd3b65d51ed5f/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:00.254850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850cfc5-0a13-4af4-bdbb-d8957bde45e1 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:00.269403 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7850cfc5-0a13-4af4-bdbb-d8957bde45e1 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:00.327007 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cc4dd-8e25-4786-8f66-a2fa344d8a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:00.327683 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc4dd-8e25-4786-8f66-a2fa344d8a65 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:00.327967 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc4dd-8e25-4786-8f66-a2fa344d8a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:00.328243 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cc4dd-8e25-4786-8f66-a2fa344d8a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:00.329104 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cc4dd-8e25-4786-8f66-a2fa344d8a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:00.330707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cc4dd-8e25-4786-8f66-a2fa344d8a65 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:00.346833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1229/2453] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:00.347097 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965a687-618a-4785-985b-3cb0670cd6fd admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:00.356619 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965a687-618a-4785-985b-3cb0670cd6fd admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:00.362373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40b98e-1438-49c5-8327-9c8c9c6e6393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:00.363273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40b98e-1438-49c5-8327-9c8c9c6e6393 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:00.363580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40b98e-1438-49c5-8327-9c8c9c6e6393 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:00.363877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40b98e-1438-49c5-8327-9c8c9c6e6393 admin admin] PATH_INFO: `/v3/projects/b262838a98254041806923c66e11e1a8/users/edd7e26bebdc4e06a35fd3b65d51ed5f/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:00.366041 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40b98e-1438-49c5-8327-9c8c9c6e6393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b262838a98254041806923c66e11e1a8, user_id=edd7e26bebdc4e06a35fd3b65d51ed5f, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:00.368753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40b98e-1438-49c5-8327-9c8c9c6e6393 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:00.380266 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1225/2454] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:00 2022] PUT /identity/v3/projects/b262838a98254041806923c66e11e1a8/users/edd7e26bebdc4e06a35fd3b65d51ed5f/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:04.264783 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cc4dd-8e25-4786-8f66-a2fa344d8a65 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:04.354875 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cc4dd-8e25-4786-8f66-a2fa344d8a65 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:04.418329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b29724-7ed1-4e14-914c-5fd7a94d32d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:04.418985 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b29724-7ed1-4e14-914c-5fd7a94d32d9 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:04.419274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b29724-7ed1-4e14-914c-5fd7a94d32d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:04.419588 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b29724-7ed1-4e14-914c-5fd7a94d32d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:04.424766 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-59b29724-7ed1-4e14-914c-5fd7a94d32d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:04.498525 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b29724-7ed1-4e14-914c-5fd7a94d32d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:04.500038 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b29724-7ed1-4e14-914c-5fd7a94d32d9 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:04.505802 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:04.513526 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1230/2455] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:06.221792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40b98e-1438-49c5-8327-9c8c9c6e6393 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:06.245000 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40b98e-1438-49c5-8327-9c8c9c6e6393 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:06.260862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2affcbd-ea85-49a6-ae82-8b26ae951478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:06.260862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2affcbd-ea85-49a6-ae82-8b26ae951478 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:06.260862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2affcbd-ea85-49a6-ae82-8b26ae951478 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:06.260862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2affcbd-ea85-49a6-ae82-8b26ae951478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:06.265111 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f2affcbd-ea85-49a6-ae82-8b26ae951478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:06.294222 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2affcbd-ea85-49a6-ae82-8b26ae951478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:06.296054 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2affcbd-ea85-49a6-ae82-8b26ae951478 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:06.321867 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1226/2456] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:07.037322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d124b-6887-43cb-bd24-05bc084f8f68 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:07.038547 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d124b-6887-43cb-bd24-05bc084f8f68 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:07.039043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d124b-6887-43cb-bd24-05bc084f8f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:07.101410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-ca3d124b-6887-43cb-bd24-05bc084f8f68 None None] MFA Rules not processed for user `edd7e26bebdc4e06a35fd3b65d51ed5f`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:07.103167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ca3d124b-6887-43cb-bd24-05bc084f8f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:07.179904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1231/2457] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:07.201274 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2affcbd-ea85-49a6-ae82-8b26ae951478 service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:07.202979 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f2affcbd-ea85-49a6-ae82-8b26ae951478 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:07.276238 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2affcbd-ea85-49a6-ae82-8b26ae951478 service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:07.281277 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131da92-67fd-48a2-86bd-e7c74c685fe4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e59193e90e240f6b9876d0455eea355', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:07.282708 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131da92-67fd-48a2-86bd-e7c74c685fe4 service glance] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:07.283209 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131da92-67fd-48a2-86bd-e7c74c685fe4 service glance] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:07.283749 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131da92-67fd-48a2-86bd-e7c74c685fe4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:07.354494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131da92-67fd-48a2-86bd-e7c74c685fe4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:07.356279 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131da92-67fd-48a2-86bd-e7c74c685fe4 service glance] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:07.392041 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1227/2458] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:07.415126 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d124b-6887-43cb-bd24-05bc084f8f68 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:07.417014 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ca3d124b-6887-43cb-bd24-05bc084f8f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:07.434491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d124b-6887-43cb-bd24-05bc084f8f68 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:07.443949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ca5cd-aa19-4299-bc55-c67e379f8f6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:07.443949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ca5cd-aa19-4299-bc55-c67e379f8f6f service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:07.443949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ca5cd-aa19-4299-bc55-c67e379f8f6f service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:07.443949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ca5cd-aa19-4299-bc55-c67e379f8f6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:07.444305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e49ca5cd-aa19-4299-bc55-c67e379f8f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:07.597118 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ca5cd-aa19-4299-bc55-c67e379f8f6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:07.598784 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ca5cd-aa19-4299-bc55-c67e379f8f6f service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:07.621592 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1232/2459] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:07 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:07.703194 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff189940-f3a0-4eef-a6c5-0c8741c4a50c None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:07.703891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff189940-f3a0-4eef-a6c5-0c8741c4a50c None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:07.704372 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff189940-f3a0-4eef-a6c5-0c8741c4a50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:07.728322 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-ff189940-f3a0-4eef-a6c5-0c8741c4a50c None None] MFA Rules not processed for user `6e6313c444eb4a788b6559eff17959f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:07.730550 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ff189940-f3a0-4eef-a6c5-0c8741c4a50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:07.768332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:07.809857 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1228/2460] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jun 27 18:57:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:07.824443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ca5cd-aa19-4299-bc55-c67e379f8f6f service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:07.826793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e49ca5cd-aa19-4299-bc55-c67e379f8f6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:07.946749 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ca5cd-aa19-4299-bc55-c67e379f8f6f service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:07.952518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690f624-64cd-42d0-8601-03f331f55aea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94555ff897d94c90968c470d82ff9e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:07.953641 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690f624-64cd-42d0-8601-03f331f55aea service swift] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:07.954040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690f624-64cd-42d0-8601-03f331f55aea service swift] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:07.954514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690f624-64cd-42d0-8601-03f331f55aea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:07.966979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690f624-64cd-42d0-8601-03f331f55aea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:07.969996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690f624-64cd-42d0-8601-03f331f55aea service swift] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:07.987855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1233/2461] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jun 27 18:57:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 27 18:57:12.009009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff189940-f3a0-4eef-a6c5-0c8741c4a50c None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:12.012930 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ff189940-f3a0-4eef-a6c5-0c8741c4a50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:12.220665 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff189940-f3a0-4eef-a6c5-0c8741c4a50c None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:12.229483 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc60f6b-c650-4dc0-a4b3-69aab49b68ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af6ef16884604753972c916f74271f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:12.230671 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc60f6b-c650-4dc0-a4b3-69aab49b68ec service placement] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:12.231451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc60f6b-c650-4dc0-a4b3-69aab49b68ec service placement] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:12.232896 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc60f6b-c650-4dc0-a4b3-69aab49b68ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:12.237080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-4dc60f6b-c650-4dc0-a4b3-69aab49b68ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:12.283188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc60f6b-c650-4dc0-a4b3-69aab49b68ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:12.284930 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc60f6b-c650-4dc0-a4b3-69aab49b68ec service placement] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:12.308840 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1229/2462] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:12.409963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690f624-64cd-42d0-8601-03f331f55aea service swift] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:12.412792 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5690f624-64cd-42d0-8601-03f331f55aea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:12.455514 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690f624-64cd-42d0-8601-03f331f55aea service swift] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:12.505825 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81706fea-035a-4da0-a80a-b97c3896bf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:12.506889 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81706fea-035a-4da0-a80a-b97c3896bf8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:12.511046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81706fea-035a-4da0-a80a-b97c3896bf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:12.511454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81706fea-035a-4da0-a80a-b97c3896bf8c admin admin] PATH_INFO: `/v3/users/f455a84e20834cec8b84aa88ef263b56` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:12.513850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81706fea-035a-4da0-a80a-b97c3896bf8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f455a84e20834cec8b84aa88ef263b56)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:12.519810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81706fea-035a-4da0-a80a-b97c3896bf8c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:12.523054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:12.817909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-81706fea-035a-4da0-a80a-b97c3896bf8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f455a84e20834cec8b84aa88ef263b56'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:12.895856 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-81706fea-035a-4da0-a80a-b97c3896bf8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f455a84e20834cec8b84aa88ef263b56'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:12.924461 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-81706fea-035a-4da0-a80a-b97c3896bf8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f455a84e20834cec8b84aa88ef263b56'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:12.924461 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-81706fea-035a-4da0-a80a-b97c3896bf8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f455a84e20834cec8b84aa88ef263b56'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:12.938398 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-81706fea-035a-4da0-a80a-b97c3896bf8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f455a84e20834cec8b84aa88ef263b56'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:12.951010 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1234/2463] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:57:12 2022] DELETE /identity/v3/users/f455a84e20834cec8b84aa88ef263b56 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:13.573036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc60f6b-c650-4dc0-a4b3-69aab49b68ec service placement] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:13.578489 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-4dc60f6b-c650-4dc0-a4b3-69aab49b68ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:13.611028 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc60f6b-c650-4dc0-a4b3-69aab49b68ec service placement] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:13.763389 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e625ea8-142a-4880-8a6d-407a4ca23ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:13.764965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e625ea8-142a-4880-8a6d-407a4ca23ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:13.765745 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e625ea8-142a-4880-8a6d-407a4ca23ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:13.766237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e625ea8-142a-4880-8a6d-407a4ca23ef8 admin admin] PATH_INFO: `/v3/users/ded25521da0d425ea95e7763d7161ff4` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:13.768573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e625ea8-142a-4880-8a6d-407a4ca23ef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded25521da0d425ea95e7763d7161ff4)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:13.772270 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e625ea8-142a-4880-8a6d-407a4ca23ef8 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:13.980665 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81706fea-035a-4da0-a80a-b97c3896bf8c admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:13.982073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-81706fea-035a-4da0-a80a-b97c3896bf8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:14.012444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81706fea-035a-4da0-a80a-b97c3896bf8c admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:14.088229 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e03a6a3-918d-4a01-b82d-a560962e8d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:14.088229 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03a6a3-918d-4a01-b82d-a560962e8d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:14.088229 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03a6a3-918d-4a01-b82d-a560962e8d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:14.088229 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e03a6a3-918d-4a01-b82d-a560962e8d3f admin admin] PATH_INFO: `/v3/projects/ebb63d35730e4bb792eae0d0f8e6bb38` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:14.089631 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03a6a3-918d-4a01-b82d-a560962e8d3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb63d35730e4bb792eae0d0f8e6bb38)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:14.089631 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e03a6a3-918d-4a01-b82d-a560962e8d3f admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:14.264171 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-3e625ea8-142a-4880-8a6d-407a4ca23ef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded25521da0d425ea95e7763d7161ff4'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:14.312207 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0e03a6a3-918d-4a01-b82d-a560962e8d3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb63d35730e4bb792eae0d0f8e6bb38', 'request_id': 'req-0e03a6a3-918d-4a01-b82d-a560962e8d3f'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:14.364200 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-3e625ea8-142a-4880-8a6d-407a4ca23ef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded25521da0d425ea95e7763d7161ff4'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:14.374750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:14.380142 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-3e625ea8-142a-4880-8a6d-407a4ca23ef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded25521da0d425ea95e7763d7161ff4'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:14.389294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-3e625ea8-142a-4880-8a6d-407a4ca23ef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded25521da0d425ea95e7763d7161ff4'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:14.391150 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-3e625ea8-142a-4880-8a6d-407a4ca23ef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded25521da0d425ea95e7763d7161ff4'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:14.407440 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1230/2464] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:57:13 2022] DELETE /identity/v3/users/ded25521da0d425ea95e7763d7161ff4 => generated 0 bytes in 835 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:14.456138 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0e03a6a3-918d-4a01-b82d-a560962e8d3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb63d35730e4bb792eae0d0f8e6bb38', 'request_id': 'req-0e03a6a3-918d-4a01-b82d-a560962e8d3f'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:14.464609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0e03a6a3-918d-4a01-b82d-a560962e8d3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb63d35730e4bb792eae0d0f8e6bb38', 'request_id': 'req-0e03a6a3-918d-4a01-b82d-a560962e8d3f'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:14.530960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0e03a6a3-918d-4a01-b82d-a560962e8d3f admin admin] The token cache is being invalidate because project ebb63d35730e4bb792eae0d0f8e6bb38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:57:14.532189 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0e03a6a3-918d-4a01-b82d-a560962e8d3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:14.533538 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0e03a6a3-918d-4a01-b82d-a560962e8d3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:14.538861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1235/2465] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:57:13 2022] DELETE /identity/v3/projects/ebb63d35730e4bb792eae0d0f8e6bb38 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:14.542933 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868fe23-9868-48a2-8342-48afa7ad91cc None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:14.543155 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868fe23-9868-48a2-8342-48afa7ad91cc None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:14.543516 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868fe23-9868-48a2-8342-48afa7ad91cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:14.581033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-a868fe23-9868-48a2-8342-48afa7ad91cc None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:14.582021 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a868fe23-9868-48a2-8342-48afa7ad91cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:14.703330 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1231/2466] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:14.710740 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61b52-4b6c-4831-b038-52904f5abde7 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:14.713293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61b52-4b6c-4831-b038-52904f5abde7 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:14.713293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec61b52-4b6c-4831-b038-52904f5abde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:14.732597 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-eec61b52-4b6c-4831-b038-52904f5abde7 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:14.734111 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-eec61b52-4b6c-4831-b038-52904f5abde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:14.755045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1236/2467] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:14.758881 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868fe23-9868-48a2-8342-48afa7ad91cc None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:14.770466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868fe23-9868-48a2-8342-48afa7ad91cc None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:14.781034 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec61b52-4b6c-4831-b038-52904f5abde7 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:14.783743 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-eec61b52-4b6c-4831-b038-52904f5abde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:14.793739 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45d36a-b34a-4e94-9382-b9d8478f8ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:14.797565 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45d36a-b34a-4e94-9382-b9d8478f8ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:14.797565 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45d36a-b34a-4e94-9382-b9d8478f8ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:14.797565 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45d36a-b34a-4e94-9382-b9d8478f8ee3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:14.797565 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45d36a-b34a-4e94-9382-b9d8478f8ee3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:57:14.797565 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45d36a-b34a-4e94-9382-b9d8478f8ee3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:14.798285 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45d36a-b34a-4e94-9382-b9d8478f8ee3 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:14.813602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec61b52-4b6c-4831-b038-52904f5abde7 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:14.821473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1232/2468] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:57:14.823315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45d36a-b34a-4e94-9382-b9d8478f8ee3 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:14.830869 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a09729-bda8-4347-9f2d-89ce3988326d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:14.834336 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a09729-bda8-4347-9f2d-89ce3988326d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:14.834761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a09729-bda8-4347-9f2d-89ce3988326d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:14.835154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a09729-bda8-4347-9f2d-89ce3988326d admin admin] PATH_INFO: `/v3/projects/991f84dedd5a46108574c5b121634db0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:14.837247 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45d36a-b34a-4e94-9382-b9d8478f8ee3 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:14.837854 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a09729-bda8-4347-9f2d-89ce3988326d admin admin] RBAC: Authorizing `identity:delete_project(project_id=991f84dedd5a46108574c5b121634db0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:14.841510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a09729-bda8-4347-9f2d-89ce3988326d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:14.842925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b7d95-815c-4039-bc38-eedbe053df88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:14.844506 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b7d95-815c-4039-bc38-eedbe053df88 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:14.846204 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b7d95-815c-4039-bc38-eedbe053df88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:14.846405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b7d95-815c-4039-bc38-eedbe053df88 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:14.848269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b7d95-815c-4039-bc38-eedbe053df88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:14.850464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b7d95-815c-4039-bc38-eedbe053df88 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:14.941818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1233/2469] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:57:14 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:14.945861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b7d95-815c-4039-bc38-eedbe053df88 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:14.993960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-97a09729-bda8-4347-9f2d-89ce3988326d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991f84dedd5a46108574c5b121634db0', 'request_id': 'req-97a09729-bda8-4347-9f2d-89ce3988326d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:14.996643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=77,keystone:DELETE=21,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:15.063295 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b7d95-815c-4039-bc38-eedbe053df88 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:15.107665 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-97a09729-bda8-4347-9f2d-89ce3988326d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991f84dedd5a46108574c5b121634db0', 'request_id': 'req-97a09729-bda8-4347-9f2d-89ce3988326d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:15.117964 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-97a09729-bda8-4347-9f2d-89ce3988326d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991f84dedd5a46108574c5b121634db0', 'request_id': 'req-97a09729-bda8-4347-9f2d-89ce3988326d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:15.147473 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-97a09729-bda8-4347-9f2d-89ce3988326d admin admin] The token cache is being invalidate because project 991f84dedd5a46108574c5b121634db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:57:15.149835 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-97a09729-bda8-4347-9f2d-89ce3988326d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:15.151747 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-97a09729-bda8-4347-9f2d-89ce3988326d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:15.156218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1237/2470] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:57:14 2022] DELETE /identity/v3/projects/991f84dedd5a46108574c5b121634db0 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:15.160591 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c825ff-9c7e-45a4-b470-82a52245283c None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:15.161206 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c825ff-9c7e-45a4-b470-82a52245283c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:15.161852 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c825ff-9c7e-45a4-b470-82a52245283c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:15.170081 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:15.189601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c65d78-21b0-46e8-a1c1-09cd9c079122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:15.190670 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c65d78-21b0-46e8-a1c1-09cd9c079122 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:15.192808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c65d78-21b0-46e8-a1c1-09cd9c079122 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:15.193338 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c65d78-21b0-46e8-a1c1-09cd9c079122 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:15.194070 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c65d78-21b0-46e8-a1c1-09cd9c079122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:15.196176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c65d78-21b0-46e8-a1c1-09cd9c079122 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:15.206075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-40c825ff-9c7e-45a4-b470-82a52245283c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:15.210861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-40c825ff-9c7e-45a4-b470-82a52245283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:15.227057 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1238/2471] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:15.235804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7f36b-eb1e-45c2-ba7b-e7a6e5521da2 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:15.236447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7f36b-eb1e-45c2-ba7b-e7a6e5521da2 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:15.237056 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7f36b-eb1e-45c2-ba7b-e7a6e5521da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:15.262446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-46f7f36b-eb1e-45c2-ba7b-e7a6e5521da2 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:15.264263 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-46f7f36b-eb1e-45c2-ba7b-e7a6e5521da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:15.279778 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1239/2472] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:57:15.284624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7f36b-eb1e-45c2-ba7b-e7a6e5521da2 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:15.303328 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1234/2473] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:57:14 2022] POST /identity/v3/users => generated 287 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:15.305284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f7f36b-eb1e-45c2-ba7b-e7a6e5521da2 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:15.306034 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c65d78-21b0-46e8-a1c1-09cd9c079122 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:15.307952 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a0c65d78-21b0-46e8-a1c1-09cd9c079122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:15.312917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd59ac-9270-4147-8c83-c8e7be51d3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:15.313579 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd59ac-9270-4147-8c83-c8e7be51d3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:15.313867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd59ac-9270-4147-8c83-c8e7be51d3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:15.314147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd59ac-9270-4147-8c83-c8e7be51d3e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:15.314899 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd59ac-9270-4147-8c83-c8e7be51d3e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:57:15.315218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd59ac-9270-4147-8c83-c8e7be51d3e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:15.316942 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd59ac-9270-4147-8c83-c8e7be51d3e5 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:15.328888 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c65d78-21b0-46e8-a1c1-09cd9c079122 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:15.331568 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1240/2474] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:57:15.335051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd59ac-9270-4147-8c83-c8e7be51d3e5 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:15.340151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ed24d-9023-4205-bfd2-ee5bbe40d891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:15.341135 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed24d-9023-4205-bfd2-ee5bbe40d891 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:15.341135 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed24d-9023-4205-bfd2-ee5bbe40d891 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:15.342398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ed24d-9023-4205-bfd2-ee5bbe40d891 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:15.342398 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ed24d-9023-4205-bfd2-ee5bbe40d891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:15.343728 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ed24d-9023-4205-bfd2-ee5bbe40d891 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:15.352859 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd59ac-9270-4147-8c83-c8e7be51d3e5 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:15.356341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1235/2475] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:15.360102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ed24d-9023-4205-bfd2-ee5bbe40d891 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:15.361920 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc64dc-1def-413a-81a8-cd5b8e8100c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:15.362709 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc64dc-1def-413a-81a8-cd5b8e8100c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:15.362962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc64dc-1def-413a-81a8-cd5b8e8100c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:15.365569 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bc64dc-1def-413a-81a8-cd5b8e8100c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:15.366340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc64dc-1def-413a-81a8-cd5b8e8100c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:15.368490 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bc64dc-1def-413a-81a8-cd5b8e8100c9 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:15.373120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ed24d-9023-4205-bfd2-ee5bbe40d891 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:15.378112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef01ea-eeb9-4fa6-9885-ef9bc8def3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:15.378967 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef01ea-eeb9-4fa6-9885-ef9bc8def3fd admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:15.379346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef01ea-eeb9-4fa6-9885-ef9bc8def3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:15.379763 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef01ea-eeb9-4fa6-9885-ef9bc8def3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:15.380809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef01ea-eeb9-4fa6-9885-ef9bc8def3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:15.382634 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef01ea-eeb9-4fa6-9885-ef9bc8def3fd admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:15.405474 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1236/2476] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:15.410206 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef01ea-eeb9-4fa6-9885-ef9bc8def3fd admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:15.421983 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef01ea-eeb9-4fa6-9885-ef9bc8def3fd admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:15.431096 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceada72-6dd2-4f87-85a7-18ae4d24308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:15.431096 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceada72-6dd2-4f87-85a7-18ae4d24308c admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:15.431096 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceada72-6dd2-4f87-85a7-18ae4d24308c admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:15.431096 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceada72-6dd2-4f87-85a7-18ae4d24308c admin admin] PATH_INFO: `/v3/projects/ea27d359c4564abcbca3b3ddb380a224/users/1cd2a3dc10fd4610924ac1cd91b80370/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:15.447076 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceada72-6dd2-4f87-85a7-18ae4d24308c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea27d359c4564abcbca3b3ddb380a224, user_id=1cd2a3dc10fd4610924ac1cd91b80370, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:15.450347 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceada72-6dd2-4f87-85a7-18ae4d24308c admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:15.463287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1241/2477] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:57:15 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:57:15.464951 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc64dc-1def-413a-81a8-cd5b8e8100c9 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:15.548015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1237/2478] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:15 2022] PUT /identity/v3/projects/ea27d359c4564abcbca3b3ddb380a224/users/1cd2a3dc10fd4610924ac1cd91b80370/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:15.553277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bc64dc-1def-413a-81a8-cd5b8e8100c9 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:15.558222 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732eb2b-d7fc-4521-8eae-5d15b9d43901 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:15.558573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732eb2b-d7fc-4521-8eae-5d15b9d43901 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:15.558928 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732eb2b-d7fc-4521-8eae-5d15b9d43901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:15.589842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-2732eb2b-d7fc-4521-8eae-5d15b9d43901 None None] MFA Rules not processed for user `1cd2a3dc10fd4610924ac1cd91b80370`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:15.591170 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2732eb2b-d7fc-4521-8eae-5d15b9d43901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:15.627816 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b11d1-6fc5-41ed-88f1-c02e007a2562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:15.628637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b11d1-6fc5-41ed-88f1-c02e007a2562 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:15.628909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b11d1-6fc5-41ed-88f1-c02e007a2562 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:15.629378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b11d1-6fc5-41ed-88f1-c02e007a2562 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:15.630087 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b11d1-6fc5-41ed-88f1-c02e007a2562 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:15.632054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b11d1-6fc5-41ed-88f1-c02e007a2562 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:15.670573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1238/2479] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:15.672069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732eb2b-d7fc-4521-8eae-5d15b9d43901 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:15.683461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732eb2b-d7fc-4521-8eae-5d15b9d43901 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:15.691296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2e4fe-3890-4adc-a33d-fc3422589d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:15.692001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2e4fe-3890-4adc-a33d-fc3422589d95 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:15.692287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2e4fe-3890-4adc-a33d-fc3422589d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:15.692564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2e4fe-3890-4adc-a33d-fc3422589d95 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:15.693264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2e4fe-3890-4adc-a33d-fc3422589d95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:15.695369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2e4fe-3890-4adc-a33d-fc3422589d95 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:15.721447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1242/2480] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:57:15 2022] POST /identity/v3/users => generated 286 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:15.727616 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b11d1-6fc5-41ed-88f1-c02e007a2562 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:15.738759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b11d1-6fc5-41ed-88f1-c02e007a2562 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:15.744238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e261df-13c9-4e05-ab0a-3675e1a989d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:15.745398 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e261df-13c9-4e05-ab0a-3675e1a989d6 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:15.745828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e261df-13c9-4e05-ab0a-3675e1a989d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:15.746114 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e261df-13c9-4e05-ab0a-3675e1a989d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:15.746991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e261df-13c9-4e05-ab0a-3675e1a989d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:15.748708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e261df-13c9-4e05-ab0a-3675e1a989d6 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:15.763414 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1243/2481] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:15.767581 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1239/2482] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:57:15 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:15.767766 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e261df-13c9-4e05-ab0a-3675e1a989d6 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:15.769626 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2e4fe-3890-4adc-a33d-fc3422589d95 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:15.786480 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e261df-13c9-4e05-ab0a-3675e1a989d6 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:15.799966 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:15.863766 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2e4fe-3890-4adc-a33d-fc3422589d95 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:15.866541 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8cc63-8eb2-4e24-9fa5-37ebbdb7b884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:15.867602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8cc63-8eb2-4e24-9fa5-37ebbdb7b884 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:15.868067 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8cc63-8eb2-4e24-9fa5-37ebbdb7b884 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:15.868446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8cc63-8eb2-4e24-9fa5-37ebbdb7b884 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:15.868564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8ff3f-189c-433b-b60f-cccde2ac2977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:15.869336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8ff3f-189c-433b-b60f-cccde2ac2977 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:15.869458 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8cc63-8eb2-4e24-9fa5-37ebbdb7b884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:15.869620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8ff3f-189c-433b-b60f-cccde2ac2977 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:15.869899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8ff3f-189c-433b-b60f-cccde2ac2977 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:15.870587 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8ff3f-189c-433b-b60f-cccde2ac2977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:15.871933 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac8cc63-8eb2-4e24-9fa5-37ebbdb7b884 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:15.872752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8ff3f-189c-433b-b60f-cccde2ac2977 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:15.885734 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:15.886235 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1244/2483] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:57:15.889997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8cc63-8eb2-4e24-9fa5-37ebbdb7b884 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:15.901215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8cc63-8eb2-4e24-9fa5-37ebbdb7b884 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:15.906332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5c79d-8c5e-4569-988f-492f1ef54e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:15.907338 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5c79d-8c5e-4569-988f-492f1ef54e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:15.907663 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5c79d-8c5e-4569-988f-492f1ef54e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:15.908051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5c79d-8c5e-4569-988f-492f1ef54e61 admin admin] PATH_INFO: `/v3/projects/7d1d2666abed43f29acd1deb4ad1681f/users/e60dc0b260b048208a1349e1f9cc59a3/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:15.931859 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5c79d-8c5e-4569-988f-492f1ef54e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1d2666abed43f29acd1deb4ad1681f, user_id=e60dc0b260b048208a1349e1f9cc59a3, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:15.935227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5c79d-8c5e-4569-988f-492f1ef54e61 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:15.970867 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1240/2484] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:57:15 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:15.974537 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8ff3f-189c-433b-b60f-cccde2ac2977 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:15.989043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8ff3f-189c-433b-b60f-cccde2ac2977 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:15.993738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c142415-a5cd-4475-95ba-31aab2f57b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:15.994556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c142415-a5cd-4475-95ba-31aab2f57b44 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:15.994838 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c142415-a5cd-4475-95ba-31aab2f57b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:15.995118 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c142415-a5cd-4475-95ba-31aab2f57b44 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:15.996032 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c142415-a5cd-4475-95ba-31aab2f57b44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:15.997794 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c142415-a5cd-4475-95ba-31aab2f57b44 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:16.015100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1241/2485] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:57:16.016551 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c142415-a5cd-4475-95ba-31aab2f57b44 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:16.028427 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c142415-a5cd-4475-95ba-31aab2f57b44 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:16.029531 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1245/2486] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:15 2022] PUT /identity/v3/projects/7d1d2666abed43f29acd1deb4ad1681f/users/e60dc0b260b048208a1349e1f9cc59a3/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:16.042294 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b02c5-008e-4d1f-bf40-0bab455fa888 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:16.042768 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b02c5-008e-4d1f-bf40-0bab455fa888 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:16.043210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b02c5-008e-4d1f-bf40-0bab455fa888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:16.084894 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-de6b02c5-008e-4d1f-bf40-0bab455fa888 None None] MFA Rules not processed for user `e60dc0b260b048208a1349e1f9cc59a3`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:16.086443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-de6b02c5-008e-4d1f-bf40-0bab455fa888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:16.124302 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c3f4f-03d2-4021-8e60-a5f107d6289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:16.126222 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c3f4f-03d2-4021-8e60-a5f107d6289d admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:16.127002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c3f4f-03d2-4021-8e60-a5f107d6289d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:16.127364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c3f4f-03d2-4021-8e60-a5f107d6289d admin admin] PATH_INFO: `/v3/projects/73d43ab8fe284fe19e9259bf01c96c99/users/344925751dbe49258ff877d099104563/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:16.150001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c3f4f-03d2-4021-8e60-a5f107d6289d admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d43ab8fe284fe19e9259bf01c96c99, user_id=344925751dbe49258ff877d099104563, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:16.152827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c3f4f-03d2-4021-8e60-a5f107d6289d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:16.167850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1246/2487] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:57:16.172836 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b02c5-008e-4d1f-bf40-0bab455fa888 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:16.184981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b02c5-008e-4d1f-bf40-0bab455fa888 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:16.190533 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da0117-96c6-4430-bb87-4b08ddc1dc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:16.191429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da0117-96c6-4430-bb87-4b08ddc1dc99 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:16.192138 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da0117-96c6-4430-bb87-4b08ddc1dc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:16.192138 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da0117-96c6-4430-bb87-4b08ddc1dc99 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:16.192833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da0117-96c6-4430-bb87-4b08ddc1dc99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:16.194759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da0117-96c6-4430-bb87-4b08ddc1dc99 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:16.255848 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1242/2488] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:16 2022] PUT /identity/v3/projects/73d43ab8fe284fe19e9259bf01c96c99/users/344925751dbe49258ff877d099104563/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:16.257050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c3f4f-03d2-4021-8e60-a5f107d6289d admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:16.277715 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1247/2489] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:57:16 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:16.297159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da0117-96c6-4430-bb87-4b08ddc1dc99 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:16.348963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c3f4f-03d2-4021-8e60-a5f107d6289d admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:16.394254 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:16.404045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da0117-96c6-4430-bb87-4b08ddc1dc99 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:16.409782 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07407899-afd4-49b5-b48d-ec823a47ec1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:16.410571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07407899-afd4-49b5-b48d-ec823a47ec1e admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:16.410756 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07407899-afd4-49b5-b48d-ec823a47ec1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:16.411018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07407899-afd4-49b5-b48d-ec823a47ec1e admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:16.411806 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07407899-afd4-49b5-b48d-ec823a47ec1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:16.413834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07407899-afd4-49b5-b48d-ec823a47ec1e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:16.425116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b5730-f852-4466-b3be-cb6b554a5601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:16.425953 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b5730-f852-4466-b3be-cb6b554a5601 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:16.426359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b5730-f852-4466-b3be-cb6b554a5601 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:16.426672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b5730-f852-4466-b3be-cb6b554a5601 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:16.427467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b5730-f852-4466-b3be-cb6b554a5601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:16.429223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b5730-f852-4466-b3be-cb6b554a5601 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:16.440881 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1243/2490] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:16.445482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b5730-f852-4466-b3be-cb6b554a5601 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:16.456103 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b5730-f852-4466-b3be-cb6b554a5601 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:16.461212 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19fc68e-d66b-4009-b66f-fc68ff4a384a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:16.462185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fc68e-d66b-4009-b66f-fc68ff4a384a admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:16.462498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fc68e-d66b-4009-b66f-fc68ff4a384a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:16.462782 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19fc68e-d66b-4009-b66f-fc68ff4a384a admin admin] PATH_INFO: `/v3/projects/73d43ab8fe284fe19e9259bf01c96c99/users/344925751dbe49258ff877d099104563/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:16.466082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19fc68e-d66b-4009-b66f-fc68ff4a384a admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d43ab8fe284fe19e9259bf01c96c99, user_id=344925751dbe49258ff877d099104563, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:16.471575 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19fc68e-d66b-4009-b66f-fc68ff4a384a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:16.477015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:16.483327 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1244/2491] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:16 2022] PUT /identity/v3/projects/73d43ab8fe284fe19e9259bf01c96c99/users/344925751dbe49258ff877d099104563/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:16.494769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad997e4-3e15-4f53-83f1-b7984378210e None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:16.495138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad997e4-3e15-4f53-83f1-b7984378210e None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:16.495517 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad997e4-3e15-4f53-83f1-b7984378210e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:16.529423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-cad997e4-3e15-4f53-83f1-b7984378210e None None] MFA Rules not processed for user `344925751dbe49258ff877d099104563`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:16.529423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-cad997e4-3e15-4f53-83f1-b7984378210e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:16.537324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1248/2492] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:57:16 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:57:16.538152 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07407899-afd4-49b5-b48d-ec823a47ec1e admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:16.549295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07407899-afd4-49b5-b48d-ec823a47ec1e admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:16.622546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1245/2493] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:16 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:57:16.634798 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad997e4-3e15-4f53-83f1-b7984378210e None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:16.636393 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-cad997e4-3e15-4f53-83f1-b7984378210e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:16.637071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce49d6-be1c-43c4-8214-b3711eda005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:16.637752 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce49d6-be1c-43c4-8214-b3711eda005d admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:16.638043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce49d6-be1c-43c4-8214-b3711eda005d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:16.639013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ce49d6-be1c-43c4-8214-b3711eda005d admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:16.641448 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce49d6-be1c-43c4-8214-b3711eda005d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:16.643150 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ce49d6-be1c-43c4-8214-b3711eda005d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:16.658684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1249/2494] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:16.660630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce49d6-be1c-43c4-8214-b3711eda005d admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:16.673525 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ce49d6-be1c-43c4-8214-b3711eda005d admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:16.679777 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdaaf8-0faf-49b6-8e6e-b753e34e2e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:16.680883 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdaaf8-0faf-49b6-8e6e-b753e34e2e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:16.681176 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdaaf8-0faf-49b6-8e6e-b753e34e2e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:16.681457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cdaaf8-0faf-49b6-8e6e-b753e34e2e8b admin admin] PATH_INFO: `/v3/projects/1a0b5c0e42924d0bbef277fd3f3e3292/users/4af68b9b471042229918b5bee20924ce/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:16.700265 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdaaf8-0faf-49b6-8e6e-b753e34e2e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a0b5c0e42924d0bbef277fd3f3e3292, user_id=4af68b9b471042229918b5bee20924ce, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:16.703717 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cdaaf8-0faf-49b6-8e6e-b753e34e2e8b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:16.706009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad997e4-3e15-4f53-83f1-b7984378210e None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:16.710454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df0d25-9915-489f-96f4-8b8db16dc633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:16.711179 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df0d25-9915-489f-96f4-8b8db16dc633 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:16.711559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df0d25-9915-489f-96f4-8b8db16dc633 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:16.711851 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df0d25-9915-489f-96f4-8b8db16dc633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:16.723182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df0d25-9915-489f-96f4-8b8db16dc633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:16.724773 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df0d25-9915-489f-96f4-8b8db16dc633 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:16.736622 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1246/2495] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:16 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:57:16.779936 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1250/2496] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:16 2022] PUT /identity/v3/projects/1a0b5c0e42924d0bbef277fd3f3e3292/users/4af68b9b471042229918b5bee20924ce/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:16.781179 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df0d25-9915-489f-96f4-8b8db16dc633 service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:16.794276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df0d25-9915-489f-96f4-8b8db16dc633 service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:16.874865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43229dc-b1e4-44e4-8baa-0e335c266bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:16.876282 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43229dc-b1e4-44e4-8baa-0e335c266bdc admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:16.876567 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43229dc-b1e4-44e4-8baa-0e335c266bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:16.877108 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43229dc-b1e4-44e4-8baa-0e335c266bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:16.877917 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43229dc-b1e4-44e4-8baa-0e335c266bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:16.879858 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43229dc-b1e4-44e4-8baa-0e335c266bdc admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:16.898776 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1247/2497] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:16.903339 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdaaf8-0faf-49b6-8e6e-b753e34e2e8b admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:16.911582 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cdaaf8-0faf-49b6-8e6e-b753e34e2e8b admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:16.916287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee800705-82ae-4b8b-b7cb-2e5b1a50f3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:16.917382 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee800705-82ae-4b8b-b7cb-2e5b1a50f3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:16.918353 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee800705-82ae-4b8b-b7cb-2e5b1a50f3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:16.918691 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee800705-82ae-4b8b-b7cb-2e5b1a50f3a5 admin admin] PATH_INFO: `/v3/projects/1a0b5c0e42924d0bbef277fd3f3e3292/users/4af68b9b471042229918b5bee20924ce/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:16.920917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee800705-82ae-4b8b-b7cb-2e5b1a50f3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a0b5c0e42924d0bbef277fd3f3e3292, user_id=4af68b9b471042229918b5bee20924ce, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:16.924341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee800705-82ae-4b8b-b7cb-2e5b1a50f3a5 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:16.936538 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1251/2498] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:16 2022] PUT /identity/v3/projects/1a0b5c0e42924d0bbef277fd3f3e3292/users/4af68b9b471042229918b5bee20924ce/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:16.948164 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ebc1-a153-4c6f-abe2-65de3409fc03 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:16.948876 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ebc1-a153-4c6f-abe2-65de3409fc03 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:16.949410 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ebc1-a153-4c6f-abe2-65de3409fc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:17.000867 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-1906ebc1-a153-4c6f-abe2-65de3409fc03 None None] MFA Rules not processed for user `4af68b9b471042229918b5bee20924ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:17.002192 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-1906ebc1-a153-4c6f-abe2-65de3409fc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:17.014042 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:17.097400 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1248/2499] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:17.114964 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee800705-82ae-4b8b-b7cb-2e5b1a50f3a5 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:17.116080 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ee800705-82ae-4b8b-b7cb-2e5b1a50f3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:17.191373 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee800705-82ae-4b8b-b7cb-2e5b1a50f3a5 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:17.195136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d42958-a3d2-4c4a-ba95-9eb0ceeec89a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:17.195913 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d42958-a3d2-4c4a-ba95-9eb0ceeec89a service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:17.196285 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d42958-a3d2-4c4a-ba95-9eb0ceeec89a service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:17.196634 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d42958-a3d2-4c4a-ba95-9eb0ceeec89a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:17.208709 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d42958-a3d2-4c4a-ba95-9eb0ceeec89a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:17.210248 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d42958-a3d2-4c4a-ba95-9eb0ceeec89a service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:17.222868 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1252/2500] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:17.448646 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906ebc1-a153-4c6f-abe2-65de3409fc03 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:17.468016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906ebc1-a153-4c6f-abe2-65de3409fc03 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:17.468016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd09b5e-b044-4b9a-9423-a9b958e9ae56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:17.468016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd09b5e-b044-4b9a-9423-a9b958e9ae56 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:17.468016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd09b5e-b044-4b9a-9423-a9b958e9ae56 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:17.468351 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd09b5e-b044-4b9a-9423-a9b958e9ae56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:17.547275 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd09b5e-b044-4b9a-9423-a9b958e9ae56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:17.548800 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd09b5e-b044-4b9a-9423-a9b958e9ae56 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:17.559573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1249/2501] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:17.964341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d42958-a3d2-4c4a-ba95-9eb0ceeec89a service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:18.013118 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:18.027709 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d42958-a3d2-4c4a-ba95-9eb0ceeec89a service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:18.032377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7d47a-38f6-4ad7-957f-c86ea0690ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:18.033270 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7d47a-38f6-4ad7-957f-c86ea0690ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:18.033557 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7d47a-38f6-4ad7-957f-c86ea0690ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:18.033836 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7d47a-38f6-4ad7-957f-c86ea0690ffb admin admin] PATH_INFO: `/v3/users/1cd2a3dc10fd4610924ac1cd91b80370` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:18.035027 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7d47a-38f6-4ad7-957f-c86ea0690ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd2a3dc10fd4610924ac1cd91b80370)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:18.036990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7d47a-38f6-4ad7-957f-c86ea0690ffb admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:18.253919 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-e7f7d47a-38f6-4ad7-957f-c86ea0690ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd2a3dc10fd4610924ac1cd91b80370'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:18.340864 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-e7f7d47a-38f6-4ad7-957f-c86ea0690ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd2a3dc10fd4610924ac1cd91b80370'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:18.358690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-e7f7d47a-38f6-4ad7-957f-c86ea0690ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd2a3dc10fd4610924ac1cd91b80370'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:18.360252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-e7f7d47a-38f6-4ad7-957f-c86ea0690ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd2a3dc10fd4610924ac1cd91b80370'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:18.368934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-e7f7d47a-38f6-4ad7-957f-c86ea0690ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd2a3dc10fd4610924ac1cd91b80370'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:18.376030 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1253/2502] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:57:17 2022] DELETE /identity/v3/users/1cd2a3dc10fd4610924ac1cd91b80370 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:18.380841 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952d60f-e76b-417c-8749-ceafe7ef289a None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:18.381753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952d60f-e76b-417c-8749-ceafe7ef289a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:18.382245 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952d60f-e76b-417c-8749-ceafe7ef289a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:18.401358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-d952d60f-e76b-417c-8749-ceafe7ef289a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:18.402910 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-d952d60f-e76b-417c-8749-ceafe7ef289a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:18.479840 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1250/2503] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:57:18.490565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7d47a-38f6-4ad7-957f-c86ea0690ffb admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:18.492011 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e7f7d47a-38f6-4ad7-957f-c86ea0690ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:18.572692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7d47a-38f6-4ad7-957f-c86ea0690ffb admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:18.576363 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9356cd-b774-4716-a6ec-912ace22bab1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:18.577016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9356cd-b774-4716-a6ec-912ace22bab1 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:18.577310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9356cd-b774-4716-a6ec-912ace22bab1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:18.577594 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9356cd-b774-4716-a6ec-912ace22bab1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:18.590531 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9356cd-b774-4716-a6ec-912ace22bab1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:18.592156 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9356cd-b774-4716-a6ec-912ace22bab1 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:18.604974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1254/2504] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:19.070560 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952d60f-e76b-417c-8749-ceafe7ef289a None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:19.072317 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-d952d60f-e76b-417c-8749-ceafe7ef289a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:19.103816 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952d60f-e76b-417c-8749-ceafe7ef289a None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:19.109508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e29e9c-0c6a-4f2d-b369-803308359eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:19.110650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e29e9c-0c6a-4f2d-b369-803308359eb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:19.111071 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e29e9c-0c6a-4f2d-b369-803308359eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:19.111464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e29e9c-0c6a-4f2d-b369-803308359eb5 admin admin] PATH_INFO: `/v3/projects/ea27d359c4564abcbca3b3ddb380a224` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:19.113531 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e29e9c-0c6a-4f2d-b369-803308359eb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea27d359c4564abcbca3b3ddb380a224)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:19.115674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e29e9c-0c6a-4f2d-b369-803308359eb5 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:19.211820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:19.218632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-13e29e9c-0c6a-4f2d-b369-803308359eb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea27d359c4564abcbca3b3ddb380a224', 'request_id': 'req-13e29e9c-0c6a-4f2d-b369-803308359eb5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:19.226156 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-13e29e9c-0c6a-4f2d-b369-803308359eb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea27d359c4564abcbca3b3ddb380a224', 'request_id': 'req-13e29e9c-0c6a-4f2d-b369-803308359eb5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:19.267730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-13e29e9c-0c6a-4f2d-b369-803308359eb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea27d359c4564abcbca3b3ddb380a224', 'request_id': 'req-13e29e9c-0c6a-4f2d-b369-803308359eb5'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:19.281742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-13e29e9c-0c6a-4f2d-b369-803308359eb5 admin admin] The token cache is being invalidate because project ea27d359c4564abcbca3b3ddb380a224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:57:19.282089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-13e29e9c-0c6a-4f2d-b369-803308359eb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:19.282778 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-13e29e9c-0c6a-4f2d-b369-803308359eb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:19.288093 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1251/2505] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:57:19 2022] DELETE /identity/v3/projects/ea27d359c4564abcbca3b3ddb380a224 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:19.289341 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9356cd-b774-4716-a6ec-912ace22bab1 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:19.302239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9356cd-b774-4716-a6ec-912ace22bab1 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:19.396224 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f23068-020a-4168-9a2d-0d00c072b20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:19.397113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f23068-020a-4168-9a2d-0d00c072b20d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:19.397538 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f23068-020a-4168-9a2d-0d00c072b20d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:19.397828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f23068-020a-4168-9a2d-0d00c072b20d admin admin] PATH_INFO: `/v3/users/344925751dbe49258ff877d099104563` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:19.399099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f23068-020a-4168-9a2d-0d00c072b20d admin admin] RBAC: Authorizing `identity:delete_user(user_id=344925751dbe49258ff877d099104563)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:19.401080 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f23068-020a-4168-9a2d-0d00c072b20d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:19.424000 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:19.633497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-f2f23068-020a-4168-9a2d-0d00c072b20d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344925751dbe49258ff877d099104563'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:19.724385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-f2f23068-020a-4168-9a2d-0d00c072b20d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344925751dbe49258ff877d099104563'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:19.743260 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-f2f23068-020a-4168-9a2d-0d00c072b20d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344925751dbe49258ff877d099104563'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:19.744086 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-f2f23068-020a-4168-9a2d-0d00c072b20d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344925751dbe49258ff877d099104563'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:19.752550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-f2f23068-020a-4168-9a2d-0d00c072b20d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344925751dbe49258ff877d099104563'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:19.760777 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1255/2506] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:57:19 2022] DELETE /identity/v3/users/344925751dbe49258ff877d099104563 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:20.322410 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e29e9c-0c6a-4f2d-b369-803308359eb5 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:20.324769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-13e29e9c-0c6a-4f2d-b369-803308359eb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:20.364860 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e29e9c-0c6a-4f2d-b369-803308359eb5 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:20.450344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19908b9c-e88c-424b-ad63-20188934ca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:20.451389 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19908b9c-e88c-424b-ad63-20188934ca75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:20.451764 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19908b9c-e88c-424b-ad63-20188934ca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:20.452114 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19908b9c-e88c-424b-ad63-20188934ca75 admin admin] PATH_INFO: `/v3/projects/73d43ab8fe284fe19e9259bf01c96c99` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:20.454440 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19908b9c-e88c-424b-ad63-20188934ca75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d43ab8fe284fe19e9259bf01c96c99)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:20.456742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19908b9c-e88c-424b-ad63-20188934ca75 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:20.597020 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-19908b9c-e88c-424b-ad63-20188934ca75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d43ab8fe284fe19e9259bf01c96c99', 'request_id': 'req-19908b9c-e88c-424b-ad63-20188934ca75'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:20.604516 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-19908b9c-e88c-424b-ad63-20188934ca75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d43ab8fe284fe19e9259bf01c96c99', 'request_id': 'req-19908b9c-e88c-424b-ad63-20188934ca75'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:20.690520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-19908b9c-e88c-424b-ad63-20188934ca75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d43ab8fe284fe19e9259bf01c96c99', 'request_id': 'req-19908b9c-e88c-424b-ad63-20188934ca75'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:20.703698 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-19908b9c-e88c-424b-ad63-20188934ca75 admin admin] The token cache is being invalidate because project 73d43ab8fe284fe19e9259bf01c96c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:57:20.703928 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-19908b9c-e88c-424b-ad63-20188934ca75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:20.704603 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-19908b9c-e88c-424b-ad63-20188934ca75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:20.706402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1252/2507] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:57:20 2022] DELETE /identity/v3/projects/73d43ab8fe284fe19e9259bf01c96c99 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:20.712286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9998f-a8ed-4558-bfba-8fac29c4b360 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:20.712911 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9998f-a8ed-4558-bfba-8fac29c4b360 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:20.713028 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9998f-a8ed-4558-bfba-8fac29c4b360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:20.732374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-32a9998f-a8ed-4558-bfba-8fac29c4b360 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:20.733590 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-32a9998f-a8ed-4558-bfba-8fac29c4b360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:20.803024 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1256/2508] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:57:20.812188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811903b-d4f8-49e2-b200-20183bf9269a None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:20.813099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811903b-d4f8-49e2-b200-20183bf9269a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:20.813380 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811903b-d4f8-49e2-b200-20183bf9269a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:20.834886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-f811903b-d4f8-49e2-b200-20183bf9269a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:20.836114 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f811903b-d4f8-49e2-b200-20183bf9269a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:20.844252 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1253/2509] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:20.848698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9998f-a8ed-4558-bfba-8fac29c4b360 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:20.859166 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9998f-a8ed-4558-bfba-8fac29c4b360 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:20.864629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff59b0-99f7-417f-ad27-48a6e19a96f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:20.865295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff59b0-99f7-417f-ad27-48a6e19a96f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:20.865585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff59b0-99f7-417f-ad27-48a6e19a96f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:20.865866 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff59b0-99f7-417f-ad27-48a6e19a96f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:20.866599 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff59b0-99f7-417f-ad27-48a6e19a96f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:57:20.866911 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff59b0-99f7-417f-ad27-48a6e19a96f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:20.868594 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff59b0-99f7-417f-ad27-48a6e19a96f3 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:20.881669 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1257/2510] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:57:20.892375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811903b-d4f8-49e2-b200-20183bf9269a None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:20.901909 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811903b-d4f8-49e2-b200-20183bf9269a None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:20.906724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406edc5-2221-4383-8075-c91b28dc3626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:20.907372 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406edc5-2221-4383-8075-c91b28dc3626 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:20.907684 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406edc5-2221-4383-8075-c91b28dc3626 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:20.907962 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406edc5-2221-4383-8075-c91b28dc3626 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:20.908788 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406edc5-2221-4383-8075-c91b28dc3626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:20.910756 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406edc5-2221-4383-8075-c91b28dc3626 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:21.057642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1254/2511] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:57:20 2022] POST /identity/v3/projects => generated 363 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:21.062073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff59b0-99f7-417f-ad27-48a6e19a96f3 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:21.072512 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff59b0-99f7-417f-ad27-48a6e19a96f3 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:21.132730 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c1e70-aed4-40a3-a61c-6b2a9058318a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:21.133439 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c1e70-aed4-40a3-a61c-6b2a9058318a admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:21.133726 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c1e70-aed4-40a3-a61c-6b2a9058318a admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:21.134004 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c1e70-aed4-40a3-a61c-6b2a9058318a admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:21.134703 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c1e70-aed4-40a3-a61c-6b2a9058318a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:21.136678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c1e70-aed4-40a3-a61c-6b2a9058318a admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:21.242244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1258/2512] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:57:21 2022] POST /identity/v3/users => generated 282 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:21.253785 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406edc5-2221-4383-8075-c91b28dc3626 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:21.254551 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406edc5-2221-4383-8075-c91b28dc3626 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:21.259799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c9f38-9645-4006-a404-3613ace6cd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:21.260569 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c9f38-9645-4006-a404-3613ace6cd71 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:21.260868 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c9f38-9645-4006-a404-3613ace6cd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:21.261129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c9f38-9645-4006-a404-3613ace6cd71 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:21.261897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c9f38-9645-4006-a404-3613ace6cd71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:21.263511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c9f38-9645-4006-a404-3613ace6cd71 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:21.274865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1255/2513] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:21.279129 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c1e70-aed4-40a3-a61c-6b2a9058318a admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:21.286156 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:21.298244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c1e70-aed4-40a3-a61c-6b2a9058318a admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:21.298244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebde5e-142c-43fa-aaa3-4d9cefb37cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:21.298244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebde5e-142c-43fa-aaa3-4d9cefb37cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:21.298244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebde5e-142c-43fa-aaa3-4d9cefb37cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:21.299897 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebde5e-142c-43fa-aaa3-4d9cefb37cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:21.299897 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebde5e-142c-43fa-aaa3-4d9cefb37cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:21.299897 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ebde5e-142c-43fa-aaa3-4d9cefb37cb3 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:21.314340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1259/2514] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:21.316510 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c9f38-9645-4006-a404-3613ace6cd71 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:21.326642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c9f38-9645-4006-a404-3613ace6cd71 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:21.331786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b1a66-16f7-4a45-8ce3-f582ae86b61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:21.332795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b1a66-16f7-4a45-8ce3-f582ae86b61c admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:21.333076 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b1a66-16f7-4a45-8ce3-f582ae86b61c admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:21.333347 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b1a66-16f7-4a45-8ce3-f582ae86b61c admin admin] PATH_INFO: `/v3/projects/b89ca38aa4b84165ab1b6ed7905eed10/users/ce0f96b96ee849a5bbfe009ac7a615c1/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:21.348467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b1a66-16f7-4a45-8ce3-f582ae86b61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b89ca38aa4b84165ab1b6ed7905eed10, user_id=ce0f96b96ee849a5bbfe009ac7a615c1, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:21.351304 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b1a66-16f7-4a45-8ce3-f582ae86b61c admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:21.354378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:21.496870 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1256/2515] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:21 2022] PUT /identity/v3/projects/b89ca38aa4b84165ab1b6ed7905eed10/users/ce0f96b96ee849a5bbfe009ac7a615c1/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:21.507157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855266d-06c5-42d9-beb7-0701b01e9114 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:21.507451 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855266d-06c5-42d9-beb7-0701b01e9114 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:21.507768 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855266d-06c5-42d9-beb7-0701b01e9114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:21.534842 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-1855266d-06c5-42d9-beb7-0701b01e9114 None None] MFA Rules not processed for user `ce0f96b96ee849a5bbfe009ac7a615c1`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:21.536089 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-1855266d-06c5-42d9-beb7-0701b01e9114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:21.627161 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1260/2516] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:21.631885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b1a66-16f7-4a45-8ce3-f582ae86b61c admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:21.710081 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b1a66-16f7-4a45-8ce3-f582ae86b61c admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:21.715195 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf7aa9-ad69-4feb-ac42-e81389a92968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:21.715917 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf7aa9-ad69-4feb-ac42-e81389a92968 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:21.716196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf7aa9-ad69-4feb-ac42-e81389a92968 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:21.716473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf7aa9-ad69-4feb-ac42-e81389a92968 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:21.717162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf7aa9-ad69-4feb-ac42-e81389a92968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:21.720099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf7aa9-ad69-4feb-ac42-e81389a92968 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:21.823270 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1257/2517] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:57:21 2022] POST /identity/v3/projects => generated 363 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:21.827307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855266d-06c5-42d9-beb7-0701b01e9114 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:21.838904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855266d-06c5-42d9-beb7-0701b01e9114 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:21.922553 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adf56d-ebd3-4ad3-935f-779bd0420f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:21.923255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adf56d-ebd3-4ad3-935f-779bd0420f2b admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:21.923563 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adf56d-ebd3-4ad3-935f-779bd0420f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:21.923848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adf56d-ebd3-4ad3-935f-779bd0420f2b admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:21.924700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adf56d-ebd3-4ad3-935f-779bd0420f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:21.926898 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adf56d-ebd3-4ad3-935f-779bd0420f2b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:22.086861 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1261/2518] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:57:21 2022] POST /identity/v3/users => generated 288 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:22.090832 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf7aa9-ad69-4feb-ac42-e81389a92968 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:22.100817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf7aa9-ad69-4feb-ac42-e81389a92968 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:22.105613 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615650d-6faf-44ed-9b0d-efbd80ca8ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:22.112801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615650d-6faf-44ed-9b0d-efbd80ca8ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:22.112801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615650d-6faf-44ed-9b0d-efbd80ca8ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:22.112801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0615650d-6faf-44ed-9b0d-efbd80ca8ec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:22.112801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615650d-6faf-44ed-9b0d-efbd80ca8ec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:22.112801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0615650d-6faf-44ed-9b0d-efbd80ca8ec7 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:22.119374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1258/2519] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:22.123361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adf56d-ebd3-4ad3-935f-779bd0420f2b admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:22.135314 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adf56d-ebd3-4ad3-935f-779bd0420f2b admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:22.140025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cbc63-e4e8-4b10-8d84-398e100f1e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:22.140907 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cbc63-e4e8-4b10-8d84-398e100f1e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:22.141834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cbc63-e4e8-4b10-8d84-398e100f1e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:22.142112 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1cbc63-e4e8-4b10-8d84-398e100f1e45 admin admin] PATH_INFO: `/v3/projects/f0f2f9b3874f44a888616dab75f05baf/users/aee05cb047444f6ab9c787f96777e302/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:22.157475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cbc63-e4e8-4b10-8d84-398e100f1e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f2f9b3874f44a888616dab75f05baf, user_id=aee05cb047444f6ab9c787f96777e302, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:22.160406 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1cbc63-e4e8-4b10-8d84-398e100f1e45 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:22.256567 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1262/2520] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:22 2022] PUT /identity/v3/projects/f0f2f9b3874f44a888616dab75f05baf/users/aee05cb047444f6ab9c787f96777e302/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:22.260595 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615650d-6faf-44ed-9b0d-efbd80ca8ec7 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:22.270473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0615650d-6faf-44ed-9b0d-efbd80ca8ec7 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:22.328024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ac646-24bc-46d5-b5de-87472c34f07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:22.328761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ac646-24bc-46d5-b5de-87472c34f07b admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:22.329047 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ac646-24bc-46d5-b5de-87472c34f07b admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:22.329329 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ac646-24bc-46d5-b5de-87472c34f07b admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:22.330071 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ac646-24bc-46d5-b5de-87472c34f07b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:22.331761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ac646-24bc-46d5-b5de-87472c34f07b admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:22.341550 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1259/2521] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:22.345724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cbc63-e4e8-4b10-8d84-398e100f1e45 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:22.356471 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1cbc63-e4e8-4b10-8d84-398e100f1e45 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:22.361827 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52e2974-30c8-446e-bb35-c1f407061556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:22.362694 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e2974-30c8-446e-bb35-c1f407061556 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:22.363022 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e2974-30c8-446e-bb35-c1f407061556 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:22.363296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52e2974-30c8-446e-bb35-c1f407061556 admin admin] PATH_INFO: `/v3/projects/f0f2f9b3874f44a888616dab75f05baf/users/aee05cb047444f6ab9c787f96777e302/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:22.365450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e2974-30c8-446e-bb35-c1f407061556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f2f9b3874f44a888616dab75f05baf, user_id=aee05cb047444f6ab9c787f96777e302, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:22.368300 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52e2974-30c8-446e-bb35-c1f407061556 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:22.379961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1263/2522] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:22 2022] PUT /identity/v3/projects/f0f2f9b3874f44a888616dab75f05baf/users/aee05cb047444f6ab9c787f96777e302/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:22.390827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771889d9-20e7-489e-b914-dee3a863ba14 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:22.391123 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771889d9-20e7-489e-b914-dee3a863ba14 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:22.391440 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771889d9-20e7-489e-b914-dee3a863ba14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:22.418463 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-771889d9-20e7-489e-b914-dee3a863ba14 None None] MFA Rules not processed for user `aee05cb047444f6ab9c787f96777e302`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:22.426304 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-771889d9-20e7-489e-b914-dee3a863ba14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:22.469893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:22.492014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1260/2523] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:22 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:22.499047 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78576785-41ea-4441-908e-8358c51b7da8 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:22.499368 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78576785-41ea-4441-908e-8358c51b7da8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:22.499682 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78576785-41ea-4441-908e-8358c51b7da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:22.506842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771889d9-20e7-489e-b914-dee3a863ba14 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:22.508284 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-771889d9-20e7-489e-b914-dee3a863ba14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:22.518748 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-78576785-41ea-4441-908e-8358c51b7da8 None None] MFA Rules not processed for user `77773d40a7a940819a99d11055439333`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:22.521173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-78576785-41ea-4441-908e-8358c51b7da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:22.551445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:22.575977 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771889d9-20e7-489e-b914-dee3a863ba14 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:22.580666 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1264/2524] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:22.580829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf2a57-ed8d-45bf-9d23-c989bf9781e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:22.580829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf2a57-ed8d-45bf-9d23-c989bf9781e0 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:22.580829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf2a57-ed8d-45bf-9d23-c989bf9781e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:22.581134 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf2a57-ed8d-45bf-9d23-c989bf9781e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:22.590744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf2a57-ed8d-45bf-9d23-c989bf9781e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:22.592654 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf2a57-ed8d-45bf-9d23-c989bf9781e0 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:22.602940 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1261/2525] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:22 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:57:22.801073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78576785-41ea-4441-908e-8358c51b7da8 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:22.810708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78576785-41ea-4441-908e-8358c51b7da8 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:22.814254 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db841e7-88b1-4cab-9c6f-33e85d326f4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:22.814894 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db841e7-88b1-4cab-9c6f-33e85d326f4e service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:22.815181 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db841e7-88b1-4cab-9c6f-33e85d326f4e service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:22.815461 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db841e7-88b1-4cab-9c6f-33e85d326f4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:22.874299 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db841e7-88b1-4cab-9c6f-33e85d326f4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:22.875707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db841e7-88b1-4cab-9c6f-33e85d326f4e service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:22.884936 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1265/2526] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:22 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:25.999300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aa1af-d7f4-4dd6-9c54-ee641c3cb591 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:26.000268 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aa1af-d7f4-4dd6-9c54-ee641c3cb591 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:26.000779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519aa1af-d7f4-4dd6-9c54-ee641c3cb591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:26.022214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-519aa1af-d7f4-4dd6-9c54-ee641c3cb591 None None] MFA Rules not processed for user `6e6313c444eb4a788b6559eff17959f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:26.023484 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-519aa1af-d7f4-4dd6-9c54-ee641c3cb591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:26.081185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1262/2527] 10.222.0.36 () {58 vars in 1009 bytes} [Mon Jun 27 18:57:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:26.094042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db841e7-88b1-4cab-9c6f-33e85d326f4e service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:26.095477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5db841e7-88b1-4cab-9c6f-33e85d326f4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:26.165307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db841e7-88b1-4cab-9c6f-33e85d326f4e service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:26.170418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af1c62-a0d7-401b-88a6-9cbc3f3e9064 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94555ff897d94c90968c470d82ff9e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:26.171004 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af1c62-a0d7-401b-88a6-9cbc3f3e9064 service swift] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:26.171298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af1c62-a0d7-401b-88a6-9cbc3f3e9064 service swift] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:26.171606 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af1c62-a0d7-401b-88a6-9cbc3f3e9064 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:26.180758 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af1c62-a0d7-401b-88a6-9cbc3f3e9064 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:26.182688 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af1c62-a0d7-401b-88a6-9cbc3f3e9064 service swift] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:26.195702 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1266/2528] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jun 27 18:57:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 18:57:26.681197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519aa1af-d7f4-4dd6-9c54-ee641c3cb591 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:26.744892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519aa1af-d7f4-4dd6-9c54-ee641c3cb591 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:26.749455 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48953014-fbb5-4cc7-ba49-e516b34f3dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:26.750335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48953014-fbb5-4cc7-ba49-e516b34f3dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:26.750622 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48953014-fbb5-4cc7-ba49-e516b34f3dca admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:26.750929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48953014-fbb5-4cc7-ba49-e516b34f3dca admin admin] PATH_INFO: `/v3/users/ce0f96b96ee849a5bbfe009ac7a615c1` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:26.752179 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48953014-fbb5-4cc7-ba49-e516b34f3dca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce0f96b96ee849a5bbfe009ac7a615c1)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:26.754111 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48953014-fbb5-4cc7-ba49-e516b34f3dca admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:26.927666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:26.933329 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-48953014-fbb5-4cc7-ba49-e516b34f3dca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce0f96b96ee849a5bbfe009ac7a615c1'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:26.981286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-48953014-fbb5-4cc7-ba49-e516b34f3dca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce0f96b96ee849a5bbfe009ac7a615c1'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:26.994201 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-48953014-fbb5-4cc7-ba49-e516b34f3dca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce0f96b96ee849a5bbfe009ac7a615c1'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:27.001261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-48953014-fbb5-4cc7-ba49-e516b34f3dca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce0f96b96ee849a5bbfe009ac7a615c1'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:27.001942 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-48953014-fbb5-4cc7-ba49-e516b34f3dca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce0f96b96ee849a5bbfe009ac7a615c1'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:27.008011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1263/2529] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:57:26 2022] DELETE /identity/v3/users/ce0f96b96ee849a5bbfe009ac7a615c1 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:27.015488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9da0fa-4494-4733-b33d-b8261dbf3a27 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:27.015817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9da0fa-4494-4733-b33d-b8261dbf3a27 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:27.016102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9da0fa-4494-4733-b33d-b8261dbf3a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:27.034231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-5c9da0fa-4494-4733-b33d-b8261dbf3a27 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:27.035446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5c9da0fa-4494-4733-b33d-b8261dbf3a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:27.093699 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1267/2530] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:27.103262 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48953014-fbb5-4cc7-ba49-e516b34f3dca admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:27.104989 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-48953014-fbb5-4cc7-ba49-e516b34f3dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:27.162512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48953014-fbb5-4cc7-ba49-e516b34f3dca admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:27.166089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368903c-3aae-43c5-96bf-56aaf5ec4c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:27.166721 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368903c-3aae-43c5-96bf-56aaf5ec4c7a service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:27.167035 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368903c-3aae-43c5-96bf-56aaf5ec4c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:27.167303 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368903c-3aae-43c5-96bf-56aaf5ec4c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:27.176484 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368903c-3aae-43c5-96bf-56aaf5ec4c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:27.177903 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368903c-3aae-43c5-96bf-56aaf5ec4c7a service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:27.187198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1264/2531] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:27.630912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9da0fa-4494-4733-b33d-b8261dbf3a27 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:27.632798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5c9da0fa-4494-4733-b33d-b8261dbf3a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:27.649343 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9da0fa-4494-4733-b33d-b8261dbf3a27 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:27.655151 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:27.656090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:27.656383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:27.660034 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3 admin admin] PATH_INFO: `/v3/projects/b89ca38aa4b84165ab1b6ed7905eed10` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:27.661526 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b89ca38aa4b84165ab1b6ed7905eed10)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:27.665180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:27.676803 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:27.811371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b89ca38aa4b84165ab1b6ed7905eed10', 'request_id': 'req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:27.856092 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b89ca38aa4b84165ab1b6ed7905eed10', 'request_id': 'req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:27.867468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b89ca38aa4b84165ab1b6ed7905eed10', 'request_id': 'req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:27.885605 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3 admin admin] The token cache is being invalidate because project b89ca38aa4b84165ab1b6ed7905eed10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:57:27.885915 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:27.886963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:27.889262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1268/2532] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:57:27 2022] DELETE /identity/v3/projects/b89ca38aa4b84165ab1b6ed7905eed10 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:27.894282 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368903c-3aae-43c5-96bf-56aaf5ec4c7a service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:27.907031 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368903c-3aae-43c5-96bf-56aaf5ec4c7a service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:27.971175 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37614093-9b1c-4f2b-9a66-b72120f93816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:27.972089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37614093-9b1c-4f2b-9a66-b72120f93816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:27.972376 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37614093-9b1c-4f2b-9a66-b72120f93816 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:27.972657 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37614093-9b1c-4f2b-9a66-b72120f93816 admin admin] PATH_INFO: `/v3/users/aee05cb047444f6ab9c787f96777e302` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:27.973858 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37614093-9b1c-4f2b-9a66-b72120f93816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee05cb047444f6ab9c787f96777e302)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:27.975838 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37614093-9b1c-4f2b-9a66-b72120f93816 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:28.215906 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-37614093-9b1c-4f2b-9a66-b72120f93816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee05cb047444f6ab9c787f96777e302'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:28.267490 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-37614093-9b1c-4f2b-9a66-b72120f93816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee05cb047444f6ab9c787f96777e302'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:28.278274 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:28.286947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-37614093-9b1c-4f2b-9a66-b72120f93816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee05cb047444f6ab9c787f96777e302'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:28.315257 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-37614093-9b1c-4f2b-9a66-b72120f93816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee05cb047444f6ab9c787f96777e302'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:28.316579 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-37614093-9b1c-4f2b-9a66-b72120f93816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee05cb047444f6ab9c787f96777e302'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:28.329743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1265/2533] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:57:27 2022] DELETE /identity/v3/users/aee05cb047444f6ab9c787f96777e302 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:29.496439 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:29.499806 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:29.543049 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29416c-0ff8-4b12-8b98-efc7ad1530b3 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:29.676584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04231241-afec-4974-aa69-ac3ddd7502ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:29.677917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04231241-afec-4974-aa69-ac3ddd7502ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:29.678377 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04231241-afec-4974-aa69-ac3ddd7502ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:29.678891 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04231241-afec-4974-aa69-ac3ddd7502ea admin admin] PATH_INFO: `/v3/projects/f0f2f9b3874f44a888616dab75f05baf` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:29.680527 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04231241-afec-4974-aa69-ac3ddd7502ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f2f9b3874f44a888616dab75f05baf)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:29.683055 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04231241-afec-4974-aa69-ac3ddd7502ea admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:29.856163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-04231241-afec-4974-aa69-ac3ddd7502ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f2f9b3874f44a888616dab75f05baf', 'request_id': 'req-04231241-afec-4974-aa69-ac3ddd7502ea'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:30.129830 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-04231241-afec-4974-aa69-ac3ddd7502ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f2f9b3874f44a888616dab75f05baf', 'request_id': 'req-04231241-afec-4974-aa69-ac3ddd7502ea'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:30.129830 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-04231241-afec-4974-aa69-ac3ddd7502ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f2f9b3874f44a888616dab75f05baf', 'request_id': 'req-04231241-afec-4974-aa69-ac3ddd7502ea'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:30.129830 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-04231241-afec-4974-aa69-ac3ddd7502ea admin admin] The token cache is being invalidate because project f0f2f9b3874f44a888616dab75f05baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:57:30.129830 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-04231241-afec-4974-aa69-ac3ddd7502ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:30.130364 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-04231241-afec-4974-aa69-ac3ddd7502ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:30.130364 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1269/2534] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:57:29 2022] DELETE /identity/v3/projects/f0f2f9b3874f44a888616dab75f05baf => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:30.130549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4938-9c98-477b-8d63-c8ecdb35e23f None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:30.130549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4938-9c98-477b-8d63-c8ecdb35e23f None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:30.130549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf4938-9c98-477b-8d63-c8ecdb35e23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:30.130549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-d8cf4938-9c98-477b-8d63-c8ecdb35e23f None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:30.130549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-d8cf4938-9c98-477b-8d63-c8ecdb35e23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:30.306240 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1266/2535] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:30.306460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf8ce9-5dd5-4a59-a01f-1ded312cafc6 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:30.306460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf8ce9-5dd5-4a59-a01f-1ded312cafc6 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:30.306460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf8ce9-5dd5-4a59-a01f-1ded312cafc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:30.360783 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-12bf8ce9-5dd5-4a59-a01f-1ded312cafc6 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:30.363890 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-12bf8ce9-5dd5-4a59-a01f-1ded312cafc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:30.397586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1270/2536] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:57:30.402186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf4938-9c98-477b-8d63-c8ecdb35e23f None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:30.429508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf4938-9c98-477b-8d63-c8ecdb35e23f None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:30.443334 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a43aa6-cc2f-4757-a606-ea7de712f9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:30.444946 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a43aa6-cc2f-4757-a606-ea7de712f9bf admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:30.445464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a43aa6-cc2f-4757-a606-ea7de712f9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:30.446375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a43aa6-cc2f-4757-a606-ea7de712f9bf admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:30.447974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a43aa6-cc2f-4757-a606-ea7de712f9bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:57:30.450750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a43aa6-cc2f-4757-a606-ea7de712f9bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:30.455300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a43aa6-cc2f-4757-a606-ea7de712f9bf admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:30.502957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1267/2537] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:57:30.511253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf8ce9-5dd5-4a59-a01f-1ded312cafc6 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:30.521769 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf8ce9-5dd5-4a59-a01f-1ded312cafc6 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:30.552402 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb8582-3afe-4c5e-a30c-87fc2fc1203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:30.552952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb8582-3afe-4c5e-a30c-87fc2fc1203a admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:30.553778 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb8582-3afe-4c5e-a30c-87fc2fc1203a admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:30.554088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb8582-3afe-4c5e-a30c-87fc2fc1203a admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:30.554858 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb8582-3afe-4c5e-a30c-87fc2fc1203a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:30.558330 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb8582-3afe-4c5e-a30c-87fc2fc1203a admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:30.597908 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:30.669807 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1271/2538] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:57:30 2022] POST /identity/v3/projects => generated 391 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:30.673603 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a43aa6-cc2f-4757-a606-ea7de712f9bf admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:30.687403 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a43aa6-cc2f-4757-a606-ea7de712f9bf admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:30.789900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fde60-8e05-4dcb-b9c9-4563ae0e30c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:30.790701 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fde60-8e05-4dcb-b9c9-4563ae0e30c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:30.791196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fde60-8e05-4dcb-b9c9-4563ae0e30c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:30.791557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fde60-8e05-4dcb-b9c9-4563ae0e30c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:30.795188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fde60-8e05-4dcb-b9c9-4563ae0e30c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:30.801120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fde60-8e05-4dcb-b9c9-4563ae0e30c7 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:30.899918 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1268/2539] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:57:30 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:57:30.900990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb8582-3afe-4c5e-a30c-87fc2fc1203a admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:30.915218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb8582-3afe-4c5e-a30c-87fc2fc1203a admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:30.924985 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c307d32-14df-4661-bf99-53b025c70664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:30.925686 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c307d32-14df-4661-bf99-53b025c70664 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:30.925971 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c307d32-14df-4661-bf99-53b025c70664 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:30.926248 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c307d32-14df-4661-bf99-53b025c70664 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:30.926998 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c307d32-14df-4661-bf99-53b025c70664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:30.936427 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c307d32-14df-4661-bf99-53b025c70664 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:30.963173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1272/2540] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:30.967643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fde60-8e05-4dcb-b9c9-4563ae0e30c7 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:30.991257 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fde60-8e05-4dcb-b9c9-4563ae0e30c7 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:31.001692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ae6c6-b4a9-4f3f-8d86-02409c713ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:31.002437 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ae6c6-b4a9-4f3f-8d86-02409c713ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:31.002879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ae6c6-b4a9-4f3f-8d86-02409c713ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:31.003166 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ae6c6-b4a9-4f3f-8d86-02409c713ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:31.003956 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ae6c6-b4a9-4f3f-8d86-02409c713ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:31.016270 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ae6c6-b4a9-4f3f-8d86-02409c713ef2 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:31.038592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1269/2541] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:31.039192 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c307d32-14df-4661-bf99-53b025c70664 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:31.059950 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c307d32-14df-4661-bf99-53b025c70664 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:31.065387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899f5bb-b3ad-4cf1-8cda-078bd3cdc8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:31.066374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899f5bb-b3ad-4cf1-8cda-078bd3cdc8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:31.066795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899f5bb-b3ad-4cf1-8cda-078bd3cdc8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:31.067143 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899f5bb-b3ad-4cf1-8cda-078bd3cdc8bc admin admin] PATH_INFO: `/v3/projects/0422cb096c0549e29254a2d65c79698c/users/119cc506c05f4f7ab0164efbd8443023/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:31.092470 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899f5bb-b3ad-4cf1-8cda-078bd3cdc8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0422cb096c0549e29254a2d65c79698c, user_id=119cc506c05f4f7ab0164efbd8443023, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:31.098768 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899f5bb-b3ad-4cf1-8cda-078bd3cdc8bc admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:31.212556 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1273/2542] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:31 2022] PUT /identity/v3/projects/0422cb096c0549e29254a2d65c79698c/users/119cc506c05f4f7ab0164efbd8443023/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:31.223918 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54984c9-d7f3-45ad-a5f8-dae52009c2dc None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:31.224929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54984c9-d7f3-45ad-a5f8-dae52009c2dc None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:31.225603 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54984c9-d7f3-45ad-a5f8-dae52009c2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:31.278535 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-f54984c9-d7f3-45ad-a5f8-dae52009c2dc None None] MFA Rules not processed for user `119cc506c05f4f7ab0164efbd8443023`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:31.279885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f54984c9-d7f3-45ad-a5f8-dae52009c2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:31.322040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:31.368315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1270/2543] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:31.373251 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899f5bb-b3ad-4cf1-8cda-078bd3cdc8bc admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:31.527105 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899f5bb-b3ad-4cf1-8cda-078bd3cdc8bc admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:31.540751 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dac928-1479-4c9c-856a-4b47f75e5b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:31.542134 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dac928-1479-4c9c-856a-4b47f75e5b9a admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:31.552521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dac928-1479-4c9c-856a-4b47f75e5b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:31.552521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dac928-1479-4c9c-856a-4b47f75e5b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:31.552521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dac928-1479-4c9c-856a-4b47f75e5b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:31.553907 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dac928-1479-4c9c-856a-4b47f75e5b9a admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:31.697744 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1274/2544] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:57:31 2022] POST /identity/v3/projects => generated 391 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:31.701870 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54984c9-d7f3-45ad-a5f8-dae52009c2dc None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:31.727237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54984c9-d7f3-45ad-a5f8-dae52009c2dc None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:31.878683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7439a-59e6-49bb-9964-3e12edbe65fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:31.880692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7439a-59e6-49bb-9964-3e12edbe65fc admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:31.881388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7439a-59e6-49bb-9964-3e12edbe65fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:31.881759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7439a-59e6-49bb-9964-3e12edbe65fc admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:31.883518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7439a-59e6-49bb-9964-3e12edbe65fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:31.885778 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7439a-59e6-49bb-9964-3e12edbe65fc admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:32.021889 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1271/2545] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:57:31 2022] POST /identity/v3/users => generated 302 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:32.024197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dac928-1479-4c9c-856a-4b47f75e5b9a admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:32.042146 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dac928-1479-4c9c-856a-4b47f75e5b9a admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:32.047503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89242161-995a-4c0c-81fc-28aada9d8953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:32.048253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89242161-995a-4c0c-81fc-28aada9d8953 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:32.048607 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89242161-995a-4c0c-81fc-28aada9d8953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:32.048936 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89242161-995a-4c0c-81fc-28aada9d8953 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:32.049754 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89242161-995a-4c0c-81fc-28aada9d8953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:32.051510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89242161-995a-4c0c-81fc-28aada9d8953 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:32.076183 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1275/2546] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:32.080979 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7439a-59e6-49bb-9964-3e12edbe65fc admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:32.121904 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7439a-59e6-49bb-9964-3e12edbe65fc admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:32.135723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b966f-8235-40af-a00d-193ff374dad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:32.135954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b966f-8235-40af-a00d-193ff374dad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:32.136119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b966f-8235-40af-a00d-193ff374dad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:32.136402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b966f-8235-40af-a00d-193ff374dad1 admin admin] PATH_INFO: `/v3/projects/04551066ee094dfcb7304b19d95d8880/users/c7852269220a42d0a8ac3f193d85edab/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:32.155276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b966f-8235-40af-a00d-193ff374dad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04551066ee094dfcb7304b19d95d8880, user_id=c7852269220a42d0a8ac3f193d85edab, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:32.159486 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b966f-8235-40af-a00d-193ff374dad1 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:32.254116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1272/2547] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:32 2022] PUT /identity/v3/projects/04551066ee094dfcb7304b19d95d8880/users/c7852269220a42d0a8ac3f193d85edab/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:32.258484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89242161-995a-4c0c-81fc-28aada9d8953 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:32.274267 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89242161-995a-4c0c-81fc-28aada9d8953 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:32.355292 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb839c-67bb-409f-bc33-91f607e81cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:32.356517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb839c-67bb-409f-bc33-91f607e81cee admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:32.357201 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb839c-67bb-409f-bc33-91f607e81cee admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:32.357559 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb839c-67bb-409f-bc33-91f607e81cee admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:32.358499 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb839c-67bb-409f-bc33-91f607e81cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:32.360315 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb839c-67bb-409f-bc33-91f607e81cee admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:32.375724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1276/2548] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:57:32.378554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b966f-8235-40af-a00d-193ff374dad1 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:32.394112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b966f-8235-40af-a00d-193ff374dad1 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:32.401710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfab99f-acf3-4348-ba64-af5da83927f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:32.403210 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfab99f-acf3-4348-ba64-af5da83927f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:32.403746 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfab99f-acf3-4348-ba64-af5da83927f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:32.404208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfab99f-acf3-4348-ba64-af5da83927f5 admin admin] PATH_INFO: `/v3/projects/04551066ee094dfcb7304b19d95d8880/users/c7852269220a42d0a8ac3f193d85edab/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:32.406974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfab99f-acf3-4348-ba64-af5da83927f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04551066ee094dfcb7304b19d95d8880, user_id=c7852269220a42d0a8ac3f193d85edab, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:32.411250 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfab99f-acf3-4348-ba64-af5da83927f5 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:32.425378 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1273/2549] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:32 2022] PUT /identity/v3/projects/04551066ee094dfcb7304b19d95d8880/users/c7852269220a42d0a8ac3f193d85edab/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:32.437276 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b42b7-1b23-488d-9f67-f02840e32253 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:32.438018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b42b7-1b23-488d-9f67-f02840e32253 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:32.438664 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b42b7-1b23-488d-9f67-f02840e32253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:32.494993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-df2b42b7-1b23-488d-9f67-f02840e32253 None None] MFA Rules not processed for user `c7852269220a42d0a8ac3f193d85edab`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:32.496294 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-df2b42b7-1b23-488d-9f67-f02840e32253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:32.533286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:32.628660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1277/2550] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:32.665437 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfab99f-acf3-4348-ba64-af5da83927f5 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:32.673163 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-0bfab99f-acf3-4348-ba64-af5da83927f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:32.791114 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfab99f-acf3-4348-ba64-af5da83927f5 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:32.808470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ad705-301a-4649-9cbb-e543eac0adb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:32.809196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ad705-301a-4649-9cbb-e543eac0adb8 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:32.809511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ad705-301a-4649-9cbb-e543eac0adb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:32.809790 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ad705-301a-4649-9cbb-e543eac0adb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:32.837790 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ad705-301a-4649-9cbb-e543eac0adb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:32.839416 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ad705-301a-4649-9cbb-e543eac0adb8 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:32.861544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1274/2551] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:32.940730 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b42b7-1b23-488d-9f67-f02840e32253 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:32.942296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-df2b42b7-1b23-488d-9f67-f02840e32253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:32.962173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b42b7-1b23-488d-9f67-f02840e32253 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:32.971492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea377c5-b904-4c68-a5ce-0db31ced9835 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:32.972193 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea377c5-b904-4c68-a5ce-0db31ced9835 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:32.972563 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea377c5-b904-4c68-a5ce-0db31ced9835 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:32.972845 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea377c5-b904-4c68-a5ce-0db31ced9835 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:33.058769 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea377c5-b904-4c68-a5ce-0db31ced9835 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:33.060505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea377c5-b904-4c68-a5ce-0db31ced9835 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:33.074236 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1278/2552] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:36.126109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ad705-301a-4649-9cbb-e543eac0adb8 service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:36.128182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-d32ad705-301a-4649-9cbb-e543eac0adb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:36.164642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:36.187737 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ad705-301a-4649-9cbb-e543eac0adb8 service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:36.191987 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d5767-945d-420b-8d4b-17e715d038f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:36.192623 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d5767-945d-420b-8d4b-17e715d038f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:36.192909 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d5767-945d-420b-8d4b-17e715d038f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:36.193182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d5767-945d-420b-8d4b-17e715d038f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:36.194931 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-824d5767-945d-420b-8d4b-17e715d038f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:36.258341 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d5767-945d-420b-8d4b-17e715d038f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:36.259821 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d5767-945d-420b-8d4b-17e715d038f8 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:36.269970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1275/2553] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:38.341163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea377c5-b904-4c68-a5ce-0db31ced9835 service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:38.357073 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea377c5-b904-4c68-a5ce-0db31ced9835 service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:38.365320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721d102-9d5f-47a4-8ae9-f302abcaf753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:38.367469 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721d102-9d5f-47a4-8ae9-f302abcaf753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:38.368001 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721d102-9d5f-47a4-8ae9-f302abcaf753 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:38.368492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721d102-9d5f-47a4-8ae9-f302abcaf753 admin admin] PATH_INFO: `/v3/users/119cc506c05f4f7ab0164efbd8443023` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:38.370122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721d102-9d5f-47a4-8ae9-f302abcaf753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=119cc506c05f4f7ab0164efbd8443023)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:38.372383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721d102-9d5f-47a4-8ae9-f302abcaf753 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:38.580296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0721d102-9d5f-47a4-8ae9-f302abcaf753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '119cc506c05f4f7ab0164efbd8443023'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:38.672425 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0721d102-9d5f-47a4-8ae9-f302abcaf753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '119cc506c05f4f7ab0164efbd8443023'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:38.686250 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0721d102-9d5f-47a4-8ae9-f302abcaf753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '119cc506c05f4f7ab0164efbd8443023'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:38.688113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0721d102-9d5f-47a4-8ae9-f302abcaf753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '119cc506c05f4f7ab0164efbd8443023'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:38.694422 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0721d102-9d5f-47a4-8ae9-f302abcaf753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '119cc506c05f4f7ab0164efbd8443023'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:38.700804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1279/2554] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:57:38 2022] DELETE /identity/v3/users/119cc506c05f4f7ab0164efbd8443023 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:38.705225 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e790a-b9df-409f-adc9-a511a847a10b None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:38.706267 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e790a-b9df-409f-adc9-a511a847a10b None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:38.706267 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e790a-b9df-409f-adc9-a511a847a10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:38.724873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-872e790a-b9df-409f-adc9-a511a847a10b None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:38.726017 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-872e790a-b9df-409f-adc9-a511a847a10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:38.796889 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1276/2555] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:57:38.810208 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721d102-9d5f-47a4-8ae9-f302abcaf753 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:38.811741 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0721d102-9d5f-47a4-8ae9-f302abcaf753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:38.845182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:38.886478 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721d102-9d5f-47a4-8ae9-f302abcaf753 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:38.890233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef7996-e138-403c-8e92-e7c2248ce279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:38.890895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef7996-e138-403c-8e92-e7c2248ce279 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:38.891181 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef7996-e138-403c-8e92-e7c2248ce279 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:38.891460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef7996-e138-403c-8e92-e7c2248ce279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:38.901556 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef7996-e138-403c-8e92-e7c2248ce279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:38.903116 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef7996-e138-403c-8e92-e7c2248ce279 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:38.913486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1280/2556] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:39.366669 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e790a-b9df-409f-adc9-a511a847a10b None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:39.373306 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-872e790a-b9df-409f-adc9-a511a847a10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:39.386926 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e790a-b9df-409f-adc9-a511a847a10b None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:39.400856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6494186-3ec7-4f4c-b776-c56835cd72f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:39.403420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6494186-3ec7-4f4c-b776-c56835cd72f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:39.403420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6494186-3ec7-4f4c-b776-c56835cd72f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:39.403420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6494186-3ec7-4f4c-b776-c56835cd72f6 admin admin] PATH_INFO: `/v3/projects/0422cb096c0549e29254a2d65c79698c` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:39.403881 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6494186-3ec7-4f4c-b776-c56835cd72f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0422cb096c0549e29254a2d65c79698c)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:39.408642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6494186-3ec7-4f4c-b776-c56835cd72f6 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:39.612196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f6494186-3ec7-4f4c-b776-c56835cd72f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0422cb096c0549e29254a2d65c79698c', 'request_id': 'req-f6494186-3ec7-4f4c-b776-c56835cd72f6'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:39.620489 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f6494186-3ec7-4f4c-b776-c56835cd72f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0422cb096c0549e29254a2d65c79698c', 'request_id': 'req-f6494186-3ec7-4f4c-b776-c56835cd72f6'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:39.724611 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f6494186-3ec7-4f4c-b776-c56835cd72f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0422cb096c0549e29254a2d65c79698c', 'request_id': 'req-f6494186-3ec7-4f4c-b776-c56835cd72f6'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:39.737444 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f6494186-3ec7-4f4c-b776-c56835cd72f6 admin admin] The token cache is being invalidate because project 0422cb096c0549e29254a2d65c79698c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:57:39.737998 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f6494186-3ec7-4f4c-b776-c56835cd72f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:39.738912 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f6494186-3ec7-4f4c-b776-c56835cd72f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:39.744066 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1277/2557] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:57:39 2022] DELETE /identity/v3/projects/0422cb096c0549e29254a2d65c79698c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:39.748252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef7996-e138-403c-8e92-e7c2248ce279 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:39.760775 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef7996-e138-403c-8e92-e7c2248ce279 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:39.832695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106f7ec-ed50-4e32-bba8-13b0036a25d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:39.834140 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106f7ec-ed50-4e32-bba8-13b0036a25d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:39.834773 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106f7ec-ed50-4e32-bba8-13b0036a25d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:39.835376 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106f7ec-ed50-4e32-bba8-13b0036a25d6 admin admin] PATH_INFO: `/v3/users/c7852269220a42d0a8ac3f193d85edab` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:39.836926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106f7ec-ed50-4e32-bba8-13b0036a25d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7852269220a42d0a8ac3f193d85edab)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:39.839246 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2106f7ec-ed50-4e32-bba8-13b0036a25d6 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:40.077233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2106f7ec-ed50-4e32-bba8-13b0036a25d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7852269220a42d0a8ac3f193d85edab'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:40.170452 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2106f7ec-ed50-4e32-bba8-13b0036a25d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7852269220a42d0a8ac3f193d85edab'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:40.185808 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2106f7ec-ed50-4e32-bba8-13b0036a25d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7852269220a42d0a8ac3f193d85edab'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:40.186990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2106f7ec-ed50-4e32-bba8-13b0036a25d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7852269220a42d0a8ac3f193d85edab'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:40.200221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2106f7ec-ed50-4e32-bba8-13b0036a25d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7852269220a42d0a8ac3f193d85edab'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:40.210900 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1281/2558] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:57:39 2022] DELETE /identity/v3/users/c7852269220a42d0a8ac3f193d85edab => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:40.302344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6494186-3ec7-4f4c-b776-c56835cd72f6 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:40.304466 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f6494186-3ec7-4f4c-b776-c56835cd72f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:40.318675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:40.322523 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6494186-3ec7-4f4c-b776-c56835cd72f6 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:40.377193 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ec36d4-7437-4b98-8d5b-448d79451502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:40.378727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec36d4-7437-4b98-8d5b-448d79451502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:40.379009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec36d4-7437-4b98-8d5b-448d79451502 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:40.379285 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ec36d4-7437-4b98-8d5b-448d79451502 admin admin] PATH_INFO: `/v3/users/798c13c87b814d1182c6df3b29ec5986` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:40.380700 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec36d4-7437-4b98-8d5b-448d79451502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=798c13c87b814d1182c6df3b29ec5986)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:40.382960 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ec36d4-7437-4b98-8d5b-448d79451502 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:40.561495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e5ec36d4-7437-4b98-8d5b-448d79451502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '798c13c87b814d1182c6df3b29ec5986'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:40.646035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106f7ec-ed50-4e32-bba8-13b0036a25d6 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:40.647521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-2106f7ec-ed50-4e32-bba8-13b0036a25d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:40.661514 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e5ec36d4-7437-4b98-8d5b-448d79451502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '798c13c87b814d1182c6df3b29ec5986'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:40.668768 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106f7ec-ed50-4e32-bba8-13b0036a25d6 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:40.674159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3c047-2596-4431-99fb-6c95b0da9f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:40.675764 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3c047-2596-4431-99fb-6c95b0da9f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:40.676122 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3c047-2596-4431-99fb-6c95b0da9f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:40.676471 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d3c047-2596-4431-99fb-6c95b0da9f04 admin admin] PATH_INFO: `/v3/projects/04551066ee094dfcb7304b19d95d8880` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:40.678294 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3c047-2596-4431-99fb-6c95b0da9f04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04551066ee094dfcb7304b19d95d8880)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:40.680846 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d3c047-2596-4431-99fb-6c95b0da9f04 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:40.684312 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e5ec36d4-7437-4b98-8d5b-448d79451502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '798c13c87b814d1182c6df3b29ec5986'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:40.692992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e5ec36d4-7437-4b98-8d5b-448d79451502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '798c13c87b814d1182c6df3b29ec5986'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:40.694073 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e5ec36d4-7437-4b98-8d5b-448d79451502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '798c13c87b814d1182c6df3b29ec5986'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:40.702692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1278/2559] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:57:40 2022] DELETE /identity/v3/users/798c13c87b814d1182c6df3b29ec5986 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:40.786686 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:40.794051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-37d3c047-2596-4431-99fb-6c95b0da9f04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04551066ee094dfcb7304b19d95d8880', 'request_id': 'req-37d3c047-2596-4431-99fb-6c95b0da9f04'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:40.850017 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-37d3c047-2596-4431-99fb-6c95b0da9f04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04551066ee094dfcb7304b19d95d8880', 'request_id': 'req-37d3c047-2596-4431-99fb-6c95b0da9f04'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:40.857598 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-37d3c047-2596-4431-99fb-6c95b0da9f04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04551066ee094dfcb7304b19d95d8880', 'request_id': 'req-37d3c047-2596-4431-99fb-6c95b0da9f04'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:40.869698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-37d3c047-2596-4431-99fb-6c95b0da9f04 admin admin] The token cache is being invalidate because project 04551066ee094dfcb7304b19d95d8880 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:57:40.869987 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-37d3c047-2596-4431-99fb-6c95b0da9f04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:40.870630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-37d3c047-2596-4431-99fb-6c95b0da9f04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:40.872304 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1282/2560] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:57:40 2022] DELETE /identity/v3/projects/04551066ee094dfcb7304b19d95d8880 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:40.877383 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b3816-62d3-462b-9c76-0484444a5935 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:40.878112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b3816-62d3-462b-9c76-0484444a5935 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:40.878112 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b3816-62d3-462b-9c76-0484444a5935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:40.895635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-8f0b3816-62d3-462b-9c76-0484444a5935 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:40.896777 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-8f0b3816-62d3-462b-9c76-0484444a5935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:40.959502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1279/2561] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:57:40.969279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3c047-2596-4431-99fb-6c95b0da9f04 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:40.970723 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-37d3c047-2596-4431-99fb-6c95b0da9f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:40.977286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c540b-bdf6-47e9-b418-49839d126d6b None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:40.978783 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c540b-bdf6-47e9-b418-49839d126d6b None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:40.980116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c540b-bdf6-47e9-b418-49839d126d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:40.990742 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d3c047-2596-4431-99fb-6c95b0da9f04 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:40.996235 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71300f83-d459-497f-98d6-b16dd73a204b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:40.997523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71300f83-d459-497f-98d6-b16dd73a204b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:40.997995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71300f83-d459-497f-98d6-b16dd73a204b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:40.998471 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71300f83-d459-497f-98d6-b16dd73a204b admin admin] PATH_INFO: `/v3/projects/e261e06be6d94e129de3957985cb0ecd` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:40.999194 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-e91c540b-bdf6-47e9-b418-49839d126d6b None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:40.999701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71300f83-d459-497f-98d6-b16dd73a204b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e261e06be6d94e129de3957985cb0ecd)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:41.000438 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e91c540b-bdf6-47e9-b418-49839d126d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:41.001639 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71300f83-d459-497f-98d6-b16dd73a204b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:41.010929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1280/2562] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:41.015027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c540b-bdf6-47e9-b418-49839d126d6b None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:41.024695 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c540b-bdf6-47e9-b418-49839d126d6b None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:41.029443 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204d856-a298-45a3-918d-71aeaa2e7ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:41.030091 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204d856-a298-45a3-918d-71aeaa2e7ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:41.030377 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204d856-a298-45a3-918d-71aeaa2e7ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:41.030658 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204d856-a298-45a3-918d-71aeaa2e7ae1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:41.031411 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204d856-a298-45a3-918d-71aeaa2e7ae1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:57:41.031754 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204d856-a298-45a3-918d-71aeaa2e7ae1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:41.033371 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204d856-a298-45a3-918d-71aeaa2e7ae1 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:41.045509 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1281/2563] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:57:41.049669 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204d856-a298-45a3-918d-71aeaa2e7ae1 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:41.055481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:41.059241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204d856-a298-45a3-918d-71aeaa2e7ae1 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:41.063980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba17904-b8d7-4b03-959f-6214099924e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:41.064584 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba17904-b8d7-4b03-959f-6214099924e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:41.064864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba17904-b8d7-4b03-959f-6214099924e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:41.065208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba17904-b8d7-4b03-959f-6214099924e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:41.065906 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba17904-b8d7-4b03-959f-6214099924e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:41.067865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba17904-b8d7-4b03-959f-6214099924e1 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:41.124541 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-71300f83-d459-497f-98d6-b16dd73a204b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e261e06be6d94e129de3957985cb0ecd', 'request_id': 'req-71300f83-d459-497f-98d6-b16dd73a204b'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:41.165740 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1282/2564] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:57:41 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:57:41.169710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba17904-b8d7-4b03-959f-6214099924e1 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:41.181102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-71300f83-d459-497f-98d6-b16dd73a204b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e261e06be6d94e129de3957985cb0ecd', 'request_id': 'req-71300f83-d459-497f-98d6-b16dd73a204b'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:41.189332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-71300f83-d459-497f-98d6-b16dd73a204b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e261e06be6d94e129de3957985cb0ecd', 'request_id': 'req-71300f83-d459-497f-98d6-b16dd73a204b'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:41.202314 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-71300f83-d459-497f-98d6-b16dd73a204b admin admin] The token cache is being invalidate because project e261e06be6d94e129de3957985cb0ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:57:41.202605 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-71300f83-d459-497f-98d6-b16dd73a204b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:41.203283 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-71300f83-d459-497f-98d6-b16dd73a204b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:41.204869 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1283/2565] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:57:40 2022] DELETE /identity/v3/projects/e261e06be6d94e129de3957985cb0ecd => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:41.212590 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a5132-7893-46c6-9038-9a44f4811fad None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:41.219655 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a5132-7893-46c6-9038-9a44f4811fad None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:41.219655 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a5132-7893-46c6-9038-9a44f4811fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:41.232271 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-7c1a5132-7893-46c6-9038-9a44f4811fad None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:41.233634 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-7c1a5132-7893-46c6-9038-9a44f4811fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:41.241196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba17904-b8d7-4b03-959f-6214099924e1 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:41.242620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1284/2566] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:41.246256 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1b2c5-4d4f-451c-8a89-00591ffa2cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:41.246925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1b2c5-4d4f-451c-8a89-00591ffa2cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:41.247212 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1b2c5-4d4f-451c-8a89-00591ffa2cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:41.247494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da1b2c5-4d4f-451c-8a89-00591ffa2cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:41.248336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1b2c5-4d4f-451c-8a89-00591ffa2cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:41.250242 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da1b2c5-4d4f-451c-8a89-00591ffa2cd9 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:41.250692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85d7b4-a4ce-46a5-b4bf-955d2af51116 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:41.251079 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85d7b4-a4ce-46a5-b4bf-955d2af51116 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:41.251868 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85d7b4-a4ce-46a5-b4bf-955d2af51116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:41.274719 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-bf85d7b4-a4ce-46a5-b4bf-955d2af51116 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:41.276190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-bf85d7b4-a4ce-46a5-b4bf-955d2af51116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:41.285653 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1285/2567] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:57:41.290097 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85d7b4-a4ce-46a5-b4bf-955d2af51116 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:41.299674 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85d7b4-a4ce-46a5-b4bf-955d2af51116 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:41.304270 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890725c-9977-41ef-8988-0cdc4b9ef20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:41.304924 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890725c-9977-41ef-8988-0cdc4b9ef20c admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:41.305205 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890725c-9977-41ef-8988-0cdc4b9ef20c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:41.305480 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890725c-9977-41ef-8988-0cdc4b9ef20c admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:41.306204 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890725c-9977-41ef-8988-0cdc4b9ef20c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:57:41.306516 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890725c-9977-41ef-8988-0cdc4b9ef20c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:41.308167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890725c-9977-41ef-8988-0cdc4b9ef20c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:41.320691 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1286/2568] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:57:41.325035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890725c-9977-41ef-8988-0cdc4b9ef20c admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:41.335485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890725c-9977-41ef-8988-0cdc4b9ef20c admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:41.340356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b471655-3cea-4715-afb0-7d684bc49568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:41.431759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b471655-3cea-4715-afb0-7d684bc49568 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:41.431759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b471655-3cea-4715-afb0-7d684bc49568 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:41.431759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b471655-3cea-4715-afb0-7d684bc49568 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:41.431759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b471655-3cea-4715-afb0-7d684bc49568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:41.431759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b471655-3cea-4715-afb0-7d684bc49568 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:42.037655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1283/2569] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:57:41 2022] POST /identity/v3/users => generated 293 bytes in 865 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:57:42.040484 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1b2c5-4d4f-451c-8a89-00591ffa2cd9 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:42.042323 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9da1b2c5-4d4f-451c-8a89-00591ffa2cd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:42.055137 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da1b2c5-4d4f-451c-8a89-00591ffa2cd9 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:42.059660 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4eea63-a9fe-4050-a386-d0d15e243b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:42.060309 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eea63-a9fe-4050-a386-d0d15e243b38 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:42.060594 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eea63-a9fe-4050-a386-d0d15e243b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:42.060869 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4eea63-a9fe-4050-a386-d0d15e243b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:42.061595 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4eea63-a9fe-4050-a386-d0d15e243b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:42.063187 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4eea63-a9fe-4050-a386-d0d15e243b38 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:42.072859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1284/2570] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:57:42.076597 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4eea63-a9fe-4050-a386-d0d15e243b38 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:42.086481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4eea63-a9fe-4050-a386-d0d15e243b38 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:42.090938 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417f892-e541-4b04-823f-ee39260e8067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:42.091599 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417f892-e541-4b04-823f-ee39260e8067 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:42.091948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417f892-e541-4b04-823f-ee39260e8067 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:42.092230 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a417f892-e541-4b04-823f-ee39260e8067 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:42.092952 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417f892-e541-4b04-823f-ee39260e8067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:42.094502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a417f892-e541-4b04-823f-ee39260e8067 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:42.105804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1285/2571] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:57:42.109571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417f892-e541-4b04-823f-ee39260e8067 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:42.119672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a417f892-e541-4b04-823f-ee39260e8067 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:42.124256 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f17ff5f-95c8-4084-8259-61795f436945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:42.125089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17ff5f-95c8-4084-8259-61795f436945 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:42.125368 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17ff5f-95c8-4084-8259-61795f436945 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:42.125642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f17ff5f-95c8-4084-8259-61795f436945 admin admin] PATH_INFO: `/v3/projects/9c9c865aa5bf4962b8033618a7fd4dc4/users/4e6160767e1e4547b6388ba20299969d/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:42.139751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17ff5f-95c8-4084-8259-61795f436945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c9c865aa5bf4962b8033618a7fd4dc4, user_id=4e6160767e1e4547b6388ba20299969d, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:42.142351 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f17ff5f-95c8-4084-8259-61795f436945 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:42.159499 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1287/2572] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:57:41 2022] POST /identity/v3/projects => generated 385 bytes in 831 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:57:42.160585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b471655-3cea-4715-afb0-7d684bc49568 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:42.225832 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b471655-3cea-4715-afb0-7d684bc49568 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:42.230584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf06eb-850c-4258-b2f4-7311ec81b43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:42.231439 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf06eb-850c-4258-b2f4-7311ec81b43d admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:42.231823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf06eb-850c-4258-b2f4-7311ec81b43d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:42.237496 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf06eb-850c-4258-b2f4-7311ec81b43d admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:42.237496 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf06eb-850c-4258-b2f4-7311ec81b43d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:42.237496 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cf06eb-850c-4258-b2f4-7311ec81b43d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:42.245379 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=5 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:42.309129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1286/2573] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:42 2022] PUT /identity/v3/projects/9c9c865aa5bf4962b8033618a7fd4dc4/users/4e6160767e1e4547b6388ba20299969d/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:42.319991 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ba567-fd2d-4ad8-82b4-9b2e6e1ad1c4 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:42.320286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ba567-fd2d-4ad8-82b4-9b2e6e1ad1c4 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:42.320574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ba567-fd2d-4ad8-82b4-9b2e6e1ad1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:42.354042 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-ba6ba567-fd2d-4ad8-82b4-9b2e6e1ad1c4 None None] MFA Rules not processed for user `4e6160767e1e4547b6388ba20299969d`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:42.355547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ba6ba567-fd2d-4ad8-82b4-9b2e6e1ad1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:42.360464 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1288/2574] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:57:42 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:57:42.365182 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf06eb-850c-4258-b2f4-7311ec81b43d admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:42.375957 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf06eb-850c-4258-b2f4-7311ec81b43d admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:42.430633 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1287/2575] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:57:42.440326 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ba567-fd2d-4ad8-82b4-9b2e6e1ad1c4 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:42.442073 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ba6ba567-fd2d-4ad8-82b4-9b2e6e1ad1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:42.445797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ade091-91ca-40cf-9c7e-df5f2635461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:42.447016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ade091-91ca-40cf-9c7e-df5f2635461b admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:42.447566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ade091-91ca-40cf-9c7e-df5f2635461b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:42.448339 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ade091-91ca-40cf-9c7e-df5f2635461b admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:42.448811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ade091-91ca-40cf-9c7e-df5f2635461b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:42.451515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ade091-91ca-40cf-9c7e-df5f2635461b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:42.463736 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1289/2576] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:57:42.466836 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:42.468274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ade091-91ca-40cf-9c7e-df5f2635461b admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:42.480075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ade091-91ca-40cf-9c7e-df5f2635461b admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:42.485248 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487249a-a5b6-49c9-b292-e1fb00e1eee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:42.485945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487249a-a5b6-49c9-b292-e1fb00e1eee5 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:42.486293 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487249a-a5b6-49c9-b292-e1fb00e1eee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:42.486573 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487249a-a5b6-49c9-b292-e1fb00e1eee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:42.487370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487249a-a5b6-49c9-b292-e1fb00e1eee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:42.492563 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487249a-a5b6-49c9-b292-e1fb00e1eee5 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:42.506214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1290/2577] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:42.509737 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ba567-fd2d-4ad8-82b4-9b2e6e1ad1c4 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:42.510095 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487249a-a5b6-49c9-b292-e1fb00e1eee5 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:42.513695 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de586ae-a0d3-4e06-9fb7-ea2390c16d14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:42.514417 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de586ae-a0d3-4e06-9fb7-ea2390c16d14 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:42.514776 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de586ae-a0d3-4e06-9fb7-ea2390c16d14 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:42.515110 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de586ae-a0d3-4e06-9fb7-ea2390c16d14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:42.521056 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487249a-a5b6-49c9-b292-e1fb00e1eee5 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:42.524881 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de586ae-a0d3-4e06-9fb7-ea2390c16d14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:42.540408 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdd041-b2a0-4634-a6bc-9b4c26c8c091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:42.541098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de586ae-a0d3-4e06-9fb7-ea2390c16d14 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:42.541186 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdd041-b2a0-4634-a6bc-9b4c26c8c091 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:42.541186 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdd041-b2a0-4634-a6bc-9b4c26c8c091 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:42.541186 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdd041-b2a0-4634-a6bc-9b4c26c8c091 admin admin] PATH_INFO: `/v3/projects/076c62b072234ceaaf61257f71925910/users/b7f1f97402294da993491c0b6485212f/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:42.541410 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1288/2578] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:57:42.544793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdd041-b2a0-4634-a6bc-9b4c26c8c091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=076c62b072234ceaaf61257f71925910, user_id=b7f1f97402294da993491c0b6485212f, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:42.547717 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdd041-b2a0-4634-a6bc-9b4c26c8c091 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:42.557893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de586ae-a0d3-4e06-9fb7-ea2390c16d14 service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:42.568866 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de586ae-a0d3-4e06-9fb7-ea2390c16d14 service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:42.573416 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a591087-8862-470e-a76c-ccb8e8427dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:42.574270 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a591087-8862-470e-a76c-ccb8e8427dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:42.574550 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a591087-8862-470e-a76c-ccb8e8427dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:42.574856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a591087-8862-470e-a76c-ccb8e8427dbe admin admin] PATH_INFO: `/v3/users/4e6160767e1e4547b6388ba20299969d` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:42.576111 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a591087-8862-470e-a76c-ccb8e8427dbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e6160767e1e4547b6388ba20299969d)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:42.578020 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a591087-8862-470e-a76c-ccb8e8427dbe admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:42.616361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1291/2579] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:42 2022] PUT /identity/v3/projects/076c62b072234ceaaf61257f71925910/users/b7f1f97402294da993491c0b6485212f/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:42.626926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46675cbf-4668-4aa1-83a4-8114b9913c1e None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:42.627213 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46675cbf-4668-4aa1-83a4-8114b9913c1e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:42.627731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46675cbf-4668-4aa1-83a4-8114b9913c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:42.654232 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-46675cbf-4668-4aa1-83a4-8114b9913c1e None None] MFA Rules not processed for user `b7f1f97402294da993491c0b6485212f`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:42.655450 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-46675cbf-4668-4aa1-83a4-8114b9913c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:42.717954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1292/2580] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:57:42.729005 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46675cbf-4668-4aa1-83a4-8114b9913c1e None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:42.730576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-46675cbf-4668-4aa1-83a4-8114b9913c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:42.766184 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6a591087-8862-470e-a76c-ccb8e8427dbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e6160767e1e4547b6388ba20299969d'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:42.803201 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46675cbf-4668-4aa1-83a4-8114b9913c1e None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:42.808748 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b316a92-eb66-4d5b-9a05-89789162f4a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'da1746d29f9e4e8b8626ad4b11931cbd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:42.809393 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b316a92-eb66-4d5b-9a05-89789162f4a6 service nova] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:42.809679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b316a92-eb66-4d5b-9a05-89789162f4a6 service nova] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:42.809960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b316a92-eb66-4d5b-9a05-89789162f4a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:42.818249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b316a92-eb66-4d5b-9a05-89789162f4a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:42.819949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b316a92-eb66-4d5b-9a05-89789162f4a6 service nova] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:42.829310 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1293/2581] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:57:42.845172 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6a591087-8862-470e-a76c-ccb8e8427dbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e6160767e1e4547b6388ba20299969d'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:42.861000 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6a591087-8862-470e-a76c-ccb8e8427dbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e6160767e1e4547b6388ba20299969d'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:42.868365 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6a591087-8862-470e-a76c-ccb8e8427dbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e6160767e1e4547b6388ba20299969d'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:42.872151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6a591087-8862-470e-a76c-ccb8e8427dbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e6160767e1e4547b6388ba20299969d'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:42.875366 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1289/2582] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:57:42 2022] DELETE /identity/v3/users/4e6160767e1e4547b6388ba20299969d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:42.880082 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e223143-1922-4e3d-8a5b-b0d7837ba1ba None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:42.880376 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e223143-1922-4e3d-8a5b-b0d7837ba1ba None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:42.880655 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e223143-1922-4e3d-8a5b-b0d7837ba1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:42.901080 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-1e223143-1922-4e3d-8a5b-b0d7837ba1ba None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:42.902719 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-1e223143-1922-4e3d-8a5b-b0d7837ba1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:42.979169 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1294/2583] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:57:42.987734 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a591087-8862-470e-a76c-ccb8e8427dbe admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:42.989267 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-6a591087-8862-470e-a76c-ccb8e8427dbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:43.046391 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a591087-8862-470e-a76c-ccb8e8427dbe admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:43.051016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cd06a-6035-470a-b941-6a57f0f215bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:43.051886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cd06a-6035-470a-b941-6a57f0f215bd service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:43.052381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cd06a-6035-470a-b941-6a57f0f215bd service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:43.052648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cd06a-6035-470a-b941-6a57f0f215bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:43.061920 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5cd06a-6035-470a-b941-6a57f0f215bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:43.063362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5cd06a-6035-470a-b941-6a57f0f215bd service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:43.073031 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1290/2584] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:57:43.302016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:43.509586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e223143-1922-4e3d-8a5b-b0d7837ba1ba None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:43.511457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-1e223143-1922-4e3d-8a5b-b0d7837ba1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:43.528673 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e223143-1922-4e3d-8a5b-b0d7837ba1ba None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:43.540305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e83cb-1c99-4a78-bd4a-fb72372d76fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:43.541189 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e83cb-1c99-4a78-bd4a-fb72372d76fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:43.541500 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e83cb-1c99-4a78-bd4a-fb72372d76fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:43.541779 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e83cb-1c99-4a78-bd4a-fb72372d76fe admin admin] PATH_INFO: `/v3/projects/9c9c865aa5bf4962b8033618a7fd4dc4` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:43.542999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e83cb-1c99-4a78-bd4a-fb72372d76fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c9c865aa5bf4962b8033618a7fd4dc4)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:43.544947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e83cb-1c99-4a78-bd4a-fb72372d76fe admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:43.680328 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8d0e83cb-1c99-4a78-bd4a-fb72372d76fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c9c865aa5bf4962b8033618a7fd4dc4', 'request_id': 'req-8d0e83cb-1c99-4a78-bd4a-fb72372d76fe'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:43.780906 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8d0e83cb-1c99-4a78-bd4a-fb72372d76fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c9c865aa5bf4962b8033618a7fd4dc4', 'request_id': 'req-8d0e83cb-1c99-4a78-bd4a-fb72372d76fe'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:43.787519 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8d0e83cb-1c99-4a78-bd4a-fb72372d76fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c9c865aa5bf4962b8033618a7fd4dc4', 'request_id': 'req-8d0e83cb-1c99-4a78-bd4a-fb72372d76fe'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:43.799009 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8d0e83cb-1c99-4a78-bd4a-fb72372d76fe admin admin] The token cache is being invalidate because project 9c9c865aa5bf4962b8033618a7fd4dc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:57:43.799346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8d0e83cb-1c99-4a78-bd4a-fb72372d76fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:43.800592 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-8d0e83cb-1c99-4a78-bd4a-fb72372d76fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:43.802125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1295/2585] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:57:43 2022] DELETE /identity/v3/projects/9c9c865aa5bf4962b8033618a7fd4dc4 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:43.807208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c6771-84ee-4328-a5e0-e1abcc9de498 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:43.807497 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c6771-84ee-4328-a5e0-e1abcc9de498 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:43.807810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c6771-84ee-4328-a5e0-e1abcc9de498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:43.824891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-021c6771-84ee-4328-a5e0-e1abcc9de498 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:43.826019 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-021c6771-84ee-4328-a5e0-e1abcc9de498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:43.855271 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:43.888567 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1291/2586] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:43.896174 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24305009-6a4f-4671-acd0-f71e7d7150f8 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:43.896486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24305009-6a4f-4671-acd0-f71e7d7150f8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:43.896759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24305009-6a4f-4671-acd0-f71e7d7150f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:43.914650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-24305009-6a4f-4671-acd0-f71e7d7150f8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:43.915880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-24305009-6a4f-4671-acd0-f71e7d7150f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:43.923705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1296/2587] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:43.928556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c6771-84ee-4328-a5e0-e1abcc9de498 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:43.938683 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c6771-84ee-4328-a5e0-e1abcc9de498 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:43.943778 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d98da-fae7-4151-a5b6-6207b7171be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:43.948811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d98da-fae7-4151-a5b6-6207b7171be9 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:43.948811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d98da-fae7-4151-a5b6-6207b7171be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:43.948811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d98da-fae7-4151-a5b6-6207b7171be9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:43.948811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d98da-fae7-4151-a5b6-6207b7171be9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:57:43.948811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d98da-fae7-4151-a5b6-6207b7171be9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:43.948811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413d98da-fae7-4151-a5b6-6207b7171be9 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:43.960561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1292/2588] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:57:43.965252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24305009-6a4f-4671-acd0-f71e7d7150f8 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:43.975215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24305009-6a4f-4671-acd0-f71e7d7150f8 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:43.988996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a8174-c99d-4ee3-a6ec-13d726fe3124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:43.988996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a8174-c99d-4ee3-a6ec-13d726fe3124 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:43.988996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a8174-c99d-4ee3-a6ec-13d726fe3124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:43.988996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a8174-c99d-4ee3-a6ec-13d726fe3124 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:43.989446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a8174-c99d-4ee3-a6ec-13d726fe3124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:43.989446 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a8174-c99d-4ee3-a6ec-13d726fe3124 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:44.095917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1297/2589] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:57:43 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:57:44.100333 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d98da-fae7-4151-a5b6-6207b7171be9 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:44.111703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413d98da-fae7-4151-a5b6-6207b7171be9 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:44.172765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b5c94-76fe-4af2-8ba5-b79f1735a105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:44.173649 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b5c94-76fe-4af2-8ba5-b79f1735a105 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:44.173959 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b5c94-76fe-4af2-8ba5-b79f1735a105 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:44.174400 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b5c94-76fe-4af2-8ba5-b79f1735a105 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:44.175083 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b5c94-76fe-4af2-8ba5-b79f1735a105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:44.177045 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b5c94-76fe-4af2-8ba5-b79f1735a105 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:44.255784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1293/2590] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:57:44 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:44.259895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a8174-c99d-4ee3-a6ec-13d726fe3124 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:44.272487 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a8174-c99d-4ee3-a6ec-13d726fe3124 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:44.277226 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77815ead-6bf6-476b-a488-a431e3c90c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:44.277941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77815ead-6bf6-476b-a488-a431e3c90c86 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:44.278226 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77815ead-6bf6-476b-a488-a431e3c90c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:44.282561 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77815ead-6bf6-476b-a488-a431e3c90c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:44.282561 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77815ead-6bf6-476b-a488-a431e3c90c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:44.282561 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77815ead-6bf6-476b-a488-a431e3c90c86 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:44.292366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1298/2591] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:44.296329 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b5c94-76fe-4af2-8ba5-b79f1735a105 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:44.306093 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b5c94-76fe-4af2-8ba5-b79f1735a105 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:44.310726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e8f6f-0dd7-44a1-b110-b1f5c7462f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:44.311375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e8f6f-0dd7-44a1-b110-b1f5c7462f54 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:44.311691 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e8f6f-0dd7-44a1-b110-b1f5c7462f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:44.311968 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e8f6f-0dd7-44a1-b110-b1f5c7462f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:44.312686 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e8f6f-0dd7-44a1-b110-b1f5c7462f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:44.314276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e8f6f-0dd7-44a1-b110-b1f5c7462f54 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:44.324448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1294/2592] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:44.328580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77815ead-6bf6-476b-a488-a431e3c90c86 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:44.339501 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77815ead-6bf6-476b-a488-a431e3c90c86 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:44.344313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0f4a7-d012-4d94-9dd3-0eacc6e751f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:44.345193 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0f4a7-d012-4d94-9dd3-0eacc6e751f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:44.345480 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0f4a7-d012-4d94-9dd3-0eacc6e751f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:44.345759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e0f4a7-d012-4d94-9dd3-0eacc6e751f4 admin admin] PATH_INFO: `/v3/projects/1d6f0aeef3cf455585b3e822037ee301/users/6a6462ed51f74600a701303b1089b443/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:44.365185 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:44.365185 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0f4a7-d012-4d94-9dd3-0eacc6e751f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d6f0aeef3cf455585b3e822037ee301, user_id=6a6462ed51f74600a701303b1089b443, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:44.366082 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e0f4a7-d012-4d94-9dd3-0eacc6e751f4 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:44.461070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1299/2593] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:44 2022] PUT /identity/v3/projects/1d6f0aeef3cf455585b3e822037ee301/users/6a6462ed51f74600a701303b1089b443/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:44.471200 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324be78-da1a-45e2-8a1c-20bdb68ed7f6 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:44.471493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324be78-da1a-45e2-8a1c-20bdb68ed7f6 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:44.471805 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324be78-da1a-45e2-8a1c-20bdb68ed7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:44.498543 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-3324be78-da1a-45e2-8a1c-20bdb68ed7f6 None None] MFA Rules not processed for user `6a6462ed51f74600a701303b1089b443`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:44.499761 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-3324be78-da1a-45e2-8a1c-20bdb68ed7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:44.562948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1295/2594] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:44.573980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0f4a7-d012-4d94-9dd3-0eacc6e751f4 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:44.575780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-18e0f4a7-d012-4d94-9dd3-0eacc6e751f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:44.631878 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e0f4a7-d012-4d94-9dd3-0eacc6e751f4 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:44.635392 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf99aa-805c-456c-9d4c-4fb578fc283f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:44.636055 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf99aa-805c-456c-9d4c-4fb578fc283f service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:44.636339 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf99aa-805c-456c-9d4c-4fb578fc283f service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:44.636620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf99aa-805c-456c-9d4c-4fb578fc283f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:44.645783 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf99aa-805c-456c-9d4c-4fb578fc283f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:44.647658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf99aa-805c-456c-9d4c-4fb578fc283f service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:44.656604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1300/2595] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:44.683643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324be78-da1a-45e2-8a1c-20bdb68ed7f6 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:44.745268 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:44.750717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324be78-da1a-45e2-8a1c-20bdb68ed7f6 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:44.755493 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3babd-c547-48eb-bb0f-7ccd9192dc75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:44.756315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3babd-c547-48eb-bb0f-7ccd9192dc75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:44.756596 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3babd-c547-48eb-bb0f-7ccd9192dc75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:44.756952 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3babd-c547-48eb-bb0f-7ccd9192dc75 admin admin] PATH_INFO: `/v3/users/6a6462ed51f74600a701303b1089b443` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:44.758085 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3babd-c547-48eb-bb0f-7ccd9192dc75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a6462ed51f74600a701303b1089b443)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:44.760058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3babd-c547-48eb-bb0f-7ccd9192dc75 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:45.017874 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8ce3babd-c547-48eb-bb0f-7ccd9192dc75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a6462ed51f74600a701303b1089b443'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:45.123431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8ce3babd-c547-48eb-bb0f-7ccd9192dc75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a6462ed51f74600a701303b1089b443'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:45.139496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8ce3babd-c547-48eb-bb0f-7ccd9192dc75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a6462ed51f74600a701303b1089b443'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:45.144136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8ce3babd-c547-48eb-bb0f-7ccd9192dc75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a6462ed51f74600a701303b1089b443'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:45.144899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8ce3babd-c547-48eb-bb0f-7ccd9192dc75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a6462ed51f74600a701303b1089b443'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:45.151795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1296/2596] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:57:44 2022] DELETE /identity/v3/users/6a6462ed51f74600a701303b1089b443 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:45.156320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ff1ff-ac23-45ab-9b41-5990c3cbd65a None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:45.156731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ff1ff-ac23-45ab-9b41-5990c3cbd65a None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:45.157036 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ff1ff-ac23-45ab-9b41-5990c3cbd65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:45.175865 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-010ff1ff-ac23-45ab-9b41-5990c3cbd65a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:45.177081 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-010ff1ff-ac23-45ab-9b41-5990c3cbd65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:45.239219 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1301/2597] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:45.248542 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3babd-c547-48eb-bb0f-7ccd9192dc75 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:45.254632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-8ce3babd-c547-48eb-bb0f-7ccd9192dc75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:45.323912 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3babd-c547-48eb-bb0f-7ccd9192dc75 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:45.331646 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7158af08-2787-496e-a7a9-304ad5519d80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:45.333015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158af08-2787-496e-a7a9-304ad5519d80 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:45.333326 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158af08-2787-496e-a7a9-304ad5519d80 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:45.333909 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7158af08-2787-496e-a7a9-304ad5519d80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:45.349548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158af08-2787-496e-a7a9-304ad5519d80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:45.351340 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7158af08-2787-496e-a7a9-304ad5519d80 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:45.369531 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1297/2598] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:45.807144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ff1ff-ac23-45ab-9b41-5990c3cbd65a None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:45.809332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-010ff1ff-ac23-45ab-9b41-5990c3cbd65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:45.823944 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ff1ff-ac23-45ab-9b41-5990c3cbd65a None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:45.829543 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b47cf-ac28-4dbc-b620-82c0844dc01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:45.830588 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b47cf-ac28-4dbc-b620-82c0844dc01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:45.830881 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b47cf-ac28-4dbc-b620-82c0844dc01b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:45.831201 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b47cf-ac28-4dbc-b620-82c0844dc01b admin admin] PATH_INFO: `/v3/projects/1d6f0aeef3cf455585b3e822037ee301` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:45.833358 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b47cf-ac28-4dbc-b620-82c0844dc01b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d6f0aeef3cf455585b3e822037ee301)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:45.835342 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4b47cf-ac28-4dbc-b620-82c0844dc01b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:45.930257 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa4b47cf-ac28-4dbc-b620-82c0844dc01b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d6f0aeef3cf455585b3e822037ee301', 'request_id': 'req-aa4b47cf-ac28-4dbc-b620-82c0844dc01b'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:46.021005 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa4b47cf-ac28-4dbc-b620-82c0844dc01b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d6f0aeef3cf455585b3e822037ee301', 'request_id': 'req-aa4b47cf-ac28-4dbc-b620-82c0844dc01b'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:46.027149 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa4b47cf-ac28-4dbc-b620-82c0844dc01b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d6f0aeef3cf455585b3e822037ee301', 'request_id': 'req-aa4b47cf-ac28-4dbc-b620-82c0844dc01b'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:46.043091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa4b47cf-ac28-4dbc-b620-82c0844dc01b admin admin] The token cache is being invalidate because project 1d6f0aeef3cf455585b3e822037ee301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:57:46.043392 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa4b47cf-ac28-4dbc-b620-82c0844dc01b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:46.044081 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa4b47cf-ac28-4dbc-b620-82c0844dc01b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:46.045640 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1302/2599] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:57:45 2022] DELETE /identity/v3/projects/1d6f0aeef3cf455585b3e822037ee301 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:46.050397 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a2c6b-23c1-4605-a791-877f2455e66d None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:46.050696 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a2c6b-23c1-4605-a791-877f2455e66d None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:46.051510 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a2c6b-23c1-4605-a791-877f2455e66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:46.069421 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-793a2c6b-23c1-4605-a791-877f2455e66d None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:46.070639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-793a2c6b-23c1-4605-a791-877f2455e66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:46.118842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:46.141329 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1298/2600] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:46.145221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77392abd-eae6-4801-9610-1254fac05c1e None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:46.145221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77392abd-eae6-4801-9610-1254fac05c1e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:46.145221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77392abd-eae6-4801-9610-1254fac05c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:46.171548 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-77392abd-eae6-4801-9610-1254fac05c1e None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:46.177529 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-77392abd-eae6-4801-9610-1254fac05c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:46.183517 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1303/2601] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:46.187673 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a2c6b-23c1-4605-a791-877f2455e66d None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:46.197945 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a2c6b-23c1-4605-a791-877f2455e66d None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:46.207873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d86a1b-8f2b-4563-b5be-4af7c01c9b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:46.207873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d86a1b-8f2b-4563-b5be-4af7c01c9b9a admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:46.207873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d86a1b-8f2b-4563-b5be-4af7c01c9b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:46.207873 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d86a1b-8f2b-4563-b5be-4af7c01c9b9a admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:46.208298 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d86a1b-8f2b-4563-b5be-4af7c01c9b9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:57:46.208298 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d86a1b-8f2b-4563-b5be-4af7c01c9b9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:46.208298 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d86a1b-8f2b-4563-b5be-4af7c01c9b9a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:46.221870 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1299/2602] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:57:46.226579 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77392abd-eae6-4801-9610-1254fac05c1e None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:46.236614 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77392abd-eae6-4801-9610-1254fac05c1e None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:46.241350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3aa96-93d1-4396-9e35-8df2c401c74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:46.242009 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3aa96-93d1-4396-9e35-8df2c401c74a admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:46.242295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3aa96-93d1-4396-9e35-8df2c401c74a admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:46.242597 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3aa96-93d1-4396-9e35-8df2c401c74a admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:46.243286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3aa96-93d1-4396-9e35-8df2c401c74a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:46.245221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3aa96-93d1-4396-9e35-8df2c401c74a admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:46.249475 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:46.328977 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1304/2603] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:57:46 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:46.330083 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d86a1b-8f2b-4563-b5be-4af7c01c9b9a admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:46.342500 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d86a1b-8f2b-4563-b5be-4af7c01c9b9a admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:46.400412 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f072f-7e11-4a5b-9b6e-ab24dcf72a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:46.401074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f072f-7e11-4a5b-9b6e-ab24dcf72a54 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:46.401357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f072f-7e11-4a5b-9b6e-ab24dcf72a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:46.401633 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f072f-7e11-4a5b-9b6e-ab24dcf72a54 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:46.402357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f072f-7e11-4a5b-9b6e-ab24dcf72a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:46.404666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f072f-7e11-4a5b-9b6e-ab24dcf72a54 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:46.555570 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1300/2604] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:57:46 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:46.559660 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3aa96-93d1-4396-9e35-8df2c401c74a admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:46.570119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3aa96-93d1-4396-9e35-8df2c401c74a admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:46.574636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71aa3a-a2cc-4292-9b38-117763855ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:46.575212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71aa3a-a2cc-4292-9b38-117763855ffc admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:46.575498 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71aa3a-a2cc-4292-9b38-117763855ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:46.575811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71aa3a-a2cc-4292-9b38-117763855ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:46.576666 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71aa3a-a2cc-4292-9b38-117763855ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:46.578266 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71aa3a-a2cc-4292-9b38-117763855ffc admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:46.593679 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1305/2605] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:46.597695 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f072f-7e11-4a5b-9b6e-ab24dcf72a54 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:46.609196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f072f-7e11-4a5b-9b6e-ab24dcf72a54 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:46.613956 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea785e-61dc-4a19-b32a-e52b97c8356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:46.614699 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea785e-61dc-4a19-b32a-e52b97c8356c admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:46.615015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea785e-61dc-4a19-b32a-e52b97c8356c admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:46.615295 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea785e-61dc-4a19-b32a-e52b97c8356c admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:46.616143 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea785e-61dc-4a19-b32a-e52b97c8356c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:46.617751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea785e-61dc-4a19-b32a-e52b97c8356c admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:46.628338 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1301/2606] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:46.632989 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71aa3a-a2cc-4292-9b38-117763855ffc admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:46.642884 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71aa3a-a2cc-4292-9b38-117763855ffc admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:46.647677 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2571f5a-4ecd-4926-9df3-b2a026a95648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:46.648549 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2571f5a-4ecd-4926-9df3-b2a026a95648 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:46.648837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2571f5a-4ecd-4926-9df3-b2a026a95648 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:46.649190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2571f5a-4ecd-4926-9df3-b2a026a95648 admin admin] PATH_INFO: `/v3/projects/dead1dd9a06341ff87694eddff27f653/users/c0eb50c75dfd47ffa2eb30f2de8103fc/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:46.663822 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2571f5a-4ecd-4926-9df3-b2a026a95648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dead1dd9a06341ff87694eddff27f653, user_id=c0eb50c75dfd47ffa2eb30f2de8103fc, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:46.666620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2571f5a-4ecd-4926-9df3-b2a026a95648 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:46.756347 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1306/2607] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:46 2022] PUT /identity/v3/projects/dead1dd9a06341ff87694eddff27f653/users/c0eb50c75dfd47ffa2eb30f2de8103fc/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:46.766783 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae3372-454a-44bd-89f7-4112c79aa3e1 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:46.767102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae3372-454a-44bd-89f7-4112c79aa3e1 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:46.767367 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae3372-454a-44bd-89f7-4112c79aa3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:46.794838 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-69ae3372-454a-44bd-89f7-4112c79aa3e1 None None] MFA Rules not processed for user `c0eb50c75dfd47ffa2eb30f2de8103fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:46.796203 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-69ae3372-454a-44bd-89f7-4112c79aa3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:46.863461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1302/2608] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:57:46.875124 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2571f5a-4ecd-4926-9df3-b2a026a95648 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:46.876860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-c2571f5a-4ecd-4926-9df3-b2a026a95648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:46.934455 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2571f5a-4ecd-4926-9df3-b2a026a95648 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:46.938156 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a63aa-5da6-4f5a-b8c3-38dcfda4ae5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:46.938828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a63aa-5da6-4f5a-b8c3-38dcfda4ae5f service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:46.939117 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a63aa-5da6-4f5a-b8c3-38dcfda4ae5f service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:46.939394 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a63aa-5da6-4f5a-b8c3-38dcfda4ae5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:46.947852 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a63aa-5da6-4f5a-b8c3-38dcfda4ae5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:46.949295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a63aa-5da6-4f5a-b8c3-38dcfda4ae5f service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:46.958611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1307/2609] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:49.631136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae3372-454a-44bd-89f7-4112c79aa3e1 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:49.631136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-69ae3372-454a-44bd-89f7-4112c79aa3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:49.679024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:49.694689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ae3372-454a-44bd-89f7-4112c79aa3e1 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:49.699128 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574d703-bb45-4760-857e-ee17c7f59116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:49.700024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574d703-bb45-4760-857e-ee17c7f59116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:49.700305 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574d703-bb45-4760-857e-ee17c7f59116 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:49.700577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c574d703-bb45-4760-857e-ee17c7f59116 admin admin] PATH_INFO: `/v3/users/b7f1f97402294da993491c0b6485212f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:49.701747 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574d703-bb45-4760-857e-ee17c7f59116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7f1f97402294da993491c0b6485212f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:49.703688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c574d703-bb45-4760-857e-ee17c7f59116 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:49.915059 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-c574d703-bb45-4760-857e-ee17c7f59116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7f1f97402294da993491c0b6485212f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:50.032290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-c574d703-bb45-4760-857e-ee17c7f59116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7f1f97402294da993491c0b6485212f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:50.045089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-c574d703-bb45-4760-857e-ee17c7f59116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7f1f97402294da993491c0b6485212f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:50.052059 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-c574d703-bb45-4760-857e-ee17c7f59116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7f1f97402294da993491c0b6485212f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:50.052714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-c574d703-bb45-4760-857e-ee17c7f59116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7f1f97402294da993491c0b6485212f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:50.058626 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1303/2610] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:57:49 2022] DELETE /identity/v3/users/b7f1f97402294da993491c0b6485212f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:50.063044 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db4017-7306-4a6a-9ae5-5cdbd6cfdb6c None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:50.063623 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db4017-7306-4a6a-9ae5-5cdbd6cfdb6c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:50.063720 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db4017-7306-4a6a-9ae5-5cdbd6cfdb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:50.080087 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-65db4017-7306-4a6a-9ae5-5cdbd6cfdb6c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:50.081271 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-65db4017-7306-4a6a-9ae5-5cdbd6cfdb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:50.139344 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1308/2611] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:50.149314 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574d703-bb45-4760-857e-ee17c7f59116 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:50.150715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-c574d703-bb45-4760-857e-ee17c7f59116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:50.210017 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c574d703-bb45-4760-857e-ee17c7f59116 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:50.213564 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b924b72e-bbbb-4a74-b2f8-df9b4556502b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:50.214201 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924b72e-bbbb-4a74-b2f8-df9b4556502b service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:50.214483 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924b72e-bbbb-4a74-b2f8-df9b4556502b service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:50.214792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b924b72e-bbbb-4a74-b2f8-df9b4556502b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:50.224317 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924b72e-bbbb-4a74-b2f8-df9b4556502b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:50.225742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b924b72e-bbbb-4a74-b2f8-df9b4556502b service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:50.235215 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1304/2612] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:50.646885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db4017-7306-4a6a-9ae5-5cdbd6cfdb6c None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:50.648330 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-65db4017-7306-4a6a-9ae5-5cdbd6cfdb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:50.660460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db4017-7306-4a6a-9ae5-5cdbd6cfdb6c None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:50.665214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb100e-c533-45b4-b9ea-eba1f48076bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:50.665980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb100e-c533-45b4-b9ea-eba1f48076bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:50.666265 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb100e-c533-45b4-b9ea-eba1f48076bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:50.666541 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb100e-c533-45b4-b9ea-eba1f48076bd admin admin] PATH_INFO: `/v3/projects/076c62b072234ceaaf61257f71925910` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:50.667960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb100e-c533-45b4-b9ea-eba1f48076bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=076c62b072234ceaaf61257f71925910)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:50.669881 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb100e-c533-45b4-b9ea-eba1f48076bd admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:50.781260 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-bbeb100e-c533-45b4-b9ea-eba1f48076bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '076c62b072234ceaaf61257f71925910', 'request_id': 'req-bbeb100e-c533-45b4-b9ea-eba1f48076bd'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:50.782918 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:50.883863 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-bbeb100e-c533-45b4-b9ea-eba1f48076bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '076c62b072234ceaaf61257f71925910', 'request_id': 'req-bbeb100e-c533-45b4-b9ea-eba1f48076bd'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:50.890179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-bbeb100e-c533-45b4-b9ea-eba1f48076bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '076c62b072234ceaaf61257f71925910', 'request_id': 'req-bbeb100e-c533-45b4-b9ea-eba1f48076bd'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:50.901205 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-bbeb100e-c533-45b4-b9ea-eba1f48076bd admin admin] The token cache is being invalidate because project 076c62b072234ceaaf61257f71925910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:57:50.901510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-bbeb100e-c533-45b4-b9ea-eba1f48076bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:50.902146 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-bbeb100e-c533-45b4-b9ea-eba1f48076bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:50.903721 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1309/2613] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:57:50 2022] DELETE /identity/v3/projects/076c62b072234ceaaf61257f71925910 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:50.908962 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea4a5f-8ff9-46d0-80a7-8a0d61176dfd None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:50.909435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea4a5f-8ff9-46d0-80a7-8a0d61176dfd None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:50.909529 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea4a5f-8ff9-46d0-80a7-8a0d61176dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:50.929289 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-37ea4a5f-8ff9-46d0-80a7-8a0d61176dfd None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:50.930492 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-37ea4a5f-8ff9-46d0-80a7-8a0d61176dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:51.001550 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1305/2614] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:51.009324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b5061-64c9-44b0-87f9-ec522ce2af79 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:51.009626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b5061-64c9-44b0-87f9-ec522ce2af79 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:51.009939 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b5061-64c9-44b0-87f9-ec522ce2af79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:51.033950 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-ee7b5061-64c9-44b0-87f9-ec522ce2af79 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:51.035187 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ee7b5061-64c9-44b0-87f9-ec522ce2af79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:51.044113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1310/2615] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:51.055710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea4a5f-8ff9-46d0-80a7-8a0d61176dfd None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:51.065363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea4a5f-8ff9-46d0-80a7-8a0d61176dfd None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:51.070522 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a2384-487d-45a8-b47b-a1e854d9d7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:51.071171 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a2384-487d-45a8-b47b-a1e854d9d7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:51.071451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a2384-487d-45a8-b47b-a1e854d9d7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:51.071760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a2384-487d-45a8-b47b-a1e854d9d7b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:51.072487 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a2384-487d-45a8-b47b-a1e854d9d7b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:57:51.072858 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a2384-487d-45a8-b47b-a1e854d9d7b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:51.074591 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a2384-487d-45a8-b47b-a1e854d9d7b8 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:51.077521 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:51.087759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1306/2616] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:57:51.092114 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b5061-64c9-44b0-87f9-ec522ce2af79 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:51.101401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b5061-64c9-44b0-87f9-ec522ce2af79 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:51.106314 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be3708-0820-4b36-9a53-2768759fc473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:51.106995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be3708-0820-4b36-9a53-2768759fc473 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:51.107401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be3708-0820-4b36-9a53-2768759fc473 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:51.107713 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be3708-0820-4b36-9a53-2768759fc473 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:51.108399 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be3708-0820-4b36-9a53-2768759fc473 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:51.110289 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50be3708-0820-4b36-9a53-2768759fc473 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:51.205733 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1311/2617] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:57:51 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:51.210559 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a2384-487d-45a8-b47b-a1e854d9d7b8 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:51.220784 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a2384-487d-45a8-b47b-a1e854d9d7b8 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:51.288648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030caff-a4ab-4551-9240-1ec3d6d6d747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:51.290088 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030caff-a4ab-4551-9240-1ec3d6d6d747 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:51.290375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030caff-a4ab-4551-9240-1ec3d6d6d747 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:51.295381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030caff-a4ab-4551-9240-1ec3d6d6d747 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:51.295381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030caff-a4ab-4551-9240-1ec3d6d6d747 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:51.295381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030caff-a4ab-4551-9240-1ec3d6d6d747 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:51.332624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be3708-0820-4b36-9a53-2768759fc473 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:51.334373 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-50be3708-0820-4b36-9a53-2768759fc473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:51.373853 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1307/2618] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:57:51 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:51.375577 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030caff-a4ab-4551-9240-1ec3d6d6d747 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:51.389133 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030caff-a4ab-4551-9240-1ec3d6d6d747 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:51.392910 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6b94f-3e55-4a0a-adc7-69b8ca9affa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:51.393719 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6b94f-3e55-4a0a-adc7-69b8ca9affa6 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:51.394067 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6b94f-3e55-4a0a-adc7-69b8ca9affa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:51.395011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6b94f-3e55-4a0a-adc7-69b8ca9affa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:51.395912 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6b94f-3e55-4a0a-adc7-69b8ca9affa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:51.402952 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6b94f-3e55-4a0a-adc7-69b8ca9affa6 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:51.409012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1308/2619] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:57:51.410991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be3708-0820-4b36-9a53-2768759fc473 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:51.412710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6b94f-3e55-4a0a-adc7-69b8ca9affa6 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:51.415423 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af871b-2b0d-4dc9-9543-921268a7a529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:51.416298 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af871b-2b0d-4dc9-9543-921268a7a529 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:51.416656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af871b-2b0d-4dc9-9543-921268a7a529 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:51.417029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af871b-2b0d-4dc9-9543-921268a7a529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:51.419302 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d8af871b-2b0d-4dc9-9543-921268a7a529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:51.424082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6b94f-3e55-4a0a-adc7-69b8ca9affa6 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:51.434592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6cc0f-5f0f-4572-8c7b-d630864b33d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:51.434592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6cc0f-5f0f-4572-8c7b-d630864b33d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:51.434592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6cc0f-5f0f-4572-8c7b-d630864b33d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:51.434592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6cc0f-5f0f-4572-8c7b-d630864b33d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:51.435015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6cc0f-5f0f-4572-8c7b-d630864b33d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:51.436817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6cc0f-5f0f-4572-8c7b-d630864b33d5 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:51.451961 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1309/2620] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:51.455865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6cc0f-5f0f-4572-8c7b-d630864b33d5 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:51.476001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6cc0f-5f0f-4572-8c7b-d630864b33d5 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:51.476001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb3474-da36-4309-8ae3-99ca9e3041ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:51.476001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb3474-da36-4309-8ae3-99ca9e3041ad admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:51.476001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb3474-da36-4309-8ae3-99ca9e3041ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:51.476811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb3474-da36-4309-8ae3-99ca9e3041ad admin admin] PATH_INFO: `/v3/projects/5016db19798b474cbad8d45bd1dfb88d/users/4210ad12d09f41aa92753c966e06b255/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:51.494592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb3474-da36-4309-8ae3-99ca9e3041ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=5016db19798b474cbad8d45bd1dfb88d, user_id=4210ad12d09f41aa92753c966e06b255, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:51.497568 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb3474-da36-4309-8ae3-99ca9e3041ad admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:51.504499 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af871b-2b0d-4dc9-9543-921268a7a529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:51.506068 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af871b-2b0d-4dc9-9543-921268a7a529 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:51.522722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1312/2621] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:57:51.605807 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1310/2622] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:51 2022] PUT /identity/v3/projects/5016db19798b474cbad8d45bd1dfb88d/users/4210ad12d09f41aa92753c966e06b255/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:51.618029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1d01f-7085-49fa-a89c-a69b21a4ac41 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:51.618320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1d01f-7085-49fa-a89c-a69b21a4ac41 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:51.618602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1d01f-7085-49fa-a89c-a69b21a4ac41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:51.646897 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-07a1d01f-7085-49fa-a89c-a69b21a4ac41 None None] MFA Rules not processed for user `4210ad12d09f41aa92753c966e06b255`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:51.648172 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-07a1d01f-7085-49fa-a89c-a69b21a4ac41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:51.696754 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:51.713968 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1313/2623] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:51.718429 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb3474-da36-4309-8ae3-99ca9e3041ad admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:51.784291 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb3474-da36-4309-8ae3-99ca9e3041ad admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:51.789769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb60531-fbe3-4819-ae62-a5c503e58a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:51.790729 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb60531-fbe3-4819-ae62-a5c503e58a56 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:51.790882 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb60531-fbe3-4819-ae62-a5c503e58a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:51.791224 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb60531-fbe3-4819-ae62-a5c503e58a56 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:51.792089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb60531-fbe3-4819-ae62-a5c503e58a56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:51.794090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb60531-fbe3-4819-ae62-a5c503e58a56 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:51.891947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1311/2624] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:57:51 2022] POST /identity/v3/projects => generated 381 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:51.896171 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1d01f-7085-49fa-a89c-a69b21a4ac41 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:51.907024 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1d01f-7085-49fa-a89c-a69b21a4ac41 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:51.963901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a925e83-628e-4143-9773-0344e1d3b927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:51.964579 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a925e83-628e-4143-9773-0344e1d3b927 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:51.964867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a925e83-628e-4143-9773-0344e1d3b927 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:51.965148 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a925e83-628e-4143-9773-0344e1d3b927 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:51.965833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a925e83-628e-4143-9773-0344e1d3b927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:51.967970 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a925e83-628e-4143-9773-0344e1d3b927 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:52.079132 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1314/2625] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:57:51 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:52.083063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb60531-fbe3-4819-ae62-a5c503e58a56 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:52.093732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb60531-fbe3-4819-ae62-a5c503e58a56 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:52.098866 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5419d-b359-4e1a-bcf1-6c0a005a9a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:52.099567 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5419d-b359-4e1a-bcf1-6c0a005a9a40 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:52.100004 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5419d-b359-4e1a-bcf1-6c0a005a9a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:52.100295 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5419d-b359-4e1a-bcf1-6c0a005a9a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:52.101028 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5419d-b359-4e1a-bcf1-6c0a005a9a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:52.102605 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5419d-b359-4e1a-bcf1-6c0a005a9a40 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:52.116847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1312/2626] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:52.120892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a925e83-628e-4143-9773-0344e1d3b927 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:52.131248 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a925e83-628e-4143-9773-0344e1d3b927 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:52.136201 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76da917-4ea8-47b9-99b2-2de028259069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:52.139404 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76da917-4ea8-47b9-99b2-2de028259069 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:52.139404 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76da917-4ea8-47b9-99b2-2de028259069 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:52.139404 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76da917-4ea8-47b9-99b2-2de028259069 admin admin] PATH_INFO: `/v3/projects/7be4a0fda3af4f01aa027b86ac6e9f22/users/f50ddc7f83994e59a0d29f46ea871990/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:52.154612 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76da917-4ea8-47b9-99b2-2de028259069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be4a0fda3af4f01aa027b86ac6e9f22, user_id=f50ddc7f83994e59a0d29f46ea871990, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:52.157397 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76da917-4ea8-47b9-99b2-2de028259069 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:52.284444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1315/2627] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:52 2022] PUT /identity/v3/projects/7be4a0fda3af4f01aa027b86ac6e9f22/users/f50ddc7f83994e59a0d29f46ea871990/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:52.289839 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5419d-b359-4e1a-bcf1-6c0a005a9a40 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:52.300803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5419d-b359-4e1a-bcf1-6c0a005a9a40 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:52.309666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:52.358088 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a632e0-aa6e-460b-850b-f15356a1beb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:52.358753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a632e0-aa6e-460b-850b-f15356a1beb1 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:52.359032 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a632e0-aa6e-460b-850b-f15356a1beb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:52.359306 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a632e0-aa6e-460b-850b-f15356a1beb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:52.360176 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a632e0-aa6e-460b-850b-f15356a1beb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:52.361678 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a632e0-aa6e-460b-850b-f15356a1beb1 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:52.375872 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1313/2628] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:57:52.381434 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76da917-4ea8-47b9-99b2-2de028259069 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:52.387823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76da917-4ea8-47b9-99b2-2de028259069 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:52.392413 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5228c76-3635-481f-8371-39aa13cd2a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:52.393284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5228c76-3635-481f-8371-39aa13cd2a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:52.393565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5228c76-3635-481f-8371-39aa13cd2a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:52.393837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5228c76-3635-481f-8371-39aa13cd2a2b admin admin] PATH_INFO: `/v3/projects/7be4a0fda3af4f01aa027b86ac6e9f22/users/f50ddc7f83994e59a0d29f46ea871990/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:52.396426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5228c76-3635-481f-8371-39aa13cd2a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be4a0fda3af4f01aa027b86ac6e9f22, user_id=f50ddc7f83994e59a0d29f46ea871990, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:52.398962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5228c76-3635-481f-8371-39aa13cd2a2b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:52.409993 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1316/2629] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:52 2022] PUT /identity/v3/projects/7be4a0fda3af4f01aa027b86ac6e9f22/users/f50ddc7f83994e59a0d29f46ea871990/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:52.420927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a5e99-8f5e-4590-8b3d-a54eaa0a8c5d None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:52.421219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a5e99-8f5e-4590-8b3d-a54eaa0a8c5d None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:52.421498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a5e99-8f5e-4590-8b3d-a54eaa0a8c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:52.448738 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-b70a5e99-8f5e-4590-8b3d-a54eaa0a8c5d None None] MFA Rules not processed for user `f50ddc7f83994e59a0d29f46ea871990`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:52.449214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b70a5e99-8f5e-4590-8b3d-a54eaa0a8c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:52.552953 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1314/2630] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:57:52.564460 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5228c76-3635-481f-8371-39aa13cd2a2b admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:52.566153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-a5228c76-3635-481f-8371-39aa13cd2a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:52.625546 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5228c76-3635-481f-8371-39aa13cd2a2b admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:52.629691 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952be7c-e43a-4d8d-9bac-9788d841b460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:52.630359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952be7c-e43a-4d8d-9bac-9788d841b460 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:52.630662 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952be7c-e43a-4d8d-9bac-9788d841b460 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:52.630921 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952be7c-e43a-4d8d-9bac-9788d841b460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:52.639928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952be7c-e43a-4d8d-9bac-9788d841b460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:52.641348 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952be7c-e43a-4d8d-9bac-9788d841b460 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:52.651837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1317/2631] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:52.747329 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a5e99-8f5e-4590-8b3d-a54eaa0a8c5d None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:52.758959 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a5e99-8f5e-4590-8b3d-a54eaa0a8c5d None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:52.762823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260f314-44f2-4537-be5d-fec279159cb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:52.763471 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260f314-44f2-4537-be5d-fec279159cb4 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:52.763788 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260f314-44f2-4537-be5d-fec279159cb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:52.764066 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260f314-44f2-4537-be5d-fec279159cb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:52.822906 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260f314-44f2-4537-be5d-fec279159cb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:52.824404 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260f314-44f2-4537-be5d-fec279159cb4 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:52.834578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1315/2632] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:56.046131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952be7c-e43a-4d8d-9bac-9788d841b460 service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:56.091668 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:56.108154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952be7c-e43a-4d8d-9bac-9788d841b460 service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:56.113431 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ed27c-d9be-4e09-a255-cbc423612806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:56.114275 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ed27c-d9be-4e09-a255-cbc423612806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:56.114572 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ed27c-d9be-4e09-a255-cbc423612806 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:56.114833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ed27c-d9be-4e09-a255-cbc423612806 admin admin] PATH_INFO: `/v3/users/4210ad12d09f41aa92753c966e06b255` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:56.116114 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ed27c-d9be-4e09-a255-cbc423612806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4210ad12d09f41aa92753c966e06b255)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:56.118108 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ed27c-d9be-4e09-a255-cbc423612806 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:56.293726 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-385ed27c-d9be-4e09-a255-cbc423612806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4210ad12d09f41aa92753c966e06b255'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:56.337206 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-385ed27c-d9be-4e09-a255-cbc423612806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4210ad12d09f41aa92753c966e06b255'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:56.356022 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-385ed27c-d9be-4e09-a255-cbc423612806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4210ad12d09f41aa92753c966e06b255'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:56.356836 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-385ed27c-d9be-4e09-a255-cbc423612806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4210ad12d09f41aa92753c966e06b255'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:56.370175 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-385ed27c-d9be-4e09-a255-cbc423612806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4210ad12d09f41aa92753c966e06b255'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:56.377877 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1318/2633] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:57:56 2022] DELETE /identity/v3/users/4210ad12d09f41aa92753c966e06b255 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:56.382429 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55069447-e9dc-4e76-aa1a-98ec68a9c45d None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:56.382920 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55069447-e9dc-4e76-aa1a-98ec68a9c45d None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:56.383237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55069447-e9dc-4e76-aa1a-98ec68a9c45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:56.401448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-55069447-e9dc-4e76-aa1a-98ec68a9c45d None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:56.403350 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-55069447-e9dc-4e76-aa1a-98ec68a9c45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:56.442242 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:56.471821 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1316/2634] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:57:56.484208 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ed27c-d9be-4e09-a255-cbc423612806 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:56.485730 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-385ed27c-d9be-4e09-a255-cbc423612806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:56.555390 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ed27c-d9be-4e09-a255-cbc423612806 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:56.559422 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3967f58-6643-4d07-a0e3-d0b7a5200b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:56.560138 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3967f58-6643-4d07-a0e3-d0b7a5200b62 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:56.560424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3967f58-6643-4d07-a0e3-d0b7a5200b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:56.560703 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3967f58-6643-4d07-a0e3-d0b7a5200b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:56.570901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3967f58-6643-4d07-a0e3-d0b7a5200b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:56.572405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3967f58-6643-4d07-a0e3-d0b7a5200b62 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:56.582841 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1319/2635] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:57:57.287828 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55069447-e9dc-4e76-aa1a-98ec68a9c45d None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:57.289369 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-55069447-e9dc-4e76-aa1a-98ec68a9c45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:57.318854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55069447-e9dc-4e76-aa1a-98ec68a9c45d None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:57.333628 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c5924-970f-435a-8b78-a8fc1424287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:57.335294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c5924-970f-435a-8b78-a8fc1424287e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:57.335623 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c5924-970f-435a-8b78-a8fc1424287e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:57.335910 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c5924-970f-435a-8b78-a8fc1424287e admin admin] PATH_INFO: `/v3/projects/5016db19798b474cbad8d45bd1dfb88d` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:57.337491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c5924-970f-435a-8b78-a8fc1424287e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5016db19798b474cbad8d45bd1dfb88d)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:57.339735 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c5924-970f-435a-8b78-a8fc1424287e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:57.467512 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e62c5924-970f-435a-8b78-a8fc1424287e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5016db19798b474cbad8d45bd1dfb88d', 'request_id': 'req-e62c5924-970f-435a-8b78-a8fc1424287e'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:57.476714 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e62c5924-970f-435a-8b78-a8fc1424287e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5016db19798b474cbad8d45bd1dfb88d', 'request_id': 'req-e62c5924-970f-435a-8b78-a8fc1424287e'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:57.564295 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e62c5924-970f-435a-8b78-a8fc1424287e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5016db19798b474cbad8d45bd1dfb88d', 'request_id': 'req-e62c5924-970f-435a-8b78-a8fc1424287e'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:57.578425 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e62c5924-970f-435a-8b78-a8fc1424287e admin admin] The token cache is being invalidate because project 5016db19798b474cbad8d45bd1dfb88d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:57:57.578824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e62c5924-970f-435a-8b78-a8fc1424287e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:57.579560 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e62c5924-970f-435a-8b78-a8fc1424287e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:57.581537 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1317/2636] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:57:57 2022] DELETE /identity/v3/projects/5016db19798b474cbad8d45bd1dfb88d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:57.585742 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3967f58-6643-4d07-a0e3-d0b7a5200b62 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:57.597540 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3967f58-6643-4d07-a0e3-d0b7a5200b62 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:57.690512 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69627a-b115-4e4b-9bad-b335e50a0584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:57.692838 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69627a-b115-4e4b-9bad-b335e50a0584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:57.693223 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69627a-b115-4e4b-9bad-b335e50a0584 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:57.693940 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69627a-b115-4e4b-9bad-b335e50a0584 admin admin] PATH_INFO: `/v3/users/f50ddc7f83994e59a0d29f46ea871990` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:57.696181 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69627a-b115-4e4b-9bad-b335e50a0584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f50ddc7f83994e59a0d29f46ea871990)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:57.702238 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69627a-b115-4e4b-9bad-b335e50a0584 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:57.719575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:57.899849 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-6d69627a-b115-4e4b-9bad-b335e50a0584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f50ddc7f83994e59a0d29f46ea871990'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:57.998214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-6d69627a-b115-4e4b-9bad-b335e50a0584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f50ddc7f83994e59a0d29f46ea871990'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:58.014215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-6d69627a-b115-4e4b-9bad-b335e50a0584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f50ddc7f83994e59a0d29f46ea871990'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:58.014913 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-6d69627a-b115-4e4b-9bad-b335e50a0584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f50ddc7f83994e59a0d29f46ea871990'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:58.022179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-6d69627a-b115-4e4b-9bad-b335e50a0584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f50ddc7f83994e59a0d29f46ea871990'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:58.029250 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1320/2637] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:57:57 2022] DELETE /identity/v3/users/f50ddc7f83994e59a0d29f46ea871990 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:58.040737 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c5924-970f-435a-8b78-a8fc1424287e admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:58.042198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e62c5924-970f-435a-8b78-a8fc1424287e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:58.055787 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c5924-970f-435a-8b78-a8fc1424287e admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:58.113954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5f555-36b3-4a68-a551-808900d7b11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:58.114840 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5f555-36b3-4a68-a551-808900d7b11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:58.115124 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5f555-36b3-4a68-a551-808900d7b11a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:58.115396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5f555-36b3-4a68-a551-808900d7b11a admin admin] PATH_INFO: `/v3/users/e60dc0b260b048208a1349e1f9cc59a3` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:58.116700 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5f555-36b3-4a68-a551-808900d7b11a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e60dc0b260b048208a1349e1f9cc59a3)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:58.118626 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5f555-36b3-4a68-a551-808900d7b11a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:58.333964 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-22a5f555-36b3-4a68-a551-808900d7b11a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e60dc0b260b048208a1349e1f9cc59a3'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:58.415755 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-22a5f555-36b3-4a68-a551-808900d7b11a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e60dc0b260b048208a1349e1f9cc59a3'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:58.420883 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:58.428770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-22a5f555-36b3-4a68-a551-808900d7b11a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e60dc0b260b048208a1349e1f9cc59a3'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:58.435429 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-22a5f555-36b3-4a68-a551-808900d7b11a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e60dc0b260b048208a1349e1f9cc59a3'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:58.436097 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-22a5f555-36b3-4a68-a551-808900d7b11a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e60dc0b260b048208a1349e1f9cc59a3'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:58.442241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1318/2638] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:57:58 2022] DELETE /identity/v3/users/e60dc0b260b048208a1349e1f9cc59a3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:57:58.446945 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7123c9c-d1da-4613-b22c-ebc29cf45555 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:58.447239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7123c9c-d1da-4613-b22c-ebc29cf45555 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:58.447522 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7123c9c-d1da-4613-b22c-ebc29cf45555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:58.468621 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5f555-36b3-4a68-a551-808900d7b11a admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:58.469790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-d7123c9c-d1da-4613-b22c-ebc29cf45555 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:58.470747 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-22a5f555-36b3-4a68-a551-808900d7b11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:58.471333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d7123c9c-d1da-4613-b22c-ebc29cf45555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:58.559700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1321/2639] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:58.563992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5f555-36b3-4a68-a551-808900d7b11a admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:58.569113 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92131c19-d928-44e8-a8c8-6d2bec23f491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:58.569952 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92131c19-d928-44e8-a8c8-6d2bec23f491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:58.570070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7123c9c-d1da-4613-b22c-ebc29cf45555 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:58.570233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92131c19-d928-44e8-a8c8-6d2bec23f491 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:58.570834 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92131c19-d928-44e8-a8c8-6d2bec23f491 admin admin] PATH_INFO: `/v3/projects/7be4a0fda3af4f01aa027b86ac6e9f22` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:58.571515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d7123c9c-d1da-4613-b22c-ebc29cf45555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:58.571718 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92131c19-d928-44e8-a8c8-6d2bec23f491 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7be4a0fda3af4f01aa027b86ac6e9f22)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:58.573633 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92131c19-d928-44e8-a8c8-6d2bec23f491 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:58.629866 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7123c9c-d1da-4613-b22c-ebc29cf45555 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:58.633574 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4854e8e5-c15a-40a9-93ba-fb54fc33f5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:58.634365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854e8e5-c15a-40a9-93ba-fb54fc33f5af service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:58.634692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854e8e5-c15a-40a9-93ba-fb54fc33f5af service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:58.635001 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4854e8e5-c15a-40a9-93ba-fb54fc33f5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:58.644924 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854e8e5-c15a-40a9-93ba-fb54fc33f5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:58.646476 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4854e8e5-c15a-40a9-93ba-fb54fc33f5af service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:58.656125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1322/2640] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:57:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:57:58.673636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-92131c19-d928-44e8-a8c8-6d2bec23f491 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7be4a0fda3af4f01aa027b86ac6e9f22', 'request_id': 'req-92131c19-d928-44e8-a8c8-6d2bec23f491'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:58.679870 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-92131c19-d928-44e8-a8c8-6d2bec23f491 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7be4a0fda3af4f01aa027b86ac6e9f22', 'request_id': 'req-92131c19-d928-44e8-a8c8-6d2bec23f491'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:58.792480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-92131c19-d928-44e8-a8c8-6d2bec23f491 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7be4a0fda3af4f01aa027b86ac6e9f22', 'request_id': 'req-92131c19-d928-44e8-a8c8-6d2bec23f491'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:58.803269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-92131c19-d928-44e8-a8c8-6d2bec23f491 admin admin] The token cache is being invalidate because project 7be4a0fda3af4f01aa027b86ac6e9f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:57:58.803578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-92131c19-d928-44e8-a8c8-6d2bec23f491 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:58.804208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-92131c19-d928-44e8-a8c8-6d2bec23f491 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:58.805826 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1319/2641] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:57:58 2022] DELETE /identity/v3/projects/7be4a0fda3af4f01aa027b86ac6e9f22 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:58.810881 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04eba6-ea92-4a87-a80f-0328997e6aa6 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:58.811174 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04eba6-ea92-4a87-a80f-0328997e6aa6 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:58.811462 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04eba6-ea92-4a87-a80f-0328997e6aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:58.832542 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-2a04eba6-ea92-4a87-a80f-0328997e6aa6 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:58.833760 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-2a04eba6-ea92-4a87-a80f-0328997e6aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:58.857941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:58.897886 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1323/2642] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:57:58.905849 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4079ede-a37a-4124-a401-8dcda9020997 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:58.906346 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4079ede-a37a-4124-a401-8dcda9020997 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:58.906561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4079ede-a37a-4124-a401-8dcda9020997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:58.925008 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-b4079ede-a37a-4124-a401-8dcda9020997 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:58.926823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b4079ede-a37a-4124-a401-8dcda9020997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:58.935402 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1320/2643] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:58.940016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04eba6-ea92-4a87-a80f-0328997e6aa6 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:58.952206 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04eba6-ea92-4a87-a80f-0328997e6aa6 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:58.956864 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e963e-c383-448e-bcba-6130bdbd1c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:58.957574 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e963e-c383-448e-bcba-6130bdbd1c85 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:58.957822 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e963e-c383-448e-bcba-6130bdbd1c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:58.958095 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e963e-c383-448e-bcba-6130bdbd1c85 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:58.958826 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e963e-c383-448e-bcba-6130bdbd1c85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:57:58.959135 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e963e-c383-448e-bcba-6130bdbd1c85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:58.960761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e963e-c383-448e-bcba-6130bdbd1c85 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:58.972659 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1324/2644] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:57:58.977125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4079ede-a37a-4124-a401-8dcda9020997 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:58.986801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4079ede-a37a-4124-a401-8dcda9020997 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:58.992405 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dc547-307f-45d5-a586-4d911f506de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:58.993080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dc547-307f-45d5-a586-4d911f506de6 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:58.993358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dc547-307f-45d5-a586-4d911f506de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:58.993622 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5dc547-307f-45d5-a586-4d911f506de6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:58.994335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dc547-307f-45d5-a586-4d911f506de6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:58.996278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5dc547-307f-45d5-a586-4d911f506de6 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:59.085494 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e963e-c383-448e-bcba-6130bdbd1c85 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:59.087360 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-692e963e-c383-448e-bcba-6130bdbd1c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:59.090748 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1321/2645] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:57:58 2022] POST /identity/v3/projects => generated 407 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:59.091670 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dc547-307f-45d5-a586-4d911f506de6 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:59.101822 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e963e-c383-448e-bcba-6130bdbd1c85 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:59.139965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:59.160985 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5dc547-307f-45d5-a586-4d911f506de6 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:59.164486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f14559-d844-418a-9de4-d378999567d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:59.165352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f14559-d844-418a-9de4-d378999567d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:59.165633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f14559-d844-418a-9de4-d378999567d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:59.165766 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637617c5-0ede-4bfe-b6c0-c3ee5272e21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:59.165910 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f14559-d844-418a-9de4-d378999567d4 admin admin] PATH_INFO: `/v3/projects/7d1d2666abed43f29acd1deb4ad1681f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:59.166370 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637617c5-0ede-4bfe-b6c0-c3ee5272e21d admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:59.166659 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637617c5-0ede-4bfe-b6c0-c3ee5272e21d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:59.166940 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637617c5-0ede-4bfe-b6c0-c3ee5272e21d admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:59.167064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f14559-d844-418a-9de4-d378999567d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1d2666abed43f29acd1deb4ad1681f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:59.167688 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637617c5-0ede-4bfe-b6c0-c3ee5272e21d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:59.169253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f14559-d844-418a-9de4-d378999567d4 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:59.169645 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637617c5-0ede-4bfe-b6c0-c3ee5272e21d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:59.261692 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1322/2646] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:57:59 2022] POST /identity/v3/users => generated 304 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:57:59.265765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637617c5-0ede-4bfe-b6c0-c3ee5272e21d admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:59.275293 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637617c5-0ede-4bfe-b6c0-c3ee5272e21d admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:59.280072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabf86d-797d-4d63-be33-26f0075c7ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:59.280705 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabf86d-797d-4d63-be33-26f0075c7ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:59.280986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabf86d-797d-4d63-be33-26f0075c7ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:59.281288 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cabf86d-797d-4d63-be33-26f0075c7ab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:59.282003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabf86d-797d-4d63-be33-26f0075c7ab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:59.283877 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cabf86d-797d-4d63-be33-26f0075c7ab7 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:59.298301 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1323/2647] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:57:59.299799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabf86d-797d-4d63-be33-26f0075c7ab7 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:59.307419 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-76f14559-d844-418a-9de4-d378999567d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1d2666abed43f29acd1deb4ad1681f', 'request_id': 'req-76f14559-d844-418a-9de4-d378999567d4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:59.310117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cabf86d-797d-4d63-be33-26f0075c7ab7 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:59.366621 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648dbd9-56ac-4ad3-97fa-b23fe54588ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:59.367202 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648dbd9-56ac-4ad3-97fa-b23fe54588ab admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:59.367483 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648dbd9-56ac-4ad3-97fa-b23fe54588ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:59.367831 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648dbd9-56ac-4ad3-97fa-b23fe54588ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:59.368550 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648dbd9-56ac-4ad3-97fa-b23fe54588ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:59.370132 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648dbd9-56ac-4ad3-97fa-b23fe54588ab admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:59.380281 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1324/2648] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:57:59.384336 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648dbd9-56ac-4ad3-97fa-b23fe54588ab admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:59.394059 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648dbd9-56ac-4ad3-97fa-b23fe54588ab admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:59.399415 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51c103-badb-4919-b657-00568ac1acc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:59.400364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51c103-badb-4919-b657-00568ac1acc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:59.400647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51c103-badb-4919-b657-00568ac1acc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:59.400926 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51c103-badb-4919-b657-00568ac1acc3 admin admin] PATH_INFO: `/v3/projects/ffddb8fa383d47d59c0b91e4f0d0f554/users/4b737a342afd4a82b995c116b2547792/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:59.415230 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51c103-badb-4919-b657-00568ac1acc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffddb8fa383d47d59c0b91e4f0d0f554, user_id=4b737a342afd4a82b995c116b2547792, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:59.417908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51c103-badb-4919-b657-00568ac1acc3 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:59.472334 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-76f14559-d844-418a-9de4-d378999567d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1d2666abed43f29acd1deb4ad1681f', 'request_id': 'req-76f14559-d844-418a-9de4-d378999567d4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:59.478696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-76f14559-d844-418a-9de4-d378999567d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1d2666abed43f29acd1deb4ad1681f', 'request_id': 'req-76f14559-d844-418a-9de4-d378999567d4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:59.491334 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-76f14559-d844-418a-9de4-d378999567d4 admin admin] The token cache is being invalidate because project 7d1d2666abed43f29acd1deb4ad1681f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:57:59.491667 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-76f14559-d844-418a-9de4-d378999567d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:59.492340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-76f14559-d844-418a-9de4-d378999567d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:59.494084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1325/2649] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:57:59 2022] DELETE /identity/v3/projects/7d1d2666abed43f29acd1deb4ad1681f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:59.497852 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f14559-d844-418a-9de4-d378999567d4 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:59.499254 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-76f14559-d844-418a-9de4-d378999567d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:59.512588 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f14559-d844-418a-9de4-d378999567d4 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:59.523255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c24d6-8b2c-4d61-bd33-a7d60246ce32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:59.524413 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c24d6-8b2c-4d61-bd33-a7d60246ce32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:59.524705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c24d6-8b2c-4d61-bd33-a7d60246ce32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:59.524985 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c24d6-8b2c-4d61-bd33-a7d60246ce32 admin admin] PATH_INFO: `/v3/users/4af68b9b471042229918b5bee20924ce` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:59.526304 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c24d6-8b2c-4d61-bd33-a7d60246ce32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af68b9b471042229918b5bee20924ce)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:59.528596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c24d6-8b2c-4d61-bd33-a7d60246ce32 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:59.540007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1325/2650] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:57:59 2022] PUT /identity/v3/projects/ffddb8fa383d47d59c0b91e4f0d0f554/users/4b737a342afd4a82b995c116b2547792/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:59.552186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17408dc-7dfb-455d-8ff7-cb7d6dbddb74 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:59.552618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17408dc-7dfb-455d-8ff7-cb7d6dbddb74 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:59.552973 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17408dc-7dfb-455d-8ff7-cb7d6dbddb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:59.580776 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-b17408dc-7dfb-455d-8ff7-cb7d6dbddb74 None None] MFA Rules not processed for user `4b737a342afd4a82b995c116b2547792`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:57:59.582005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b17408dc-7dfb-455d-8ff7-cb7d6dbddb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:59.647011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1326/2651] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:57:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:57:59.651255 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17408dc-7dfb-455d-8ff7-cb7d6dbddb74 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:59.652576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b17408dc-7dfb-455d-8ff7-cb7d6dbddb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:59.671552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:59.709997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:57:59.715755 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0f5c24d6-8b2c-4d61-bd33-a7d60246ce32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af68b9b471042229918b5bee20924ce'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:59.716171 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17408dc-7dfb-455d-8ff7-cb7d6dbddb74 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:59.721156 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b39511-4d8f-4bed-b119-f762ac8a816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:59.721939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b39511-4d8f-4bed-b119-f762ac8a816d admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:59.722231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b39511-4d8f-4bed-b119-f762ac8a816d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:59.722687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b39511-4d8f-4bed-b119-f762ac8a816d admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:59.723312 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b39511-4d8f-4bed-b119-f762ac8a816d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:59.725350 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b39511-4d8f-4bed-b119-f762ac8a816d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:57:59.791996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0f5c24d6-8b2c-4d61-bd33-a7d60246ce32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af68b9b471042229918b5bee20924ce'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:59.805016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0f5c24d6-8b2c-4d61-bd33-a7d60246ce32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af68b9b471042229918b5bee20924ce'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:59.805707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0f5c24d6-8b2c-4d61-bd33-a7d60246ce32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af68b9b471042229918b5bee20924ce'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:59.812532 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0f5c24d6-8b2c-4d61-bd33-a7d60246ce32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af68b9b471042229918b5bee20924ce'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:57:59.818987 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1326/2652] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:57:59 2022] DELETE /identity/v3/users/4af68b9b471042229918b5bee20924ce => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:57:59.835119 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1327/2653] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:57:59 2022] POST /identity/v3/projects => generated 405 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:57:59.843872 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c24d6-8b2c-4d61-bd33-a7d60246ce32 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:57:59.845359 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0f5c24d6-8b2c-4d61-bd33-a7d60246ce32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:57:59.914922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c24d6-8b2c-4d61-bd33-a7d60246ce32 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:57:59.971885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc24f5e-3d2b-4676-873e-9241d0ffb809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:57:59.973879 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc24f5e-3d2b-4676-873e-9241d0ffb809 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:57:59.973879 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc24f5e-3d2b-4676-873e-9241d0ffb809 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:57:59.973879 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc24f5e-3d2b-4676-873e-9241d0ffb809 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:57:59.975198 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc24f5e-3d2b-4676-873e-9241d0ffb809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:57:59.976036 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc24f5e-3d2b-4676-873e-9241d0ffb809 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:00.099964 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1327/2654] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:57:59 2022] POST /identity/v3/users => generated 309 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:00.100792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b39511-4d8f-4bed-b119-f762ac8a816d admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:00.112226 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b39511-4d8f-4bed-b119-f762ac8a816d admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:00.117588 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aed254-86cb-4df4-a3f5-a4a10d204e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:00.118319 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aed254-86cb-4df4-a3f5-a4a10d204e07 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:00.118605 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aed254-86cb-4df4-a3f5-a4a10d204e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:00.118884 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aed254-86cb-4df4-a3f5-a4a10d204e07 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:00.119939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aed254-86cb-4df4-a3f5-a4a10d204e07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:00.121406 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aed254-86cb-4df4-a3f5-a4a10d204e07 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:00.132415 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1328/2655] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:00.138941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc24f5e-3d2b-4676-873e-9241d0ffb809 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:00.147760 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc24f5e-3d2b-4676-873e-9241d0ffb809 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:00.152955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862b2a6-1586-4396-87e5-be42dfece676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:00.153877 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862b2a6-1586-4396-87e5-be42dfece676 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:00.154167 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862b2a6-1586-4396-87e5-be42dfece676 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:00.154447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862b2a6-1586-4396-87e5-be42dfece676 admin admin] PATH_INFO: `/v3/projects/0b47c6f557f64ca9ad5dec697860d479/users/66d726370ca542ff9916db8d29d42432/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:00.172231 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862b2a6-1586-4396-87e5-be42dfece676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b47c6f557f64ca9ad5dec697860d479, user_id=66d726370ca542ff9916db8d29d42432, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:00.174104 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862b2a6-1586-4396-87e5-be42dfece676 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:00.284282 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1328/2656] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:00 2022] PUT /identity/v3/projects/0b47c6f557f64ca9ad5dec697860d479/users/66d726370ca542ff9916db8d29d42432/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:00.288977 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aed254-86cb-4df4-a3f5-a4a10d204e07 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:00.299362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aed254-86cb-4df4-a3f5-a4a10d204e07 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:00.314756 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862b2a6-1586-4396-87e5-be42dfece676 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:00.317038 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-8862b2a6-1586-4396-87e5-be42dfece676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:00.365260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f86637-2ea1-4524-beac-6c2c159b404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:00.365934 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f86637-2ea1-4524-beac-6c2c159b404f admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:00.366216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f86637-2ea1-4524-beac-6c2c159b404f admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:00.366608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f86637-2ea1-4524-beac-6c2c159b404f admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:00.366841 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:00.367286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f86637-2ea1-4524-beac-6c2c159b404f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:00.368865 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f86637-2ea1-4524-beac-6c2c159b404f admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:00.378926 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1329/2657] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:58:00.383120 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f86637-2ea1-4524-beac-6c2c159b404f admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:00.392890 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f86637-2ea1-4524-beac-6c2c159b404f admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:00.398566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862b2a6-1586-4396-87e5-be42dfece676 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:00.399217 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4f4ee-6263-46e2-889f-083cae6382af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:00.400125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4f4ee-6263-46e2-889f-083cae6382af admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:00.400409 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4f4ee-6263-46e2-889f-083cae6382af admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:00.400681 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4f4ee-6263-46e2-889f-083cae6382af admin admin] PATH_INFO: `/v3/projects/0b47c6f557f64ca9ad5dec697860d479/users/66d726370ca542ff9916db8d29d42432/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:00.403253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b35e965-45bf-4b90-a78f-fdc458724a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:00.403950 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4f4ee-6263-46e2-889f-083cae6382af admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b47c6f557f64ca9ad5dec697860d479, user_id=66d726370ca542ff9916db8d29d42432, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:00.404373 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35e965-45bf-4b90-a78f-fdc458724a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:00.404663 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35e965-45bf-4b90-a78f-fdc458724a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:00.404946 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b35e965-45bf-4b90-a78f-fdc458724a68 admin admin] PATH_INFO: `/v3/projects/1a0b5c0e42924d0bbef277fd3f3e3292` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:00.406140 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35e965-45bf-4b90-a78f-fdc458724a68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a0b5c0e42924d0bbef277fd3f3e3292)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:00.406582 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4f4ee-6263-46e2-889f-083cae6382af admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:00.408083 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b35e965-45bf-4b90-a78f-fdc458724a68 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:00.418060 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1330/2658] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:00 2022] PUT /identity/v3/projects/0b47c6f557f64ca9ad5dec697860d479/users/66d726370ca542ff9916db8d29d42432/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:00.428206 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683e18b-b0c6-4e4e-9f45-afd472664394 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:00.428438 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683e18b-b0c6-4e4e-9f45-afd472664394 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:00.428725 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683e18b-b0c6-4e4e-9f45-afd472664394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:00.454617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-3683e18b-b0c6-4e4e-9f45-afd472664394 None None] MFA Rules not processed for user `66d726370ca542ff9916db8d29d42432`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:00.455885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-3683e18b-b0c6-4e4e-9f45-afd472664394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:00.523216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:00.527376 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1331/2659] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:58:00.541059 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683e18b-b0c6-4e4e-9f45-afd472664394 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:00.542640 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-3683e18b-b0c6-4e4e-9f45-afd472664394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:00.543788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-6b35e965-45bf-4b90-a78f-fdc458724a68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a0b5c0e42924d0bbef277fd3f3e3292', 'request_id': 'req-6b35e965-45bf-4b90-a78f-fdc458724a68'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:00.599107 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-6b35e965-45bf-4b90-a78f-fdc458724a68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a0b5c0e42924d0bbef277fd3f3e3292', 'request_id': 'req-6b35e965-45bf-4b90-a78f-fdc458724a68'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:00.600825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683e18b-b0c6-4e4e-9f45-afd472664394 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:00.605432 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-6b35e965-45bf-4b90-a78f-fdc458724a68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a0b5c0e42924d0bbef277fd3f3e3292', 'request_id': 'req-6b35e965-45bf-4b90-a78f-fdc458724a68'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:00.616712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-6b35e965-45bf-4b90-a78f-fdc458724a68 admin admin] The token cache is being invalidate because project 1a0b5c0e42924d0bbef277fd3f3e3292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:00.619624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-6b35e965-45bf-4b90-a78f-fdc458724a68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:00.619624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-6b35e965-45bf-4b90-a78f-fdc458724a68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:00.619624 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1329/2660] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:00 2022] DELETE /identity/v3/projects/1a0b5c0e42924d0bbef277fd3f3e3292 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:00.623859 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15702998-2472-419f-819d-516e5bd6200a None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:00.624154 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15702998-2472-419f-819d-516e5bd6200a None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:00.624437 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15702998-2472-419f-819d-516e5bd6200a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:00.642187 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-15702998-2472-419f-819d-516e5bd6200a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:00.643415 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-15702998-2472-419f-819d-516e5bd6200a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:00.650459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66be661-eab5-4d1e-aad2-3bf2594b22b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:00.651109 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66be661-eab5-4d1e-aad2-3bf2594b22b7 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:00.651396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66be661-eab5-4d1e-aad2-3bf2594b22b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:00.651709 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66be661-eab5-4d1e-aad2-3bf2594b22b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:00.653547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-c66be661-eab5-4d1e-aad2-3bf2594b22b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:00.704643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1330/2661] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:58:00.713433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91680627-b1a8-4b4a-b189-b90b78f66b38 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:00.714039 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91680627-b1a8-4b4a-b189-b90b78f66b38 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:00.714039 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91680627-b1a8-4b4a-b189-b90b78f66b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:00.717088 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66be661-eab5-4d1e-aad2-3bf2594b22b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:00.718667 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66be661-eab5-4d1e-aad2-3bf2594b22b7 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:00.728981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1332/2662] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:00 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:00.733664 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-91680627-b1a8-4b4a-b189-b90b78f66b38 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:00.735215 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-91680627-b1a8-4b4a-b189-b90b78f66b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:00.743621 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1331/2663] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:58:00.748922 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66be661-eab5-4d1e-aad2-3bf2594b22b7 service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:00.758539 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66be661-eab5-4d1e-aad2-3bf2594b22b7 service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:00.763199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8eb6a3-befa-445d-9ddc-2db182b40d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:00.768779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8eb6a3-befa-445d-9ddc-2db182b40d1b admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:00.768779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8eb6a3-befa-445d-9ddc-2db182b40d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:00.768779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8eb6a3-befa-445d-9ddc-2db182b40d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:00.768779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8eb6a3-befa-445d-9ddc-2db182b40d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:58:00.768779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8eb6a3-befa-445d-9ddc-2db182b40d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:00.768779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8eb6a3-befa-445d-9ddc-2db182b40d1b admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:00.783294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1333/2664] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:58:00.786440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91680627-b1a8-4b4a-b189-b90b78f66b38 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:00.795718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91680627-b1a8-4b4a-b189-b90b78f66b38 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:00.800646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fd1f1-1018-40a9-9664-e7002e4a0f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:00.801412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fd1f1-1018-40a9-9664-e7002e4a0f66 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:00.801620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fd1f1-1018-40a9-9664-e7002e4a0f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:00.801856 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438fd1f1-1018-40a9-9664-e7002e4a0f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:00.802683 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fd1f1-1018-40a9-9664-e7002e4a0f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:00.805640 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438fd1f1-1018-40a9-9664-e7002e4a0f66 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:00.908013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1332/2665] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:00 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:00.909276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8eb6a3-befa-445d-9ddc-2db182b40d1b admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:00.919451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8eb6a3-befa-445d-9ddc-2db182b40d1b admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:00.977900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6892d4-3f29-4516-b01c-35aa0db97b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:00.978581 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6892d4-3f29-4516-b01c-35aa0db97b19 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:00.978871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6892d4-3f29-4516-b01c-35aa0db97b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:00.979151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6892d4-3f29-4516-b01c-35aa0db97b19 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:00.980228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6892d4-3f29-4516-b01c-35aa0db97b19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:00.982245 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6892d4-3f29-4516-b01c-35aa0db97b19 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:01.086548 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1334/2666] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:00 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:01.090417 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fd1f1-1018-40a9-9664-e7002e4a0f66 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:01.093835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6892d4-3f29-4516-b01c-35aa0db97b19 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:01.095496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-1e6892d4-3f29-4516-b01c-35aa0db97b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:01.101048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438fd1f1-1018-40a9-9664-e7002e4a0f66 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:01.106654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553edcf9-1c84-486e-aac5-b9d9877e0a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:01.107314 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553edcf9-1c84-486e-aac5-b9d9877e0a39 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:01.107647 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553edcf9-1c84-486e-aac5-b9d9877e0a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:01.107915 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553edcf9-1c84-486e-aac5-b9d9877e0a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:01.108658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553edcf9-1c84-486e-aac5-b9d9877e0a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:01.110253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553edcf9-1c84-486e-aac5-b9d9877e0a39 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:01.121236 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1333/2667] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:01.125070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553edcf9-1c84-486e-aac5-b9d9877e0a39 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:01.135911 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553edcf9-1c84-486e-aac5-b9d9877e0a39 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:01.140769 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf853a-ee78-4529-8dd3-298bc6abd1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:01.141421 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf853a-ee78-4529-8dd3-298bc6abd1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:01.141708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf853a-ee78-4529-8dd3-298bc6abd1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:01.141987 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf853a-ee78-4529-8dd3-298bc6abd1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:01.142714 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf853a-ee78-4529-8dd3-298bc6abd1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:01.144338 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf853a-ee78-4529-8dd3-298bc6abd1f0 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:01.152928 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6892d4-3f29-4516-b01c-35aa0db97b19 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:01.154468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1334/2668] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:01.157027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880a37bf-7e53-4079-a0fa-82603ddb95c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:01.157808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a37bf-7e53-4079-a0fa-82603ddb95c8 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:01.158013 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a37bf-7e53-4079-a0fa-82603ddb95c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:01.158295 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880a37bf-7e53-4079-a0fa-82603ddb95c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:01.159336 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf853a-ee78-4529-8dd3-298bc6abd1f0 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:01.160286 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-880a37bf-7e53-4079-a0fa-82603ddb95c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:01.169035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf853a-ee78-4529-8dd3-298bc6abd1f0 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:01.173825 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5993358-1fb8-4518-9d4d-f9333e9094d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:01.174693 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5993358-1fb8-4518-9d4d-f9333e9094d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:01.174980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5993358-1fb8-4518-9d4d-f9333e9094d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:01.175266 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5993358-1fb8-4518-9d4d-f9333e9094d8 admin admin] PATH_INFO: `/v3/projects/e9b45f33086a432ca65df5d5ae5d2d5d/users/bfb956933823471db4a5d62be3b6d34b/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:01.190528 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5993358-1fb8-4518-9d4d-f9333e9094d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9b45f33086a432ca65df5d5ae5d2d5d, user_id=bfb956933823471db4a5d62be3b6d34b, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:01.194805 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5993358-1fb8-4518-9d4d-f9333e9094d8 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:01.220151 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a37bf-7e53-4079-a0fa-82603ddb95c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:01.221590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880a37bf-7e53-4079-a0fa-82603ddb95c8 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:01.230677 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1335/2669] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:01 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:58:01.286798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1335/2670] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:01 2022] PUT /identity/v3/projects/e9b45f33086a432ca65df5d5ae5d2d5d/users/bfb956933823471db4a5d62be3b6d34b/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:01.296601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a88de9-c14e-4d65-93a2-96df90b22cab None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:01.296959 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a88de9-c14e-4d65-93a2-96df90b22cab None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:01.297331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a88de9-c14e-4d65-93a2-96df90b22cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:01.325394 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-e9a88de9-c14e-4d65-93a2-96df90b22cab None None] MFA Rules not processed for user `bfb956933823471db4a5d62be3b6d34b`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:01.326722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e9a88de9-c14e-4d65-93a2-96df90b22cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:01.390884 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1336/2671] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:01.395523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5993358-1fb8-4518-9d4d-f9333e9094d8 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:01.438614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:01.458038 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5993358-1fb8-4518-9d4d-f9333e9094d8 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:01.463544 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ee34b-7049-432a-a3c6-b2d94eb16830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:01.464249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ee34b-7049-432a-a3c6-b2d94eb16830 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:01.464537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ee34b-7049-432a-a3c6-b2d94eb16830 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:01.464817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ee34b-7049-432a-a3c6-b2d94eb16830 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:01.465511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ee34b-7049-432a-a3c6-b2d94eb16830 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:01.467474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ee34b-7049-432a-a3c6-b2d94eb16830 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:01.518804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:01.554840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1336/2672] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:01 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:01.559235 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a88de9-c14e-4d65-93a2-96df90b22cab None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:01.570107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a88de9-c14e-4d65-93a2-96df90b22cab None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:01.627321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cd2b5-8fd8-414e-a29c-02a1d665ac2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:01.628028 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cd2b5-8fd8-414e-a29c-02a1d665ac2a admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:01.628319 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cd2b5-8fd8-414e-a29c-02a1d665ac2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:01.628599 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cd2b5-8fd8-414e-a29c-02a1d665ac2a admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:01.629302 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cd2b5-8fd8-414e-a29c-02a1d665ac2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:01.631233 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cd2b5-8fd8-414e-a29c-02a1d665ac2a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:01.718251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1337/2673] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:01 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:01.722206 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ee34b-7049-432a-a3c6-b2d94eb16830 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:01.733611 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ee34b-7049-432a-a3c6-b2d94eb16830 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:01.736048 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:01.738859 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efe731-dbfe-47ae-a233-cd9ffa1babf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:01.740075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efe731-dbfe-47ae-a233-cd9ffa1babf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:01.740374 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efe731-dbfe-47ae-a233-cd9ffa1babf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:01.740687 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efe731-dbfe-47ae-a233-cd9ffa1babf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:01.746822 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efe731-dbfe-47ae-a233-cd9ffa1babf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:01.746822 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efe731-dbfe-47ae-a233-cd9ffa1babf1 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:01.753943 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1337/2674] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:01.758174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cd2b5-8fd8-414e-a29c-02a1d665ac2a admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:01.768055 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cd2b5-8fd8-414e-a29c-02a1d665ac2a admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:01.772772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f555040-0af7-42aa-8ccd-717ca4c6a66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:01.773356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555040-0af7-42aa-8ccd-717ca4c6a66e admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:01.773638 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555040-0af7-42aa-8ccd-717ca4c6a66e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:01.773947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f555040-0af7-42aa-8ccd-717ca4c6a66e admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:01.774666 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f555040-0af7-42aa-8ccd-717ca4c6a66e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:01.776320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f555040-0af7-42aa-8ccd-717ca4c6a66e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:01.786845 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1338/2675] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:01.790830 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efe731-dbfe-47ae-a233-cd9ffa1babf1 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:01.801980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efe731-dbfe-47ae-a233-cd9ffa1babf1 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:01.806705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9861c28-7372-4903-9eb3-2b0d7c366796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:01.807612 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9861c28-7372-4903-9eb3-2b0d7c366796 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:01.807904 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9861c28-7372-4903-9eb3-2b0d7c366796 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:01.808252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9861c28-7372-4903-9eb3-2b0d7c366796 admin admin] PATH_INFO: `/v3/projects/a989017df88f4114a8e86a572a9fcfca/users/9cbe158cdabc4ad4b08b997d38446fd8/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:01.823317 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9861c28-7372-4903-9eb3-2b0d7c366796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a989017df88f4114a8e86a572a9fcfca, user_id=9cbe158cdabc4ad4b08b997d38446fd8, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:01.826250 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9861c28-7372-4903-9eb3-2b0d7c366796 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:01.889793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1338/2676] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:01 2022] PUT /identity/v3/projects/a989017df88f4114a8e86a572a9fcfca/users/9cbe158cdabc4ad4b08b997d38446fd8/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:01.901671 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0e95-9a7e-4ffc-824a-5e3b1e0a40bd None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:01.902530 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0e95-9a7e-4ffc-824a-5e3b1e0a40bd None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:01.902952 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0e95-9a7e-4ffc-824a-5e3b1e0a40bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:01.929963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-9a8c0e95-9a7e-4ffc-824a-5e3b1e0a40bd None None] MFA Rules not processed for user `9cbe158cdabc4ad4b08b997d38446fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:01.931186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-9a8c0e95-9a7e-4ffc-824a-5e3b1e0a40bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:01.997647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1339/2677] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:02.002090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9861c28-7372-4903-9eb3-2b0d7c366796 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:02.063401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9861c28-7372-4903-9eb3-2b0d7c366796 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:02.068240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650687d-66a6-454a-86da-7f7ac3ece741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:02.068895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650687d-66a6-454a-86da-7f7ac3ece741 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:02.069185 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650687d-66a6-454a-86da-7f7ac3ece741 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:02.069469 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650687d-66a6-454a-86da-7f7ac3ece741 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:02.070172 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650687d-66a6-454a-86da-7f7ac3ece741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:02.072180 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650687d-66a6-454a-86da-7f7ac3ece741 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:02.131233 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1339/2678] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:02 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:02.134762 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c0e95-9a7e-4ffc-824a-5e3b1e0a40bd None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:02.145913 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c0e95-9a7e-4ffc-824a-5e3b1e0a40bd None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:02.200035 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6af9fe-8714-4b4d-b7f6-8ac5ea642469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:02.200715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af9fe-8714-4b4d-b7f6-8ac5ea642469 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:02.200989 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af9fe-8714-4b4d-b7f6-8ac5ea642469 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:02.201267 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af9fe-8714-4b4d-b7f6-8ac5ea642469 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:02.201947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6af9fe-8714-4b4d-b7f6-8ac5ea642469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:02.203935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6af9fe-8714-4b4d-b7f6-8ac5ea642469 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:02.312672 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1340/2679] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:02 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:02.319593 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650687d-66a6-454a-86da-7f7ac3ece741 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:02.330237 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650687d-66a6-454a-86da-7f7ac3ece741 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:02.335435 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afd619-e829-4824-bdea-19768f59b981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:02.336308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afd619-e829-4824-bdea-19768f59b981 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:02.336665 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afd619-e829-4824-bdea-19768f59b981 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:02.336953 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77afd619-e829-4824-bdea-19768f59b981 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:02.337688 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77afd619-e829-4824-bdea-19768f59b981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:02.339437 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77afd619-e829-4824-bdea-19768f59b981 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:02.353999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1340/2680] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:02.355471 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6af9fe-8714-4b4d-b7f6-8ac5ea642469 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:02.368900 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6af9fe-8714-4b4d-b7f6-8ac5ea642469 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:02.373630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129a1ff-75c0-41c0-9518-be65d3df4a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:02.378880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a1ff-75c0-41c0-9518-be65d3df4a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:02.378880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a1ff-75c0-41c0-9518-be65d3df4a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:02.378880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5129a1ff-75c0-41c0-9518-be65d3df4a3e admin admin] PATH_INFO: `/v3/projects/8c391e3bc88e44a1ab9ddeb511884f37/users/f314d5fddced4ae68212f667813505bd/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:02.393685 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129a1ff-75c0-41c0-9518-be65d3df4a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c391e3bc88e44a1ab9ddeb511884f37, user_id=f314d5fddced4ae68212f667813505bd, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:02.397031 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5129a1ff-75c0-41c0-9518-be65d3df4a3e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:02.423160 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afd619-e829-4824-bdea-19768f59b981 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:02.424934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-77afd619-e829-4824-bdea-19768f59b981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:02.437580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77afd619-e829-4824-bdea-19768f59b981 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:02.443045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcd3ae-6076-4b44-b74e-513da3178c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:02.443959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcd3ae-6076-4b44-b74e-513da3178c9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:02.444241 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcd3ae-6076-4b44-b74e-513da3178c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:02.444519 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcd3ae-6076-4b44-b74e-513da3178c9a admin admin] PATH_INFO: `/v3/users/c0eb50c75dfd47ffa2eb30f2de8103fc` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:02.445729 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcd3ae-6076-4b44-b74e-513da3178c9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0eb50c75dfd47ffa2eb30f2de8103fc)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:02.447846 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcd3ae-6076-4b44-b74e-513da3178c9a admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:02.452442 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:02.474212 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:02.479030 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1341/2681] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:02 2022] PUT /identity/v3/projects/8c391e3bc88e44a1ab9ddeb511884f37/users/f314d5fddced4ae68212f667813505bd/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:02.483083 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129a1ff-75c0-41c0-9518-be65d3df4a3e admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:02.543225 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5129a1ff-75c0-41c0-9518-be65d3df4a3e admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:02.547949 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a97c7-f8dc-4ce0-bd26-a54dca386028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:02.548546 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a97c7-f8dc-4ce0-bd26-a54dca386028 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:02.548827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a97c7-f8dc-4ce0-bd26-a54dca386028 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:02.549105 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a97c7-f8dc-4ce0-bd26-a54dca386028 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:02.549823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a97c7-f8dc-4ce0-bd26-a54dca386028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:02.551442 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a97c7-f8dc-4ce0-bd26-a54dca386028 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:02.561004 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1342/2682] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:58:02.564984 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a97c7-f8dc-4ce0-bd26-a54dca386028 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:02.574918 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a97c7-f8dc-4ce0-bd26-a54dca386028 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:02.579596 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da303f-7971-4012-be9a-6e2f71d8a64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:02.580478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da303f-7971-4012-be9a-6e2f71d8a64b admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:02.580759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da303f-7971-4012-be9a-6e2f71d8a64b admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:02.581033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da303f-7971-4012-be9a-6e2f71d8a64b admin admin] PATH_INFO: `/v3/projects/8c391e3bc88e44a1ab9ddeb511884f37/users/f314d5fddced4ae68212f667813505bd/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:02.583601 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da303f-7971-4012-be9a-6e2f71d8a64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c391e3bc88e44a1ab9ddeb511884f37, user_id=f314d5fddced4ae68212f667813505bd, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:02.586255 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da303f-7971-4012-be9a-6e2f71d8a64b admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:02.596875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1343/2683] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:02 2022] PUT /identity/v3/projects/8c391e3bc88e44a1ab9ddeb511884f37/users/f314d5fddced4ae68212f667813505bd/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:02.608078 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51212b44-7270-4d50-ae7a-9956f9e5e291 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:02.608363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51212b44-7270-4d50-ae7a-9956f9e5e291 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:02.608641 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51212b44-7270-4d50-ae7a-9956f9e5e291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:02.636813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-51212b44-7270-4d50-ae7a-9956f9e5e291 None None] MFA Rules not processed for user `f314d5fddced4ae68212f667813505bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:02.638063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-51212b44-7270-4d50-ae7a-9956f9e5e291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:02.658021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-cfbcd3ae-6076-4b44-b74e-513da3178c9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0eb50c75dfd47ffa2eb30f2de8103fc'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:02.704732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1344/2684] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:58:02.706604 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-cfbcd3ae-6076-4b44-b74e-513da3178c9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0eb50c75dfd47ffa2eb30f2de8103fc'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:02.715884 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51212b44-7270-4d50-ae7a-9956f9e5e291 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:02.720528 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-cfbcd3ae-6076-4b44-b74e-513da3178c9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0eb50c75dfd47ffa2eb30f2de8103fc'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:02.721693 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-cfbcd3ae-6076-4b44-b74e-513da3178c9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0eb50c75dfd47ffa2eb30f2de8103fc'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:02.729923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-cfbcd3ae-6076-4b44-b74e-513da3178c9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0eb50c75dfd47ffa2eb30f2de8103fc'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:02.736254 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1341/2685] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:02 2022] DELETE /identity/v3/users/c0eb50c75dfd47ffa2eb30f2de8103fc => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:02.741197 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31151c-861d-4ac7-ac3c-4cd3b3c6b0b6 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:02.741566 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31151c-861d-4ac7-ac3c-4cd3b3c6b0b6 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:02.741903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31151c-861d-4ac7-ac3c-4cd3b3c6b0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:02.759325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-7e31151c-861d-4ac7-ac3c-4cd3b3c6b0b6 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:02.760579 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-7e31151c-861d-4ac7-ac3c-4cd3b3c6b0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:02.771197 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51212b44-7270-4d50-ae7a-9956f9e5e291 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:02.790478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:02.820020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1342/2686] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:58:02.820205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e855e8f-7ff9-477d-b5ea-414138b4fd4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:02.820776 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e855e8f-7ff9-477d-b5ea-414138b4fd4c service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:02.821263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e855e8f-7ff9-477d-b5ea-414138b4fd4c service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:02.821694 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e855e8f-7ff9-477d-b5ea-414138b4fd4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:02.823903 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-5e855e8f-7ff9-477d-b5ea-414138b4fd4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:02.829378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31151c-861d-4ac7-ac3c-4cd3b3c6b0b6 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:02.830751 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-7e31151c-861d-4ac7-ac3c-4cd3b3c6b0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:02.888272 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e855e8f-7ff9-477d-b5ea-414138b4fd4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:02.889707 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e855e8f-7ff9-477d-b5ea-414138b4fd4c service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:02.889829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31151c-861d-4ac7-ac3c-4cd3b3c6b0b6 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:02.893447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b268c-4268-4328-a0df-91665014efff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:02.894090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b268c-4268-4328-a0df-91665014efff service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:02.894373 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b268c-4268-4328-a0df-91665014efff service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:02.894647 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b268c-4268-4328-a0df-91665014efff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:02.900006 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1345/2687] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:58:02.904202 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b268c-4268-4328-a0df-91665014efff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:02.905708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b268c-4268-4328-a0df-91665014efff service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:02.916371 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1343/2688] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:58:03.372401 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e855e8f-7ff9-477d-b5ea-414138b4fd4c service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:03.373843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-5e855e8f-7ff9-477d-b5ea-414138b4fd4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:03.387086 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e855e8f-7ff9-477d-b5ea-414138b4fd4c service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:03.392101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564dcc6f-6bbd-48aa-874f-29b6efcdddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:03.393016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dcc6f-6bbd-48aa-874f-29b6efcdddef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:03.393300 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dcc6f-6bbd-48aa-874f-29b6efcdddef admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:03.393571 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564dcc6f-6bbd-48aa-874f-29b6efcdddef admin admin] PATH_INFO: `/v3/projects/dead1dd9a06341ff87694eddff27f653` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:03.394838 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564dcc6f-6bbd-48aa-874f-29b6efcdddef admin admin] RBAC: Authorizing `identity:delete_project(project_id=dead1dd9a06341ff87694eddff27f653)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:03.397332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564dcc6f-6bbd-48aa-874f-29b6efcdddef admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:03.569906 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-564dcc6f-6bbd-48aa-874f-29b6efcdddef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dead1dd9a06341ff87694eddff27f653', 'request_id': 'req-564dcc6f-6bbd-48aa-874f-29b6efcdddef'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:03.575980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-564dcc6f-6bbd-48aa-874f-29b6efcdddef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dead1dd9a06341ff87694eddff27f653', 'request_id': 'req-564dcc6f-6bbd-48aa-874f-29b6efcdddef'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:03.666448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-564dcc6f-6bbd-48aa-874f-29b6efcdddef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dead1dd9a06341ff87694eddff27f653', 'request_id': 'req-564dcc6f-6bbd-48aa-874f-29b6efcdddef'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:03.677762 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-564dcc6f-6bbd-48aa-874f-29b6efcdddef admin admin] The token cache is being invalidate because project dead1dd9a06341ff87694eddff27f653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:03.678048 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-564dcc6f-6bbd-48aa-874f-29b6efcdddef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:03.678704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-564dcc6f-6bbd-48aa-874f-29b6efcdddef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:03.680308 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1346/2689] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:03 2022] DELETE /identity/v3/projects/dead1dd9a06341ff87694eddff27f653 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:03.685203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61a119-f148-45fd-9c11-d73add61f0bc None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:03.685516 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61a119-f148-45fd-9c11-d73add61f0bc None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:03.685808 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd61a119-f148-45fd-9c11-d73add61f0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:03.704525 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-cd61a119-f148-45fd-9c11-d73add61f0bc None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:03.705737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-cd61a119-f148-45fd-9c11-d73add61f0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:03.726694 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:03.766404 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1344/2690] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:03.775710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a5306-a596-4bbb-9714-b420e01caed4 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:03.775999 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a5306-a596-4bbb-9714-b420e01caed4 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:03.776278 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a5306-a596-4bbb-9714-b420e01caed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:03.794629 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-8f2a5306-a596-4bbb-9714-b420e01caed4 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:03.795950 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-8f2a5306-a596-4bbb-9714-b420e01caed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:03.803860 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1347/2691] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:03.808039 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61a119-f148-45fd-9c11-d73add61f0bc None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:03.818134 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd61a119-f148-45fd-9c11-d73add61f0bc None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:03.822684 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f447e1-d200-4505-acfa-05e3f603a72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:03.823330 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f447e1-d200-4505-acfa-05e3f603a72a admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:03.823648 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f447e1-d200-4505-acfa-05e3f603a72a admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:03.823926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f447e1-d200-4505-acfa-05e3f603a72a admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:03.824667 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f447e1-d200-4505-acfa-05e3f603a72a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:58:03.824959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f447e1-d200-4505-acfa-05e3f603a72a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:03.826610 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f447e1-d200-4505-acfa-05e3f603a72a admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:03.838511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1345/2692] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:58:03.842965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a5306-a596-4bbb-9714-b420e01caed4 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:03.852303 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a5306-a596-4bbb-9714-b420e01caed4 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:03.857162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66467cd9-6800-4e66-afb6-999da294813e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:03.857797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66467cd9-6800-4e66-afb6-999da294813e admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:03.858077 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66467cd9-6800-4e66-afb6-999da294813e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:03.858432 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66467cd9-6800-4e66-afb6-999da294813e admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:03.859123 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66467cd9-6800-4e66-afb6-999da294813e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:03.861086 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66467cd9-6800-4e66-afb6-999da294813e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:03.984255 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1348/2693] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:03 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:58:03.990401 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f447e1-d200-4505-acfa-05e3f603a72a admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:04.001288 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f447e1-d200-4505-acfa-05e3f603a72a admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:04.056991 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66467cd9-6800-4e66-afb6-999da294813e admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:04.057398 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf1c49-7649-4491-913e-1643d2cea5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:04.058064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf1c49-7649-4491-913e-1643d2cea5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:04.058347 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf1c49-7649-4491-913e-1643d2cea5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:04.058627 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf1c49-7649-4491-913e-1643d2cea5b9 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:04.058766 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-66467cd9-6800-4e66-afb6-999da294813e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:04.059327 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf1c49-7649-4491-913e-1643d2cea5b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:04.061284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadf1c49-7649-4491-913e-1643d2cea5b9 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:04.091040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:04.116396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66467cd9-6800-4e66-afb6-999da294813e admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:04.120116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d8f64-b330-45e8-8969-01d31cc8f96e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:04.120752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d8f64-b330-45e8-8969-01d31cc8f96e service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:04.121037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d8f64-b330-45e8-8969-01d31cc8f96e service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:04.121318 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d8f64-b330-45e8-8969-01d31cc8f96e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:04.123152 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-dd7d8f64-b330-45e8-8969-01d31cc8f96e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:04.164526 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1346/2694] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:03 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:04.169286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf1c49-7649-4491-913e-1643d2cea5b9 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:04.179823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf1c49-7649-4491-913e-1643d2cea5b9 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:04.184710 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d8f64-b330-45e8-8969-01d31cc8f96e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:04.185883 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08293f9-fc4f-4c49-b6e5-7b6dda4aa511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:04.186158 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7d8f64-b330-45e8-8969-01d31cc8f96e service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:04.192656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08293f9-fc4f-4c49-b6e5-7b6dda4aa511 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:04.192656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08293f9-fc4f-4c49-b6e5-7b6dda4aa511 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:04.192656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08293f9-fc4f-4c49-b6e5-7b6dda4aa511 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:04.192656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08293f9-fc4f-4c49-b6e5-7b6dda4aa511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:04.192656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08293f9-fc4f-4c49-b6e5-7b6dda4aa511 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:04.196020 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1349/2695] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:04.201084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1347/2696] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:58:04.204912 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d8f64-b330-45e8-8969-01d31cc8f96e service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:04.216240 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d8f64-b330-45e8-8969-01d31cc8f96e service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:04.220993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adad441-c784-4640-afe5-cc935b5e3024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:04.222733 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adad441-c784-4640-afe5-cc935b5e3024 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:04.222733 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adad441-c784-4640-afe5-cc935b5e3024 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:04.222733 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adad441-c784-4640-afe5-cc935b5e3024 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:04.223008 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adad441-c784-4640-afe5-cc935b5e3024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:04.224521 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adad441-c784-4640-afe5-cc935b5e3024 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:04.235760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1350/2697] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:04.240510 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08293f9-fc4f-4c49-b6e5-7b6dda4aa511 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:04.250307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08293f9-fc4f-4c49-b6e5-7b6dda4aa511 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:04.255975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430dd78-1e88-4c2c-af4f-d7052ba16de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:04.257319 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430dd78-1e88-4c2c-af4f-d7052ba16de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:04.257319 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430dd78-1e88-4c2c-af4f-d7052ba16de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:04.257544 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430dd78-1e88-4c2c-af4f-d7052ba16de7 admin admin] PATH_INFO: `/v3/projects/9aa3b6da1bb24d4caac40b1503f2e8ca/users/c472fb30615044e487e6824f82dbaec4/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:04.273063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430dd78-1e88-4c2c-af4f-d7052ba16de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa3b6da1bb24d4caac40b1503f2e8ca, user_id=c472fb30615044e487e6824f82dbaec4, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:04.275824 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430dd78-1e88-4c2c-af4f-d7052ba16de7 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:04.330297 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1348/2698] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:04 2022] PUT /identity/v3/projects/9aa3b6da1bb24d4caac40b1503f2e8ca/users/c472fb30615044e487e6824f82dbaec4/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:04.340251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f5bb4-d9a3-47ef-83c6-df5a004a285d None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:04.340537 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f5bb4-d9a3-47ef-83c6-df5a004a285d None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:04.340817 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f5bb4-d9a3-47ef-83c6-df5a004a285d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:04.367090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-ae5f5bb4-d9a3-47ef-83c6-df5a004a285d None None] MFA Rules not processed for user `c472fb30615044e487e6824f82dbaec4`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:04.368352 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ae5f5bb4-d9a3-47ef-83c6-df5a004a285d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:04.431921 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1351/2699] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:58:04.436441 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430dd78-1e88-4c2c-af4f-d7052ba16de7 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:04.502774 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430dd78-1e88-4c2c-af4f-d7052ba16de7 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:04.507700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb9bd0-3aba-419e-b189-d22178f2616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:04.508350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb9bd0-3aba-419e-b189-d22178f2616e admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:04.508633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb9bd0-3aba-419e-b189-d22178f2616e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:04.508910 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fb9bd0-3aba-419e-b189-d22178f2616e admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:04.509634 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb9bd0-3aba-419e-b189-d22178f2616e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:04.511571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fb9bd0-3aba-419e-b189-d22178f2616e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:04.526068 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:04.609227 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1349/2700] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:04 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:04.610399 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f5bb4-d9a3-47ef-83c6-df5a004a285d None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:04.621475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f5bb4-d9a3-47ef-83c6-df5a004a285d None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:04.679200 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c310a-4e46-4824-b69b-f79ec576ecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:04.679915 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c310a-4e46-4824-b69b-f79ec576ecd9 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:04.680201 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c310a-4e46-4824-b69b-f79ec576ecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:04.680482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c310a-4e46-4824-b69b-f79ec576ecd9 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:04.681213 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c310a-4e46-4824-b69b-f79ec576ecd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:04.683246 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c310a-4e46-4824-b69b-f79ec576ecd9 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:04.690988 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:04.812615 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1352/2701] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:04 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:04.814174 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb9bd0-3aba-419e-b189-d22178f2616e admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:04.824140 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fb9bd0-3aba-419e-b189-d22178f2616e admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:04.828599 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6991534-0e75-49b3-801c-6d35418fd182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:04.829249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6991534-0e75-49b3-801c-6d35418fd182 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:04.829532 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6991534-0e75-49b3-801c-6d35418fd182 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:04.829807 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6991534-0e75-49b3-801c-6d35418fd182 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:04.830712 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6991534-0e75-49b3-801c-6d35418fd182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:04.835488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6991534-0e75-49b3-801c-6d35418fd182 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:04.842915 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1350/2702] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:04.846745 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c310a-4e46-4824-b69b-f79ec576ecd9 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:04.857487 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c310a-4e46-4824-b69b-f79ec576ecd9 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:04.862168 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78f3ad-c797-4870-b03e-584e7792d5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:04.862818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78f3ad-c797-4870-b03e-584e7792d5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:04.863413 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78f3ad-c797-4870-b03e-584e7792d5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:04.864326 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78f3ad-c797-4870-b03e-584e7792d5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:04.865061 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78f3ad-c797-4870-b03e-584e7792d5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:04.866657 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78f3ad-c797-4870-b03e-584e7792d5b0 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:04.877279 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1353/2703] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:58:04.881352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6991534-0e75-49b3-801c-6d35418fd182 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:04.891912 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6991534-0e75-49b3-801c-6d35418fd182 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:04.896965 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba995f6e-7643-419a-84ed-4053f7737a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:04.897837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba995f6e-7643-419a-84ed-4053f7737a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:04.898150 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba995f6e-7643-419a-84ed-4053f7737a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:04.898426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba995f6e-7643-419a-84ed-4053f7737a4f admin admin] PATH_INFO: `/v3/projects/5ee99f40cde74ab3bbdbab8e52f0383d/users/90c2a6b638e542e3a572002d82a31be2/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:04.914658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba995f6e-7643-419a-84ed-4053f7737a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ee99f40cde74ab3bbdbab8e52f0383d, user_id=90c2a6b638e542e3a572002d82a31be2, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:04.917699 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba995f6e-7643-419a-84ed-4053f7737a4f admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:05.032850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1351/2704] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:04 2022] PUT /identity/v3/projects/5ee99f40cde74ab3bbdbab8e52f0383d/users/90c2a6b638e542e3a572002d82a31be2/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:05.043408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c8013-6677-4ece-bb91-06ab19f4c1c0 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:05.043745 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c8013-6677-4ece-bb91-06ab19f4c1c0 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:05.044038 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c8013-6677-4ece-bb91-06ab19f4c1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:05.072396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-f92c8013-6677-4ece-bb91-06ab19f4c1c0 None None] MFA Rules not processed for user `90c2a6b638e542e3a572002d82a31be2`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:05.073633 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f92c8013-6677-4ece-bb91-06ab19f4c1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:05.142903 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1354/2705] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:05.147977 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba995f6e-7643-419a-84ed-4053f7737a4f admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:05.217636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba995f6e-7643-419a-84ed-4053f7737a4f admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:05.222499 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ed8b9-bc77-4119-87b7-a23b7d8c3a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:05.223810 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ed8b9-bc77-4119-87b7-a23b7d8c3a79 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:05.224105 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ed8b9-bc77-4119-87b7-a23b7d8c3a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:05.224392 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ed8b9-bc77-4119-87b7-a23b7d8c3a79 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:05.225100 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ed8b9-bc77-4119-87b7-a23b7d8c3a79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:05.229177 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ed8b9-bc77-4119-87b7-a23b7d8c3a79 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:05.320249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1352/2706] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:05 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:58:05.324249 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c8013-6677-4ece-bb91-06ab19f4c1c0 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:05.335712 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c8013-6677-4ece-bb91-06ab19f4c1c0 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:05.391033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494f6f7-eeef-487c-9516-5748f3d9d1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:05.391733 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494f6f7-eeef-487c-9516-5748f3d9d1b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:05.392015 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494f6f7-eeef-487c-9516-5748f3d9d1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:05.392287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494f6f7-eeef-487c-9516-5748f3d9d1b3 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:05.392978 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494f6f7-eeef-487c-9516-5748f3d9d1b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:05.394943 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4494f6f7-eeef-487c-9516-5748f3d9d1b3 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:05.524829 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1355/2707] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:05 2022] POST /identity/v3/users => generated 295 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:05.529361 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ed8b9-bc77-4119-87b7-a23b7d8c3a79 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:05.539997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ed8b9-bc77-4119-87b7-a23b7d8c3a79 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:05.544582 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b0f75-271a-4cc4-8da9-cb115b3ce45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:05.545311 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b0f75-271a-4cc4-8da9-cb115b3ce45d admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:05.545596 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b0f75-271a-4cc4-8da9-cb115b3ce45d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:05.545875 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b0f75-271a-4cc4-8da9-cb115b3ce45d admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:05.546607 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b0f75-271a-4cc4-8da9-cb115b3ce45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:05.548245 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b0f75-271a-4cc4-8da9-cb115b3ce45d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:05.558962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1353/2708] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:05.562998 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494f6f7-eeef-487c-9516-5748f3d9d1b3 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:05.573824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494f6f7-eeef-487c-9516-5748f3d9d1b3 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:05.578331 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d3da-ffd3-42ca-b558-3982d0240810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:05.579213 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d3da-ffd3-42ca-b558-3982d0240810 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:05.579813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d3da-ffd3-42ca-b558-3982d0240810 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:05.579813 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5676d3da-ffd3-42ca-b558-3982d0240810 admin admin] PATH_INFO: `/v3/projects/baaf1fd002e14d0589cf68c704c48353/users/e3f6d950374e4a6099ffbb86bbb4fd22/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:05.595464 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676d3da-ffd3-42ca-b558-3982d0240810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baaf1fd002e14d0589cf68c704c48353, user_id=e3f6d950374e4a6099ffbb86bbb4fd22, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:05.598254 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5676d3da-ffd3-42ca-b558-3982d0240810 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:05.684122 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1356/2709] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:05 2022] PUT /identity/v3/projects/baaf1fd002e14d0589cf68c704c48353/users/e3f6d950374e4a6099ffbb86bbb4fd22/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:05.688211 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b0f75-271a-4cc4-8da9-cb115b3ce45d admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:05.698738 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b0f75-271a-4cc4-8da9-cb115b3ce45d admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:05.754614 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315f2e55-ef2a-4983-8b08-c0520fcbd5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:05.755273 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2e55-ef2a-4983-8b08-c0520fcbd5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:05.756248 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2e55-ef2a-4983-8b08-c0520fcbd5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:05.756531 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315f2e55-ef2a-4983-8b08-c0520fcbd5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:05.757316 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f2e55-ef2a-4983-8b08-c0520fcbd5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:05.758934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315f2e55-ef2a-4983-8b08-c0520fcbd5c4 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:05.768759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1354/2710] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:58:05.773029 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d3da-ffd3-42ca-b558-3982d0240810 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:05.783491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5676d3da-ffd3-42ca-b558-3982d0240810 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:05.788352 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b24871-44ac-42e1-978b-e9d841dfd829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:05.789316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24871-44ac-42e1-978b-e9d841dfd829 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:05.789508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24871-44ac-42e1-978b-e9d841dfd829 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:05.789785 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b24871-44ac-42e1-978b-e9d841dfd829 admin admin] PATH_INFO: `/v3/projects/baaf1fd002e14d0589cf68c704c48353/users/e3f6d950374e4a6099ffbb86bbb4fd22/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:05.791945 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b24871-44ac-42e1-978b-e9d841dfd829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baaf1fd002e14d0589cf68c704c48353, user_id=e3f6d950374e4a6099ffbb86bbb4fd22, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:05.794584 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b24871-44ac-42e1-978b-e9d841dfd829 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:05.806008 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1357/2711] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:05 2022] PUT /identity/v3/projects/baaf1fd002e14d0589cf68c704c48353/users/e3f6d950374e4a6099ffbb86bbb4fd22/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:05.873758 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2012a-94a1-4f85-bcb7-badb684e4531 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:05.874313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2012a-94a1-4f85-bcb7-badb684e4531 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:05.874313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2012a-94a1-4f85-bcb7-badb684e4531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:05.903285 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-6ea2012a-94a1-4f85-bcb7-badb684e4531 None None] MFA Rules not processed for user `e3f6d950374e4a6099ffbb86bbb4fd22`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:05.904571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-6ea2012a-94a1-4f85-bcb7-badb684e4531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:05.922355 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:05.973257 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1355/2712] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:05.985330 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b24871-44ac-42e1-978b-e9d841dfd829 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:06.011911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:06.041893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b24871-44ac-42e1-978b-e9d841dfd829 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:06.045828 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe761462-13db-408e-ad41-0008b520c144 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:06.046461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe761462-13db-408e-ad41-0008b520c144 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:06.046742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe761462-13db-408e-ad41-0008b520c144 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:06.047017 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe761462-13db-408e-ad41-0008b520c144 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:06.107703 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe761462-13db-408e-ad41-0008b520c144 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:06.109149 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe761462-13db-408e-ad41-0008b520c144 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:06.118699 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1358/2713] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:08.115519 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2012a-94a1-4f85-bcb7-badb684e4531 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:08.116977 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-6ea2012a-94a1-4f85-bcb7-badb684e4531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:08.128975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2012a-94a1-4f85-bcb7-badb684e4531 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:08.147301 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ebacf-0ba4-41eb-b115-88dba057c449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:08.147301 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ebacf-0ba4-41eb-b115-88dba057c449 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:08.147301 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ebacf-0ba4-41eb-b115-88dba057c449 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:08.147301 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ebacf-0ba4-41eb-b115-88dba057c449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:08.191283 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ebacf-0ba4-41eb-b115-88dba057c449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:08.192745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ebacf-0ba4-41eb-b115-88dba057c449 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:08.202277 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1356/2714] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:08.229494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe761462-13db-408e-ad41-0008b520c144 service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:08.231215 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-fe761462-13db-408e-ad41-0008b520c144 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:08.296724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe761462-13db-408e-ad41-0008b520c144 service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:08.301554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf2bf9-7464-48e2-b823-d6e5d98f8d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:08.302449 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf2bf9-7464-48e2-b823-d6e5d98f8d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:08.302736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf2bf9-7464-48e2-b823-d6e5d98f8d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:08.303011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf2bf9-7464-48e2-b823-d6e5d98f8d8b admin admin] PATH_INFO: `/v3/users/4b737a342afd4a82b995c116b2547792` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:08.304203 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf2bf9-7464-48e2-b823-d6e5d98f8d8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b737a342afd4a82b995c116b2547792)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:08.306152 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf2bf9-7464-48e2-b823-d6e5d98f8d8b admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:08.533473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8daf2bf9-7464-48e2-b823-d6e5d98f8d8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b737a342afd4a82b995c116b2547792'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:08.626640 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8daf2bf9-7464-48e2-b823-d6e5d98f8d8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b737a342afd4a82b995c116b2547792'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:08.639810 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8daf2bf9-7464-48e2-b823-d6e5d98f8d8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b737a342afd4a82b995c116b2547792'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:08.645462 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:08.647580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8daf2bf9-7464-48e2-b823-d6e5d98f8d8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b737a342afd4a82b995c116b2547792'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:08.648282 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-8daf2bf9-7464-48e2-b823-d6e5d98f8d8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b737a342afd4a82b995c116b2547792'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:08.654102 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1359/2715] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:08 2022] DELETE /identity/v3/users/4b737a342afd4a82b995c116b2547792 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:08.658715 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c72718-d2b7-4f48-a992-3b7a0523d138 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:08.659005 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c72718-d2b7-4f48-a992-3b7a0523d138 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:08.659281 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c72718-d2b7-4f48-a992-3b7a0523d138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:08.675931 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-d8c72718-d2b7-4f48-a992-3b7a0523d138 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:08.677136 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d8c72718-d2b7-4f48-a992-3b7a0523d138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:08.737538 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1357/2716] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:08.747474 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf2bf9-7464-48e2-b823-d6e5d98f8d8b admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:08.748861 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-8daf2bf9-7464-48e2-b823-d6e5d98f8d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:08.805772 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf2bf9-7464-48e2-b823-d6e5d98f8d8b admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:08.809468 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e32b54-88ba-4824-a64d-26d949478f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:08.810099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e32b54-88ba-4824-a64d-26d949478f26 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:08.810379 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e32b54-88ba-4824-a64d-26d949478f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:08.810653 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e32b54-88ba-4824-a64d-26d949478f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:08.819318 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e32b54-88ba-4824-a64d-26d949478f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:08.820779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e32b54-88ba-4824-a64d-26d949478f26 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:08.830036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1360/2717] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:09.183181 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c72718-d2b7-4f48-a992-3b7a0523d138 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:09.184595 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d8c72718-d2b7-4f48-a992-3b7a0523d138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:09.201089 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e32b54-88ba-4824-a64d-26d949478f26 service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:09.202736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-34e32b54-88ba-4824-a64d-26d949478f26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:09.221775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e32b54-88ba-4824-a64d-26d949478f26 service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:09.227996 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d8cf9-6a38-4cee-94d7-5b62324764cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:09.229959 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d8cf9-6a38-4cee-94d7-5b62324764cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:09.229959 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d8cf9-6a38-4cee-94d7-5b62324764cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:09.229959 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d8cf9-6a38-4cee-94d7-5b62324764cd admin admin] PATH_INFO: `/v3/projects/ffddb8fa383d47d59c0b91e4f0d0f554` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:09.231803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d8cf9-6a38-4cee-94d7-5b62324764cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffddb8fa383d47d59c0b91e4f0d0f554)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:09.235027 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d8cf9-6a38-4cee-94d7-5b62324764cd admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:09.252033 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c72718-d2b7-4f48-a992-3b7a0523d138 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:09.256103 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428d948-57b0-4658-88db-40093f0b8a2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:09.258692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428d948-57b0-4658-88db-40093f0b8a2f service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:09.258692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428d948-57b0-4658-88db-40093f0b8a2f service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:09.258692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428d948-57b0-4658-88db-40093f0b8a2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:09.259115 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d428d948-57b0-4658-88db-40093f0b8a2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:09.265164 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:09.316825 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428d948-57b0-4658-88db-40093f0b8a2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:09.318919 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428d948-57b0-4658-88db-40093f0b8a2f service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:09.328101 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1358/2718] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:09.342357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-171d8cf9-6a38-4cee-94d7-5b62324764cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffddb8fa383d47d59c0b91e4f0d0f554', 'request_id': 'req-171d8cf9-6a38-4cee-94d7-5b62324764cd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:09.348504 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-171d8cf9-6a38-4cee-94d7-5b62324764cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffddb8fa383d47d59c0b91e4f0d0f554', 'request_id': 'req-171d8cf9-6a38-4cee-94d7-5b62324764cd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:09.437927 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-171d8cf9-6a38-4cee-94d7-5b62324764cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffddb8fa383d47d59c0b91e4f0d0f554', 'request_id': 'req-171d8cf9-6a38-4cee-94d7-5b62324764cd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:09.449518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-171d8cf9-6a38-4cee-94d7-5b62324764cd admin admin] The token cache is being invalidate because project ffddb8fa383d47d59c0b91e4f0d0f554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:09.449807 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-171d8cf9-6a38-4cee-94d7-5b62324764cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:09.450426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-171d8cf9-6a38-4cee-94d7-5b62324764cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:09.452230 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1361/2719] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:09 2022] DELETE /identity/v3/projects/ffddb8fa383d47d59c0b91e4f0d0f554 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:09.455979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428d948-57b0-4658-88db-40093f0b8a2f service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:09.471610 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428d948-57b0-4658-88db-40093f0b8a2f service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:09.497074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d8cf9-6a38-4cee-94d7-5b62324764cd admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:09.498923 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-171d8cf9-6a38-4cee-94d7-5b62324764cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:09.537732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc2478-555f-4024-885b-8446066aec4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:09.539205 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc2478-555f-4024-885b-8446066aec4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:09.539508 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc2478-555f-4024-885b-8446066aec4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:09.539880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc2478-555f-4024-885b-8446066aec4e admin admin] PATH_INFO: `/v3/users/66d726370ca542ff9916db8d29d42432` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:09.541160 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc2478-555f-4024-885b-8446066aec4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=66d726370ca542ff9916db8d29d42432)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:09.543120 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcc2478-555f-4024-885b-8446066aec4e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:09.567576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d8cf9-6a38-4cee-94d7-5b62324764cd admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:09.572024 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f5f37-26a0-4fc8-a4fb-6167b3bb24c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:09.575269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f5f37-26a0-4fc8-a4fb-6167b3bb24c9 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:09.575269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f5f37-26a0-4fc8-a4fb-6167b3bb24c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:09.575269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f5f37-26a0-4fc8-a4fb-6167b3bb24c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:09.575269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-286f5f37-26a0-4fc8-a4fb-6167b3bb24c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:09.612195 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:09.644804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f5f37-26a0-4fc8-a4fb-6167b3bb24c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:09.646329 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f5f37-26a0-4fc8-a4fb-6167b3bb24c9 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:09.655801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1362/2720] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:09.709091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7fcc2478-555f-4024-885b-8446066aec4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d726370ca542ff9916db8d29d42432'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:09.758076 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7fcc2478-555f-4024-885b-8446066aec4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d726370ca542ff9916db8d29d42432'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:09.770853 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7fcc2478-555f-4024-885b-8446066aec4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d726370ca542ff9916db8d29d42432'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:09.772021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7fcc2478-555f-4024-885b-8446066aec4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d726370ca542ff9916db8d29d42432'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:09.778971 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7fcc2478-555f-4024-885b-8446066aec4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d726370ca542ff9916db8d29d42432'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:09.785206 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1359/2721] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:09 2022] DELETE /identity/v3/users/66d726370ca542ff9916db8d29d42432 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:10.213533 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f5f37-26a0-4fc8-a4fb-6167b3bb24c9 service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:10.215481 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-286f5f37-26a0-4fc8-a4fb-6167b3bb24c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:10.230552 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f5f37-26a0-4fc8-a4fb-6167b3bb24c9 service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:10.287497 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a6097-0769-47d6-947e-2304321c1baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:10.288381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a6097-0769-47d6-947e-2304321c1baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:10.288686 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a6097-0769-47d6-947e-2304321c1baa admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:10.288955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a6097-0769-47d6-947e-2304321c1baa admin admin] PATH_INFO: `/v3/projects/0b47c6f557f64ca9ad5dec697860d479` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:10.290129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a6097-0769-47d6-947e-2304321c1baa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b47c6f557f64ca9ad5dec697860d479)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:10.293380 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a6097-0769-47d6-947e-2304321c1baa admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:10.404053 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1a3a6097-0769-47d6-947e-2304321c1baa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b47c6f557f64ca9ad5dec697860d479', 'request_id': 'req-1a3a6097-0769-47d6-947e-2304321c1baa'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:10.410214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1a3a6097-0769-47d6-947e-2304321c1baa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b47c6f557f64ca9ad5dec697860d479', 'request_id': 'req-1a3a6097-0769-47d6-947e-2304321c1baa'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:10.524154 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1a3a6097-0769-47d6-947e-2304321c1baa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b47c6f557f64ca9ad5dec697860d479', 'request_id': 'req-1a3a6097-0769-47d6-947e-2304321c1baa'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:10.536004 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1a3a6097-0769-47d6-947e-2304321c1baa admin admin] The token cache is being invalidate because project 0b47c6f557f64ca9ad5dec697860d479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:10.541198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1a3a6097-0769-47d6-947e-2304321c1baa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:10.541198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-1a3a6097-0769-47d6-947e-2304321c1baa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:10.541198 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1363/2722] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:10 2022] DELETE /identity/v3/projects/0b47c6f557f64ca9ad5dec697860d479 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:10.543550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c54bef-3e64-4a29-9d7f-f0b2e26fbcc5 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:10.544062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c54bef-3e64-4a29-9d7f-f0b2e26fbcc5 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:10.544062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c54bef-3e64-4a29-9d7f-f0b2e26fbcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:10.561373 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-b9c54bef-3e64-4a29-9d7f-f0b2e26fbcc5 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:10.573355 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b9c54bef-3e64-4a29-9d7f-f0b2e26fbcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:10.584705 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:10.621788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1360/2723] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:10.629446 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3e7d8-68cf-4460-acfb-b0d8a1b144c6 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:10.629737 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3e7d8-68cf-4460-acfb-b0d8a1b144c6 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:10.630021 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3e7d8-68cf-4460-acfb-b0d8a1b144c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:10.649354 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-64c3e7d8-68cf-4460-acfb-b0d8a1b144c6 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:10.650581 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-64c3e7d8-68cf-4460-acfb-b0d8a1b144c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:10.658597 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1364/2724] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:10.662855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c54bef-3e64-4a29-9d7f-f0b2e26fbcc5 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:10.672547 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c54bef-3e64-4a29-9d7f-f0b2e26fbcc5 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:10.677470 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c66013-c81f-41f8-82d8-5750bf4c5554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:10.678120 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c66013-c81f-41f8-82d8-5750bf4c5554 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:10.678405 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c66013-c81f-41f8-82d8-5750bf4c5554 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:10.678678 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c66013-c81f-41f8-82d8-5750bf4c5554 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:10.679400 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c66013-c81f-41f8-82d8-5750bf4c5554 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:58:10.679750 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c66013-c81f-41f8-82d8-5750bf4c5554 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:10.681340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c66013-c81f-41f8-82d8-5750bf4c5554 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:10.692749 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1361/2725] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:58:10.704430 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3e7d8-68cf-4460-acfb-b0d8a1b144c6 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:10.714231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3e7d8-68cf-4460-acfb-b0d8a1b144c6 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:10.718890 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f2579-7035-4f60-851c-e8315a4fb4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:10.719543 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f2579-7035-4f60-851c-e8315a4fb4cb admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:10.719843 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f2579-7035-4f60-851c-e8315a4fb4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:10.720223 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f2579-7035-4f60-851c-e8315a4fb4cb admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:10.720908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f2579-7035-4f60-851c-e8315a4fb4cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:10.722787 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f2579-7035-4f60-851c-e8315a4fb4cb admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:10.797705 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1365/2726] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:10 2022] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:10.798772 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c66013-c81f-41f8-82d8-5750bf4c5554 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:10.808965 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c66013-c81f-41f8-82d8-5750bf4c5554 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:10.867090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0048c31-24dd-4fd2-bda1-ea25b9a5ad64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:10.868040 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0048c31-24dd-4fd2-bda1-ea25b9a5ad64 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:10.868155 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0048c31-24dd-4fd2-bda1-ea25b9a5ad64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:10.868415 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0048c31-24dd-4fd2-bda1-ea25b9a5ad64 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:10.869108 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0048c31-24dd-4fd2-bda1-ea25b9a5ad64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:10.871091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0048c31-24dd-4fd2-bda1-ea25b9a5ad64 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:10.941916 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1362/2727] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:10 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:10.946538 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f2579-7035-4f60-851c-e8315a4fb4cb admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:10.957450 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f2579-7035-4f60-851c-e8315a4fb4cb admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:10.962616 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd919ddd-fbd3-48b2-8ea7-e53dd05e91d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:10.963858 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd919ddd-fbd3-48b2-8ea7-e53dd05e91d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:10.964558 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd919ddd-fbd3-48b2-8ea7-e53dd05e91d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:10.965039 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd919ddd-fbd3-48b2-8ea7-e53dd05e91d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:10.966506 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd919ddd-fbd3-48b2-8ea7-e53dd05e91d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:10.968869 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd919ddd-fbd3-48b2-8ea7-e53dd05e91d3 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:10.981675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1366/2728] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:58:10.986312 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0048c31-24dd-4fd2-bda1-ea25b9a5ad64 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:10.998568 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0048c31-24dd-4fd2-bda1-ea25b9a5ad64 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:11.003713 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f5013-2da0-43cc-bcce-647c251cbd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:11.004462 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f5013-2da0-43cc-bcce-647c251cbd04 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:11.004756 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f5013-2da0-43cc-bcce-647c251cbd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:11.005046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f5013-2da0-43cc-bcce-647c251cbd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:11.006591 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f5013-2da0-43cc-bcce-647c251cbd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:11.008331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f5013-2da0-43cc-bcce-647c251cbd04 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:11.018701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1363/2729] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:11.022765 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd919ddd-fbd3-48b2-8ea7-e53dd05e91d3 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:11.032650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd919ddd-fbd3-48b2-8ea7-e53dd05e91d3 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:11.037457 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b739f75-d8c8-4d36-900f-a6e3992c932f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:11.038363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b739f75-d8c8-4d36-900f-a6e3992c932f admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:11.038648 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b739f75-d8c8-4d36-900f-a6e3992c932f admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:11.038925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b739f75-d8c8-4d36-900f-a6e3992c932f admin admin] PATH_INFO: `/v3/projects/f9240e2a4f134941b6db2ea41038500f/users/41112a52e70b44899a690e558351f592/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:11.054138 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b739f75-d8c8-4d36-900f-a6e3992c932f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9240e2a4f134941b6db2ea41038500f, user_id=41112a52e70b44899a690e558351f592, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:11.056799 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b739f75-d8c8-4d36-900f-a6e3992c932f admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:11.147467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:11.156814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1367/2730] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:11 2022] PUT /identity/v3/projects/f9240e2a4f134941b6db2ea41038500f/users/41112a52e70b44899a690e558351f592/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:11.167918 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6e2c9-e510-4fd1-8406-dea8308209c8 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:11.168218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6e2c9-e510-4fd1-8406-dea8308209c8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:11.168580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6e2c9-e510-4fd1-8406-dea8308209c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:11.197287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-61e6e2c9-e510-4fd1-8406-dea8308209c8 None None] MFA Rules not processed for user `41112a52e70b44899a690e558351f592`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:11.198520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-61e6e2c9-e510-4fd1-8406-dea8308209c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:11.265250 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1364/2731] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:11.270133 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b739f75-d8c8-4d36-900f-a6e3992c932f admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:11.332657 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b739f75-d8c8-4d36-900f-a6e3992c932f admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:11.337531 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd96ae8-1b10-4d3c-8b82-220ca5f36a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:11.338187 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd96ae8-1b10-4d3c-8b82-220ca5f36a01 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:11.338472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd96ae8-1b10-4d3c-8b82-220ca5f36a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:11.338751 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd96ae8-1b10-4d3c-8b82-220ca5f36a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:11.339484 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd96ae8-1b10-4d3c-8b82-220ca5f36a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:11.341433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd96ae8-1b10-4d3c-8b82-220ca5f36a01 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:11.420804 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1368/2732] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:11 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:11.422365 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6e2c9-e510-4fd1-8406-dea8308209c8 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:11.434048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6e2c9-e510-4fd1-8406-dea8308209c8 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:11.453764 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:11.493506 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0032e80-244c-4fce-95a9-f63b187fe804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:11.494102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0032e80-244c-4fce-95a9-f63b187fe804 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:11.494387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0032e80-244c-4fce-95a9-f63b187fe804 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:11.494670 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0032e80-244c-4fce-95a9-f63b187fe804 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:11.495354 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0032e80-244c-4fce-95a9-f63b187fe804 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:11.497338 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0032e80-244c-4fce-95a9-f63b187fe804 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:11.559933 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1365/2733] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:11 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:11.564066 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd96ae8-1b10-4d3c-8b82-220ca5f36a01 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:11.574520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd96ae8-1b10-4d3c-8b82-220ca5f36a01 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:11.579357 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6664374-b2c6-400b-a9b6-77d9445ee352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:11.580049 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6664374-b2c6-400b-a9b6-77d9445ee352 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:11.580337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6664374-b2c6-400b-a9b6-77d9445ee352 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:11.580617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6664374-b2c6-400b-a9b6-77d9445ee352 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:11.581374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6664374-b2c6-400b-a9b6-77d9445ee352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:11.583011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6664374-b2c6-400b-a9b6-77d9445ee352 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:11.594165 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1369/2734] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:11.598076 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0032e80-244c-4fce-95a9-f63b187fe804 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:11.608710 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0032e80-244c-4fce-95a9-f63b187fe804 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:11.613329 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8bf19f-4d68-4c92-b241-cc3422952bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:11.613980 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bf19f-4d68-4c92-b241-cc3422952bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:11.614267 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bf19f-4d68-4c92-b241-cc3422952bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:11.614546 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8bf19f-4d68-4c92-b241-cc3422952bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:11.615272 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bf19f-4d68-4c92-b241-cc3422952bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:11.616911 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8bf19f-4d68-4c92-b241-cc3422952bf3 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:11.626716 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1366/2735] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:11.630578 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6664374-b2c6-400b-a9b6-77d9445ee352 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:11.640780 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6664374-b2c6-400b-a9b6-77d9445ee352 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:11.645561 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0037362-979d-4c87-81ba-003a55598325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:11.646947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0037362-979d-4c87-81ba-003a55598325 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:11.647255 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0037362-979d-4c87-81ba-003a55598325 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:11.647574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0037362-979d-4c87-81ba-003a55598325 admin admin] PATH_INFO: `/v3/projects/8478b32f171f47449d4a8f7983fbf43d/users/006baf8564954b9faa226cc228192012/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:11.662722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0037362-979d-4c87-81ba-003a55598325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8478b32f171f47449d4a8f7983fbf43d, user_id=006baf8564954b9faa226cc228192012, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:11.665423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0037362-979d-4c87-81ba-003a55598325 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:11.787966 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1370/2736] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:11 2022] PUT /identity/v3/projects/8478b32f171f47449d4a8f7983fbf43d/users/006baf8564954b9faa226cc228192012/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:11.798134 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bc55c-1919-4946-8627-628f18a65c15 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:11.798427 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bc55c-1919-4946-8627-628f18a65c15 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:11.798708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1bc55c-1919-4946-8627-628f18a65c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:11.825014 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-ca1bc55c-1919-4946-8627-628f18a65c15 None None] MFA Rules not processed for user `006baf8564954b9faa226cc228192012`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:11.826255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ca1bc55c-1919-4946-8627-628f18a65c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:11.891208 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1367/2737] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:11.902351 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0037362-979d-4c87-81ba-003a55598325 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:11.963665 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0037362-979d-4c87-81ba-003a55598325 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:11.968289 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c48ec-5625-4834-8be0-f9a406923928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:11.968941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c48ec-5625-4834-8be0-f9a406923928 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:11.969222 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c48ec-5625-4834-8be0-f9a406923928 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:11.969498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c48ec-5625-4834-8be0-f9a406923928 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:11.970185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c48ec-5625-4834-8be0-f9a406923928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:11.972115 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c48ec-5625-4834-8be0-f9a406923928 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:12.067212 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1371/2738] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:11 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:12.071885 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1bc55c-1919-4946-8627-628f18a65c15 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:12.082581 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1bc55c-1919-4946-8627-628f18a65c15 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:12.139430 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f8dc7-c88c-450a-888f-0dc65a6cc012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:12.140135 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f8dc7-c88c-450a-888f-0dc65a6cc012 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:12.140445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f8dc7-c88c-450a-888f-0dc65a6cc012 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:12.140726 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089f8dc7-c88c-450a-888f-0dc65a6cc012 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:12.141477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f8dc7-c88c-450a-888f-0dc65a6cc012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:12.143403 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089f8dc7-c88c-450a-888f-0dc65a6cc012 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:12.204506 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1368/2739] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:12 2022] POST /identity/v3/users => generated 295 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:12.212092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c48ec-5625-4834-8be0-f9a406923928 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:12.222294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c48ec-5625-4834-8be0-f9a406923928 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:12.226995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732799c-fbc2-45de-a26d-e334be6b2717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:12.227679 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732799c-fbc2-45de-a26d-e334be6b2717 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:12.227964 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732799c-fbc2-45de-a26d-e334be6b2717 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:12.228239 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6732799c-fbc2-45de-a26d-e334be6b2717 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:12.229017 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732799c-fbc2-45de-a26d-e334be6b2717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:12.230842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6732799c-fbc2-45de-a26d-e334be6b2717 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:12.244907 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1372/2740] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:12.246085 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f8dc7-c88c-450a-888f-0dc65a6cc012 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:12.256828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089f8dc7-c88c-450a-888f-0dc65a6cc012 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:12.261575 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c674de-8e1e-4c37-ba90-994bcf5e7c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:12.262453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c674de-8e1e-4c37-ba90-994bcf5e7c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:12.262855 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c674de-8e1e-4c37-ba90-994bcf5e7c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:12.263145 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c674de-8e1e-4c37-ba90-994bcf5e7c09 admin admin] PATH_INFO: `/v3/projects/9b3f9a9543354524a84956cfe56151fa/users/f084471a1d554c03b6d363c8a3132be2/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:12.282319 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c674de-8e1e-4c37-ba90-994bcf5e7c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3f9a9543354524a84956cfe56151fa, user_id=f084471a1d554c03b6d363c8a3132be2, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:12.282319 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c674de-8e1e-4c37-ba90-994bcf5e7c09 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:12.284913 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:12.344082 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1369/2741] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:12 2022] PUT /identity/v3/projects/9b3f9a9543354524a84956cfe56151fa/users/f084471a1d554c03b6d363c8a3132be2/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:12.348040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732799c-fbc2-45de-a26d-e334be6b2717 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:12.358189 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6732799c-fbc2-45de-a26d-e334be6b2717 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:12.376422 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:12.413320 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12fd60-7f17-4c83-bb1b-34284ead137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:12.413949 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12fd60-7f17-4c83-bb1b-34284ead137c admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:12.414237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12fd60-7f17-4c83-bb1b-34284ead137c admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:12.414513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12fd60-7f17-4c83-bb1b-34284ead137c admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:12.415241 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12fd60-7f17-4c83-bb1b-34284ead137c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:12.416934 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12fd60-7f17-4c83-bb1b-34284ead137c admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:12.430265 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1373/2742] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:12.434252 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c674de-8e1e-4c37-ba90-994bcf5e7c09 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:12.442634 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c674de-8e1e-4c37-ba90-994bcf5e7c09 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:12.448014 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cba3c-50e9-4946-9a63-0caa2d504e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:12.448907 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cba3c-50e9-4946-9a63-0caa2d504e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:12.449211 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cba3c-50e9-4946-9a63-0caa2d504e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:12.449486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0cba3c-50e9-4946-9a63-0caa2d504e25 admin admin] PATH_INFO: `/v3/projects/9b3f9a9543354524a84956cfe56151fa/users/f084471a1d554c03b6d363c8a3132be2/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:12.451487 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0cba3c-50e9-4946-9a63-0caa2d504e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3f9a9543354524a84956cfe56151fa, user_id=f084471a1d554c03b6d363c8a3132be2, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:12.454375 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0cba3c-50e9-4946-9a63-0caa2d504e25 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:12.465285 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1370/2743] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:12 2022] PUT /identity/v3/projects/9b3f9a9543354524a84956cfe56151fa/users/f084471a1d554c03b6d363c8a3132be2/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:12.476396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34afeb-b0d3-4af2-9b3a-b8f501347738 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:12.476723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34afeb-b0d3-4af2-9b3a-b8f501347738 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:12.476970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b34afeb-b0d3-4af2-9b3a-b8f501347738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:12.505184 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-2b34afeb-b0d3-4af2-9b3a-b8f501347738 None None] MFA Rules not processed for user `f084471a1d554c03b6d363c8a3132be2`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:12.507945 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2b34afeb-b0d3-4af2-9b3a-b8f501347738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:12.575929 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1374/2744] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:12 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:12.614025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cba3c-50e9-4946-9a63-0caa2d504e25 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:12.616236 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-4e0cba3c-50e9-4946-9a63-0caa2d504e25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:12.673394 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0cba3c-50e9-4946-9a63-0caa2d504e25 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:12.677035 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e66478-29c1-42ce-948c-1afb8c7671a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:12.678195 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e66478-29c1-42ce-948c-1afb8c7671a8 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:12.678501 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e66478-29c1-42ce-948c-1afb8c7671a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:12.678790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e66478-29c1-42ce-948c-1afb8c7671a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:12.688061 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e66478-29c1-42ce-948c-1afb8c7671a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:12.689503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e66478-29c1-42ce-948c-1afb8c7671a8 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:12.699589 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1371/2745] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:12.840032 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34afeb-b0d3-4af2-9b3a-b8f501347738 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:12.853605 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b34afeb-b0d3-4af2-9b3a-b8f501347738 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:12.856638 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55a8d4-f84e-4528-8ac3-30b7d5f3bea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:12.857284 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55a8d4-f84e-4528-8ac3-30b7d5f3bea1 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:12.857569 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55a8d4-f84e-4528-8ac3-30b7d5f3bea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:12.857847 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55a8d4-f84e-4528-8ac3-30b7d5f3bea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:12.914630 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55a8d4-f84e-4528-8ac3-30b7d5f3bea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:12.916107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f55a8d4-f84e-4528-8ac3-30b7d5f3bea1 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:12.924941 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1375/2746] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:13.627967 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e66478-29c1-42ce-948c-1afb8c7671a8 service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:13.629959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-99e66478-29c1-42ce-948c-1afb8c7671a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:13.706991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e66478-29c1-42ce-948c-1afb8c7671a8 service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:13.712255 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a96b3b-ee20-44a6-beff-31f13c179cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:13.713163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a96b3b-ee20-44a6-beff-31f13c179cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:13.713449 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a96b3b-ee20-44a6-beff-31f13c179cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:13.713731 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a96b3b-ee20-44a6-beff-31f13c179cb4 admin admin] PATH_INFO: `/v3/users/bfb956933823471db4a5d62be3b6d34b` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:13.714947 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a96b3b-ee20-44a6-beff-31f13c179cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfb956933823471db4a5d62be3b6d34b)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:13.717029 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a96b3b-ee20-44a6-beff-31f13c179cb4 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:13.942530 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-64a96b3b-ee20-44a6-beff-31f13c179cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfb956933823471db4a5d62be3b6d34b'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:14.020347 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-64a96b3b-ee20-44a6-beff-31f13c179cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfb956933823471db4a5d62be3b6d34b'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:14.032513 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-64a96b3b-ee20-44a6-beff-31f13c179cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfb956933823471db4a5d62be3b6d34b'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:14.035467 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-64a96b3b-ee20-44a6-beff-31f13c179cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfb956933823471db4a5d62be3b6d34b'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:14.039962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-64a96b3b-ee20-44a6-beff-31f13c179cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfb956933823471db4a5d62be3b6d34b'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:14.045867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1372/2747] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:13 2022] DELETE /identity/v3/users/bfb956933823471db4a5d62be3b6d34b => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:14.050351 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502ec69-5415-4e9c-8dee-93081533a688 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:14.050854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502ec69-5415-4e9c-8dee-93081533a688 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:14.051007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502ec69-5415-4e9c-8dee-93081533a688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:14.069054 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-f502ec69-5415-4e9c-8dee-93081533a688 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:14.070276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f502ec69-5415-4e9c-8dee-93081533a688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:14.108040 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=100 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:14.127908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1376/2748] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:14.137976 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a96b3b-ee20-44a6-beff-31f13c179cb4 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:14.139395 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-64a96b3b-ee20-44a6-beff-31f13c179cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:14.145798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:14.195966 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a96b3b-ee20-44a6-beff-31f13c179cb4 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:14.199692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d18b0e-4c7d-437c-9b7a-b7a2ed7a0ea4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:14.200338 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d18b0e-4c7d-437c-9b7a-b7a2ed7a0ea4 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:14.200621 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d18b0e-4c7d-437c-9b7a-b7a2ed7a0ea4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:14.200898 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d18b0e-4c7d-437c-9b7a-b7a2ed7a0ea4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:14.209756 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d18b0e-4c7d-437c-9b7a-b7a2ed7a0ea4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:14.211185 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d18b0e-4c7d-437c-9b7a-b7a2ed7a0ea4 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:14.220484 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1373/2749] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:14.621928 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502ec69-5415-4e9c-8dee-93081533a688 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:14.623463 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f502ec69-5415-4e9c-8dee-93081533a688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:14.637458 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502ec69-5415-4e9c-8dee-93081533a688 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:14.642433 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd600bb0-0b76-4a5a-add1-bf1c42251b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:14.643234 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd600bb0-0b76-4a5a-add1-bf1c42251b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:14.643513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd600bb0-0b76-4a5a-add1-bf1c42251b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:14.643834 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd600bb0-0b76-4a5a-add1-bf1c42251b52 admin admin] PATH_INFO: `/v3/projects/e9b45f33086a432ca65df5d5ae5d2d5d` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:14.646959 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd600bb0-0b76-4a5a-add1-bf1c42251b52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9b45f33086a432ca65df5d5ae5d2d5d)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:14.648374 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd600bb0-0b76-4a5a-add1-bf1c42251b52 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:14.746982 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d18b0e-4c7d-437c-9b7a-b7a2ed7a0ea4 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:14.747475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-fd600bb0-0b76-4a5a-add1-bf1c42251b52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9b45f33086a432ca65df5d5ae5d2d5d', 'request_id': 'req-fd600bb0-0b76-4a5a-add1-bf1c42251b52'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:14.748536 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e0d18b0e-4c7d-437c-9b7a-b7a2ed7a0ea4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:14.753513 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-fd600bb0-0b76-4a5a-add1-bf1c42251b52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9b45f33086a432ca65df5d5ae5d2d5d', 'request_id': 'req-fd600bb0-0b76-4a5a-add1-bf1c42251b52'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:14.761313 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d18b0e-4c7d-437c-9b7a-b7a2ed7a0ea4 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:14.820629 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05ff21-3744-4d3c-9cca-742a5e4cfd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:14.821621 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05ff21-3744-4d3c-9cca-742a5e4cfd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:14.821915 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05ff21-3744-4d3c-9cca-742a5e4cfd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:14.822194 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05ff21-3744-4d3c-9cca-742a5e4cfd7d admin admin] PATH_INFO: `/v3/users/c472fb30615044e487e6824f82dbaec4` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:14.823479 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05ff21-3744-4d3c-9cca-742a5e4cfd7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c472fb30615044e487e6824f82dbaec4)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:14.825620 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05ff21-3744-4d3c-9cca-742a5e4cfd7d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:14.826541 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-fd600bb0-0b76-4a5a-add1-bf1c42251b52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9b45f33086a432ca65df5d5ae5d2d5d', 'request_id': 'req-fd600bb0-0b76-4a5a-add1-bf1c42251b52'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:14.838244 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-fd600bb0-0b76-4a5a-add1-bf1c42251b52 admin admin] The token cache is being invalidate because project e9b45f33086a432ca65df5d5ae5d2d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:14.838535 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-fd600bb0-0b76-4a5a-add1-bf1c42251b52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:14.839435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-fd600bb0-0b76-4a5a-add1-bf1c42251b52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:14.843212 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1377/2750] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:14 2022] DELETE /identity/v3/projects/e9b45f33086a432ca65df5d5ae5d2d5d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:14.847056 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd600bb0-0b76-4a5a-add1-bf1c42251b52 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:14.849870 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-fd600bb0-0b76-4a5a-add1-bf1c42251b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:14.862801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd600bb0-0b76-4a5a-add1-bf1c42251b52 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:14.867978 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1ca56-8863-44c4-95c5-a139490f9856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:14.875461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1ca56-8863-44c4-95c5-a139490f9856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:14.875461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1ca56-8863-44c4-95c5-a139490f9856 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:14.875461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1ca56-8863-44c4-95c5-a139490f9856 admin admin] PATH_INFO: `/v3/users/9cbe158cdabc4ad4b08b997d38446fd8` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:14.875461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1ca56-8863-44c4-95c5-a139490f9856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cbe158cdabc4ad4b08b997d38446fd8)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:14.875461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1ca56-8863-44c4-95c5-a139490f9856 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:15.017523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7c05ff21-3744-4d3c-9cca-742a5e4cfd7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c472fb30615044e487e6824f82dbaec4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:15.078013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7c05ff21-3744-4d3c-9cca-742a5e4cfd7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c472fb30615044e487e6824f82dbaec4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:15.091162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7c05ff21-3744-4d3c-9cca-742a5e4cfd7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c472fb30615044e487e6824f82dbaec4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:15.091394 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-11c1ca56-8863-44c4-95c5-a139490f9856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cbe158cdabc4ad4b08b997d38446fd8'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:15.091888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7c05ff21-3744-4d3c-9cca-742a5e4cfd7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c472fb30615044e487e6824f82dbaec4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:15.098866 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7c05ff21-3744-4d3c-9cca-742a5e4cfd7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c472fb30615044e487e6824f82dbaec4'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:15.105665 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1374/2751] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:14 2022] DELETE /identity/v3/users/c472fb30615044e487e6824f82dbaec4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:15.109949 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ed71-b67f-49b1-b688-29bec69674a6 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:15.110246 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ed71-b67f-49b1-b688-29bec69674a6 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:15.110589 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ed71-b67f-49b1-b688-29bec69674a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:15.127672 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-7904ed71-b67f-49b1-b688-29bec69674a6 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:15.128881 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-7904ed71-b67f-49b1-b688-29bec69674a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:15.149050 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:15.169407 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-11c1ca56-8863-44c4-95c5-a139490f9856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cbe158cdabc4ad4b08b997d38446fd8'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:15.195925 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-11c1ca56-8863-44c4-95c5-a139490f9856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cbe158cdabc4ad4b08b997d38446fd8'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:15.201807 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1375/2752] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:58:15.207098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-11c1ca56-8863-44c4-95c5-a139490f9856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cbe158cdabc4ad4b08b997d38446fd8'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:15.207841 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-11c1ca56-8863-44c4-95c5-a139490f9856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cbe158cdabc4ad4b08b997d38446fd8'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:15.211303 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904ed71-b67f-49b1-b688-29bec69674a6 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:15.212806 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-7904ed71-b67f-49b1-b688-29bec69674a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:15.215610 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1378/2753] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:14 2022] DELETE /identity/v3/users/9cbe158cdabc4ad4b08b997d38446fd8 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:15.272173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904ed71-b67f-49b1-b688-29bec69674a6 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:15.328951 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb99c5d-40f0-487f-907a-1e022113a3a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:15.329625 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb99c5d-40f0-487f-907a-1e022113a3a5 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:15.330013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb99c5d-40f0-487f-907a-1e022113a3a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:15.330432 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb99c5d-40f0-487f-907a-1e022113a3a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:15.332454 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ceb99c5d-40f0-487f-907a-1e022113a3a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:15.400048 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb99c5d-40f0-487f-907a-1e022113a3a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:15.401488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb99c5d-40f0-487f-907a-1e022113a3a5 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:15.412686 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1376/2754] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:58:15.741764 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1ca56-8863-44c4-95c5-a139490f9856 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:15.743388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-11c1ca56-8863-44c4-95c5-a139490f9856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:15.757823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1ca56-8863-44c4-95c5-a139490f9856 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:15.763643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa704deb-5333-465d-a139-9af0d6caa395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:15.764632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa704deb-5333-465d-a139-9af0d6caa395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:15.765072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa704deb-5333-465d-a139-9af0d6caa395 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:15.765317 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa704deb-5333-465d-a139-9af0d6caa395 admin admin] PATH_INFO: `/v3/projects/a989017df88f4114a8e86a572a9fcfca` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:15.766781 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa704deb-5333-465d-a139-9af0d6caa395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a989017df88f4114a8e86a572a9fcfca)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:15.768825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa704deb-5333-465d-a139-9af0d6caa395 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:15.850126 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:15.861755 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-aa704deb-5333-465d-a139-9af0d6caa395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a989017df88f4114a8e86a572a9fcfca', 'request_id': 'req-aa704deb-5333-465d-a139-9af0d6caa395'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:15.867939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-aa704deb-5333-465d-a139-9af0d6caa395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a989017df88f4114a8e86a572a9fcfca', 'request_id': 'req-aa704deb-5333-465d-a139-9af0d6caa395'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:15.925692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb99c5d-40f0-487f-907a-1e022113a3a5 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:15.927254 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ceb99c5d-40f0-487f-907a-1e022113a3a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:15.938992 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb99c5d-40f0-487f-907a-1e022113a3a5 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:15.948255 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-aa704deb-5333-465d-a139-9af0d6caa395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a989017df88f4114a8e86a572a9fcfca', 'request_id': 'req-aa704deb-5333-465d-a139-9af0d6caa395'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:15.963897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-aa704deb-5333-465d-a139-9af0d6caa395 admin admin] The token cache is being invalidate because project a989017df88f4114a8e86a572a9fcfca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:15.964236 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-aa704deb-5333-465d-a139-9af0d6caa395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:15.964876 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-aa704deb-5333-465d-a139-9af0d6caa395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:15.966408 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1379/2755] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:15 2022] DELETE /identity/v3/projects/a989017df88f4114a8e86a572a9fcfca => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:15.970673 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa704deb-5333-465d-a139-9af0d6caa395 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:15.972069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-aa704deb-5333-465d-a139-9af0d6caa395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:15.973531 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:16.001326 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59130f6-8fb1-4a07-b983-6a2436f94d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:16.002419 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59130f6-8fb1-4a07-b983-6a2436f94d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:16.002708 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59130f6-8fb1-4a07-b983-6a2436f94d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:16.003045 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59130f6-8fb1-4a07-b983-6a2436f94d7e admin admin] PATH_INFO: `/v3/projects/9aa3b6da1bb24d4caac40b1503f2e8ca` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:16.004251 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59130f6-8fb1-4a07-b983-6a2436f94d7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa3b6da1bb24d4caac40b1503f2e8ca)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:16.006812 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59130f6-8fb1-4a07-b983-6a2436f94d7e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:16.037529 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa704deb-5333-465d-a139-9af0d6caa395 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:16.042145 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8016bc7-ec28-45c9-9c28-7cd53fb82d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:16.043007 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8016bc7-ec28-45c9-9c28-7cd53fb82d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:16.043289 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8016bc7-ec28-45c9-9c28-7cd53fb82d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:16.043608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8016bc7-ec28-45c9-9c28-7cd53fb82d89 admin admin] PATH_INFO: `/v3/users/f314d5fddced4ae68212f667813505bd` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:16.044797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8016bc7-ec28-45c9-9c28-7cd53fb82d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f314d5fddced4ae68212f667813505bd)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:16.046730 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8016bc7-ec28-45c9-9c28-7cd53fb82d89 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:16.129948 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-d59130f6-8fb1-4a07-b983-6a2436f94d7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa3b6da1bb24d4caac40b1503f2e8ca', 'request_id': 'req-d59130f6-8fb1-4a07-b983-6a2436f94d7e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:16.249334 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-d59130f6-8fb1-4a07-b983-6a2436f94d7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa3b6da1bb24d4caac40b1503f2e8ca', 'request_id': 'req-d59130f6-8fb1-4a07-b983-6a2436f94d7e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:16.256501 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-d59130f6-8fb1-4a07-b983-6a2436f94d7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa3b6da1bb24d4caac40b1503f2e8ca', 'request_id': 'req-d59130f6-8fb1-4a07-b983-6a2436f94d7e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:16.268418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-d59130f6-8fb1-4a07-b983-6a2436f94d7e admin admin] The token cache is being invalidate because project 9aa3b6da1bb24d4caac40b1503f2e8ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:16.268759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-d59130f6-8fb1-4a07-b983-6a2436f94d7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:16.269437 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-d59130f6-8fb1-4a07-b983-6a2436f94d7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:16.271128 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1377/2756] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:15 2022] DELETE /identity/v3/projects/9aa3b6da1bb24d4caac40b1503f2e8ca => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:16.275179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59130f6-8fb1-4a07-b983-6a2436f94d7e admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:16.276551 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d59130f6-8fb1-4a07-b983-6a2436f94d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:16.308517 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f8016bc7-ec28-45c9-9c28-7cd53fb82d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f314d5fddced4ae68212f667813505bd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:16.340470 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59130f6-8fb1-4a07-b983-6a2436f94d7e admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:16.345539 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857efa98-b6b4-4dc2-bb1e-d223acfd9bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:16.346441 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857efa98-b6b4-4dc2-bb1e-d223acfd9bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:16.346745 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857efa98-b6b4-4dc2-bb1e-d223acfd9bed admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:16.347021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857efa98-b6b4-4dc2-bb1e-d223acfd9bed admin admin] PATH_INFO: `/v3/users/90c2a6b638e542e3a572002d82a31be2` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:16.348285 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857efa98-b6b4-4dc2-bb1e-d223acfd9bed admin admin] RBAC: Authorizing `identity:delete_user(user_id=90c2a6b638e542e3a572002d82a31be2)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:16.350314 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857efa98-b6b4-4dc2-bb1e-d223acfd9bed admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:16.374815 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f8016bc7-ec28-45c9-9c28-7cd53fb82d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f314d5fddced4ae68212f667813505bd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:16.387631 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f8016bc7-ec28-45c9-9c28-7cd53fb82d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f314d5fddced4ae68212f667813505bd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:16.394294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f8016bc7-ec28-45c9-9c28-7cd53fb82d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f314d5fddced4ae68212f667813505bd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:16.394936 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-f8016bc7-ec28-45c9-9c28-7cd53fb82d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f314d5fddced4ae68212f667813505bd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:16.400759 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1380/2757] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:15 2022] DELETE /identity/v3/users/f314d5fddced4ae68212f667813505bd => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:16.519974 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-857efa98-b6b4-4dc2-bb1e-d223acfd9bed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90c2a6b638e542e3a572002d82a31be2'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:16.637788 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-857efa98-b6b4-4dc2-bb1e-d223acfd9bed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90c2a6b638e542e3a572002d82a31be2'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:16.646631 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:16.655983 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-857efa98-b6b4-4dc2-bb1e-d223acfd9bed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90c2a6b638e542e3a572002d82a31be2'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:16.662274 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-857efa98-b6b4-4dc2-bb1e-d223acfd9bed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90c2a6b638e542e3a572002d82a31be2'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:16.664895 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-857efa98-b6b4-4dc2-bb1e-d223acfd9bed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90c2a6b638e542e3a572002d82a31be2'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:16.671159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1378/2758] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:16 2022] DELETE /identity/v3/users/90c2a6b638e542e3a572002d82a31be2 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:16.839874 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8016bc7-ec28-45c9-9c28-7cd53fb82d89 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:16.841364 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f8016bc7-ec28-45c9-9c28-7cd53fb82d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:16.918762 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:16.940414 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8016bc7-ec28-45c9-9c28-7cd53fb82d89 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:16.996807 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38518f8a-1074-45a4-a79e-8778d40b3380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:16.997775 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38518f8a-1074-45a4-a79e-8778d40b3380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:16.998058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38518f8a-1074-45a4-a79e-8778d40b3380 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:16.998334 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38518f8a-1074-45a4-a79e-8778d40b3380 admin admin] PATH_INFO: `/v3/projects/8c391e3bc88e44a1ab9ddeb511884f37` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:16.999508 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38518f8a-1074-45a4-a79e-8778d40b3380 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c391e3bc88e44a1ab9ddeb511884f37)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:17.001423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38518f8a-1074-45a4-a79e-8778d40b3380 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:17.023571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857efa98-b6b4-4dc2-bb1e-d223acfd9bed admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:17.025088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-857efa98-b6b4-4dc2-bb1e-d223acfd9bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:17.038996 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857efa98-b6b4-4dc2-bb1e-d223acfd9bed admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:17.043609 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6c042-1da5-4e8c-b789-6e019ffe2b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:17.044481 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6c042-1da5-4e8c-b789-6e019ffe2b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:17.044765 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6c042-1da5-4e8c-b789-6e019ffe2b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:17.045041 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6c042-1da5-4e8c-b789-6e019ffe2b26 admin admin] PATH_INFO: `/v3/users/41112a52e70b44899a690e558351f592` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:17.046232 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6c042-1da5-4e8c-b789-6e019ffe2b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41112a52e70b44899a690e558351f592)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:17.048225 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6c042-1da5-4e8c-b789-6e019ffe2b26 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:17.130852 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-38518f8a-1074-45a4-a79e-8778d40b3380 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c391e3bc88e44a1ab9ddeb511884f37', 'request_id': 'req-38518f8a-1074-45a4-a79e-8778d40b3380'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.137422 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-38518f8a-1074-45a4-a79e-8778d40b3380 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c391e3bc88e44a1ab9ddeb511884f37', 'request_id': 'req-38518f8a-1074-45a4-a79e-8778d40b3380'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.237794 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-38518f8a-1074-45a4-a79e-8778d40b3380 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c391e3bc88e44a1ab9ddeb511884f37', 'request_id': 'req-38518f8a-1074-45a4-a79e-8778d40b3380'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.240882 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-9dd6c042-1da5-4e8c-b789-6e019ffe2b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41112a52e70b44899a690e558351f592'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.249259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-38518f8a-1074-45a4-a79e-8778d40b3380 admin admin] The token cache is being invalidate because project 8c391e3bc88e44a1ab9ddeb511884f37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:17.249553 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-38518f8a-1074-45a4-a79e-8778d40b3380 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.250190 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-38518f8a-1074-45a4-a79e-8778d40b3380 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.251778 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1381/2759] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:16 2022] DELETE /identity/v3/projects/8c391e3bc88e44a1ab9ddeb511884f37 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:17.252526 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38518f8a-1074-45a4-a79e-8778d40b3380 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:17.253952 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-38518f8a-1074-45a4-a79e-8778d40b3380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:17.317072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38518f8a-1074-45a4-a79e-8778d40b3380 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:17.318247 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-9dd6c042-1da5-4e8c-b789-6e019ffe2b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41112a52e70b44899a690e558351f592'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.322347 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72b794-37ef-4ec2-bf8e-bb3cc795d7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:17.323208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b794-37ef-4ec2-bf8e-bb3cc795d7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:17.323491 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b794-37ef-4ec2-bf8e-bb3cc795d7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:17.323797 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72b794-37ef-4ec2-bf8e-bb3cc795d7a1 admin admin] PATH_INFO: `/v3/projects/5ee99f40cde74ab3bbdbab8e52f0383d` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:17.324994 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72b794-37ef-4ec2-bf8e-bb3cc795d7a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ee99f40cde74ab3bbdbab8e52f0383d)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:17.326886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72b794-37ef-4ec2-bf8e-bb3cc795d7a1 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:17.332013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-9dd6c042-1da5-4e8c-b789-6e019ffe2b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41112a52e70b44899a690e558351f592'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.332761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-9dd6c042-1da5-4e8c-b789-6e019ffe2b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41112a52e70b44899a690e558351f592'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.340407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-9dd6c042-1da5-4e8c-b789-6e019ffe2b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41112a52e70b44899a690e558351f592'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.346431 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1379/2760] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:17 2022] DELETE /identity/v3/users/41112a52e70b44899a690e558351f592 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:17.349413 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34b36a-d1d1-4c43-aeb8-6c063e64bf15 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:17.349413 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34b36a-d1d1-4c43-aeb8-6c063e64bf15 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:17.349413 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34b36a-d1d1-4c43-aeb8-6c063e64bf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:17.365732 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-df34b36a-d1d1-4c43-aeb8-6c063e64bf15 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:17.366887 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-df34b36a-d1d1-4c43-aeb8-6c063e64bf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:17.404556 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:17.412342 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-5f72b794-37ef-4ec2-bf8e-bb3cc795d7a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ee99f40cde74ab3bbdbab8e52f0383d', 'request_id': 'req-5f72b794-37ef-4ec2-bf8e-bb3cc795d7a1'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.418529 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-5f72b794-37ef-4ec2-bf8e-bb3cc795d7a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ee99f40cde74ab3bbdbab8e52f0383d', 'request_id': 'req-5f72b794-37ef-4ec2-bf8e-bb3cc795d7a1'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.429901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1380/2761] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:17.431174 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620ddff-5a10-4085-aae0-5afa8a128521 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:17.431469 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620ddff-5a10-4085-aae0-5afa8a128521 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:17.431774 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620ddff-5a10-4085-aae0-5afa8a128521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:17.449922 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-3620ddff-5a10-4085-aae0-5afa8a128521 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:17.457236 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3620ddff-5a10-4085-aae0-5afa8a128521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:17.477856 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-5f72b794-37ef-4ec2-bf8e-bb3cc795d7a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ee99f40cde74ab3bbdbab8e52f0383d', 'request_id': 'req-5f72b794-37ef-4ec2-bf8e-bb3cc795d7a1'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.489715 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-5f72b794-37ef-4ec2-bf8e-bb3cc795d7a1 admin admin] The token cache is being invalidate because project 5ee99f40cde74ab3bbdbab8e52f0383d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:17.490082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-5f72b794-37ef-4ec2-bf8e-bb3cc795d7a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.490801 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-5f72b794-37ef-4ec2-bf8e-bb3cc795d7a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.492625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1382/2762] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:17 2022] DELETE /identity/v3/projects/5ee99f40cde74ab3bbdbab8e52f0383d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:17.496747 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84e9a9-d1db-4b28-8e56-49a1b132b0a5 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:17.497518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84e9a9-d1db-4b28-8e56-49a1b132b0a5 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:17.497518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84e9a9-d1db-4b28-8e56-49a1b132b0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:17.500343 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:17.512356 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1381/2763] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:17.515811 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-2a84e9a9-d1db-4b28-8e56-49a1b132b0a5 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:17.516124 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620ddff-5a10-4085-aae0-5afa8a128521 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:17.517071 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2a84e9a9-d1db-4b28-8e56-49a1b132b0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:17.517737 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3620ddff-5a10-4085-aae0-5afa8a128521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:17.526261 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1383/2764] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:17.528165 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84e9a9-d1db-4b28-8e56-49a1b132b0a5 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:17.528360 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2a84e9a9-d1db-4b28-8e56-49a1b132b0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:17.533448 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620ddff-5a10-4085-aae0-5afa8a128521 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:17.538836 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eae75-cc64-453e-b177-79dffa0a2e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:17.539784 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eae75-cc64-453e-b177-79dffa0a2e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:17.540075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eae75-cc64-453e-b177-79dffa0a2e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:17.540362 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401eae75-cc64-453e-b177-79dffa0a2e7c admin admin] PATH_INFO: `/v3/users/e3f6d950374e4a6099ffbb86bbb4fd22` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:17.541586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401eae75-cc64-453e-b177-79dffa0a2e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3f6d950374e4a6099ffbb86bbb4fd22)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:17.543519 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401eae75-cc64-453e-b177-79dffa0a2e7c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:17.585881 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84e9a9-d1db-4b28-8e56-49a1b132b0a5 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:17.589769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29004845-0949-446f-844f-efdff05dbc16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:17.590441 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29004845-0949-446f-844f-efdff05dbc16 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:17.590750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29004845-0949-446f-844f-efdff05dbc16 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:17.591026 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29004845-0949-446f-844f-efdff05dbc16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:17.600005 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29004845-0949-446f-844f-efdff05dbc16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:17.601435 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29004845-0949-446f-844f-efdff05dbc16 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:17.611160 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1384/2765] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:17.611969 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29004845-0949-446f-844f-efdff05dbc16 service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:17.621431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29004845-0949-446f-844f-efdff05dbc16 service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:17.626230 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48126c74-01fe-45a4-9437-55afe4f9063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:17.626899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48126c74-01fe-45a4-9437-55afe4f9063b admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:17.627153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48126c74-01fe-45a4-9437-55afe4f9063b admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:17.627436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48126c74-01fe-45a4-9437-55afe4f9063b admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:17.628219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48126c74-01fe-45a4-9437-55afe4f9063b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:58:17.628531 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48126c74-01fe-45a4-9437-55afe4f9063b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:17.630111 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48126c74-01fe-45a4-9437-55afe4f9063b admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:17.643431 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1385/2766] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:58:17.647603 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48126c74-01fe-45a4-9437-55afe4f9063b admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:17.657691 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48126c74-01fe-45a4-9437-55afe4f9063b admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:17.662809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b6ff8-e131-4fea-a31e-b45e66a0591a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:17.663459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b6ff8-e131-4fea-a31e-b45e66a0591a admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:17.663818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b6ff8-e131-4fea-a31e-b45e66a0591a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:17.664226 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b6ff8-e131-4fea-a31e-b45e66a0591a admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:17.664918 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b6ff8-e131-4fea-a31e-b45e66a0591a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:17.666962 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74b6ff8-e131-4fea-a31e-b45e66a0591a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:17.698581 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-401eae75-cc64-453e-b177-79dffa0a2e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3f6d950374e4a6099ffbb86bbb4fd22'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.736741 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1386/2767] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:17 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:58:17.741259 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b6ff8-e131-4fea-a31e-b45e66a0591a admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:17.759332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-401eae75-cc64-453e-b177-79dffa0a2e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3f6d950374e4a6099ffbb86bbb4fd22'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.782567 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-401eae75-cc64-453e-b177-79dffa0a2e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3f6d950374e4a6099ffbb86bbb4fd22'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.783761 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-401eae75-cc64-453e-b177-79dffa0a2e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3f6d950374e4a6099ffbb86bbb4fd22'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.798112 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-401eae75-cc64-453e-b177-79dffa0a2e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3f6d950374e4a6099ffbb86bbb4fd22'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:17.809461 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b6ff8-e131-4fea-a31e-b45e66a0591a admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:17.810312 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1382/2768] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:17 2022] DELETE /identity/v3/users/e3f6d950374e4a6099ffbb86bbb4fd22 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:17.827905 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:17.882687 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408dfad-6b1d-4ad6-8913-4d5b2c2fd037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:17.883476 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408dfad-6b1d-4ad6-8913-4d5b2c2fd037 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:17.883859 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408dfad-6b1d-4ad6-8913-4d5b2c2fd037 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:17.884208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408dfad-6b1d-4ad6-8913-4d5b2c2fd037 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:17.884980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408dfad-6b1d-4ad6-8913-4d5b2c2fd037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:17.887117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408dfad-6b1d-4ad6-8913-4d5b2c2fd037 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:17.969674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1387/2769] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:17 2022] POST /identity/v3/users => generated 291 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:58:17.973927 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eae75-cc64-453e-b177-79dffa0a2e7c admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:17.976005 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-401eae75-cc64-453e-b177-79dffa0a2e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:17.989257 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401eae75-cc64-453e-b177-79dffa0a2e7c admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:17.994636 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433b6bf-3c2f-48a1-b998-1eb909546c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:17.996960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433b6bf-3c2f-48a1-b998-1eb909546c71 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:17.996960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433b6bf-3c2f-48a1-b998-1eb909546c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:17.996960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433b6bf-3c2f-48a1-b998-1eb909546c71 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:17.996960 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433b6bf-3c2f-48a1-b998-1eb909546c71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:17.998264 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433b6bf-3c2f-48a1-b998-1eb909546c71 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:18.008950 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1383/2770] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:18.012945 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408dfad-6b1d-4ad6-8913-4d5b2c2fd037 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:18.026127 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408dfad-6b1d-4ad6-8913-4d5b2c2fd037 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:18.030001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05520fea-9dbb-4952-97f3-e61a41d02ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:18.030698 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05520fea-9dbb-4952-97f3-e61a41d02ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:18.030983 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05520fea-9dbb-4952-97f3-e61a41d02ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:18.031276 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05520fea-9dbb-4952-97f3-e61a41d02ad2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:18.032036 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05520fea-9dbb-4952-97f3-e61a41d02ad2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:18.033638 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05520fea-9dbb-4952-97f3-e61a41d02ad2 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:18.048635 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1388/2771] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:58:18.050518 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433b6bf-3c2f-48a1-b998-1eb909546c71 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:18.051389 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05520fea-9dbb-4952-97f3-e61a41d02ad2 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:18.053698 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-05520fea-9dbb-4952-97f3-e61a41d02ad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:18.062232 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433b6bf-3c2f-48a1-b998-1eb909546c71 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:18.066554 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05520fea-9dbb-4952-97f3-e61a41d02ad2 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:18.067362 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c3ae9-dfe7-4247-9c08-9534e183fda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:18.068724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c3ae9-dfe7-4247-9c08-9534e183fda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:18.069006 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c3ae9-dfe7-4247-9c08-9534e183fda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:18.069284 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c3ae9-dfe7-4247-9c08-9534e183fda5 admin admin] PATH_INFO: `/v3/projects/8e104b8ed91644aea8cbff3d6dcb99e5/users/ec58cf8f719c4fccbc90efb05e2ce639/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:18.074456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757e9cf-9011-40bc-b3d1-b97b12d87eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:18.075642 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757e9cf-9011-40bc-b3d1-b97b12d87eff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:18.076002 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757e9cf-9011-40bc-b3d1-b97b12d87eff admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:18.076356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757e9cf-9011-40bc-b3d1-b97b12d87eff admin admin] PATH_INFO: `/v3/projects/f9240e2a4f134941b6db2ea41038500f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:18.077670 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757e9cf-9011-40bc-b3d1-b97b12d87eff admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9240e2a4f134941b6db2ea41038500f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:18.079803 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757e9cf-9011-40bc-b3d1-b97b12d87eff admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:18.096497 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c3ae9-dfe7-4247-9c08-9534e183fda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e104b8ed91644aea8cbff3d6dcb99e5, user_id=ec58cf8f719c4fccbc90efb05e2ce639, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:18.099738 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c3ae9-dfe7-4247-9c08-9534e183fda5 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:18.186710 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1384/2772] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:18 2022] PUT /identity/v3/projects/8e104b8ed91644aea8cbff3d6dcb99e5/users/ec58cf8f719c4fccbc90efb05e2ce639/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:18.198619 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd4180-8e1d-4fba-8610-704ba87eca94 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:18.198909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd4180-8e1d-4fba-8610-704ba87eca94 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:18.199190 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd4180-8e1d-4fba-8610-704ba87eca94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:18.229539 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-a2cd4180-8e1d-4fba-8610-704ba87eca94 None None] MFA Rules not processed for user `ec58cf8f719c4fccbc90efb05e2ce639`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:18.231032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-a2cd4180-8e1d-4fba-8610-704ba87eca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:18.234361 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6757e9cf-9011-40bc-b3d1-b97b12d87eff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9240e2a4f134941b6db2ea41038500f', 'request_id': 'req-6757e9cf-9011-40bc-b3d1-b97b12d87eff'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:18.242920 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6757e9cf-9011-40bc-b3d1-b97b12d87eff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9240e2a4f134941b6db2ea41038500f', 'request_id': 'req-6757e9cf-9011-40bc-b3d1-b97b12d87eff'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:18.299050 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1385/2773] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:58:18.300124 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd4180-8e1d-4fba-8610-704ba87eca94 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:18.301533 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-a2cd4180-8e1d-4fba-8610-704ba87eca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:18.312359 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6757e9cf-9011-40bc-b3d1-b97b12d87eff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9240e2a4f134941b6db2ea41038500f', 'request_id': 'req-6757e9cf-9011-40bc-b3d1-b97b12d87eff'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:18.327392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6757e9cf-9011-40bc-b3d1-b97b12d87eff admin admin] The token cache is being invalidate because project f9240e2a4f134941b6db2ea41038500f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:18.328039 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6757e9cf-9011-40bc-b3d1-b97b12d87eff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:18.333933 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:18.334063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6757e9cf-9011-40bc-b3d1-b97b12d87eff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:18.334063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1389/2774] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:18 2022] DELETE /identity/v3/projects/f9240e2a4f134941b6db2ea41038500f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:18.334063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757e9cf-9011-40bc-b3d1-b97b12d87eff admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:18.334063 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-6757e9cf-9011-40bc-b3d1-b97b12d87eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:18.369955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd4180-8e1d-4fba-8610-704ba87eca94 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:18.377793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494b275-5c0a-492e-b3e9-96e0cc429ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:18.378502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494b275-5c0a-492e-b3e9-96e0cc429ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:18.378787 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494b275-5c0a-492e-b3e9-96e0cc429ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:18.379067 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0494b275-5c0a-492e-b3e9-96e0cc429ae7 admin admin] PATH_INFO: `/v3/projects/baaf1fd002e14d0589cf68c704c48353` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:18.380521 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494b275-5c0a-492e-b3e9-96e0cc429ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baaf1fd002e14d0589cf68c704c48353)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:18.382442 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0494b275-5c0a-492e-b3e9-96e0cc429ae7 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:18.399321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757e9cf-9011-40bc-b3d1-b97b12d87eff admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:18.403977 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1962bdd-1478-4b07-b471-790f9571175d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:18.404736 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1962bdd-1478-4b07-b471-790f9571175d admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:18.404911 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1962bdd-1478-4b07-b471-790f9571175d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:18.405183 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1962bdd-1478-4b07-b471-790f9571175d admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:18.405867 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1962bdd-1478-4b07-b471-790f9571175d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:18.407778 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1962bdd-1478-4b07-b471-790f9571175d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:18.489694 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0494b275-5c0a-492e-b3e9-96e0cc429ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baaf1fd002e14d0589cf68c704c48353', 'request_id': 'req-0494b275-5c0a-492e-b3e9-96e0cc429ae7'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:18.502033 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1390/2775] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:18 2022] POST /identity/v3/projects => generated 381 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:18.502871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1962bdd-1478-4b07-b471-790f9571175d admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:18.504465 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b1962bdd-1478-4b07-b471-790f9571175d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:18.509067 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:18.552242 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0494b275-5c0a-492e-b3e9-96e0cc429ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baaf1fd002e14d0589cf68c704c48353', 'request_id': 'req-0494b275-5c0a-492e-b3e9-96e0cc429ae7'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:18.558587 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0494b275-5c0a-492e-b3e9-96e0cc429ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baaf1fd002e14d0589cf68c704c48353', 'request_id': 'req-0494b275-5c0a-492e-b3e9-96e0cc429ae7'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:18.567392 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1962bdd-1478-4b07-b471-790f9571175d admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:18.570024 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0494b275-5c0a-492e-b3e9-96e0cc429ae7 admin admin] The token cache is being invalidate because project baaf1fd002e14d0589cf68c704c48353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:18.570312 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0494b275-5c0a-492e-b3e9-96e0cc429ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:18.570954 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-0494b275-5c0a-492e-b3e9-96e0cc429ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:18.572538 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1386/2776] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:18 2022] DELETE /identity/v3/projects/baaf1fd002e14d0589cf68c704c48353 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:18.575957 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c6098-01e4-4443-a6bd-0a0da25b1504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:18.576092 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494b275-5c0a-492e-b3e9-96e0cc429ae7 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:18.576200 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c6098-01e4-4443-a6bd-0a0da25b1504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:18.576200 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c6098-01e4-4443-a6bd-0a0da25b1504 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:18.576200 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c6098-01e4-4443-a6bd-0a0da25b1504 admin admin] PATH_INFO: `/v3/users/006baf8564954b9faa226cc228192012` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:18.577279 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c6098-01e4-4443-a6bd-0a0da25b1504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=006baf8564954b9faa226cc228192012)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:18.577464 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-0494b275-5c0a-492e-b3e9-96e0cc429ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:18.579248 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c6098-01e4-4443-a6bd-0a0da25b1504 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:18.641094 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0494b275-5c0a-492e-b3e9-96e0cc429ae7 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:18.646400 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89366100-cbb4-4fe5-a4dc-7515483e2840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:18.647082 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89366100-cbb4-4fe5-a4dc-7515483e2840 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:18.647443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89366100-cbb4-4fe5-a4dc-7515483e2840 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:18.647668 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89366100-cbb4-4fe5-a4dc-7515483e2840 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:18.648386 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89366100-cbb4-4fe5-a4dc-7515483e2840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:18.650308 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89366100-cbb4-4fe5-a4dc-7515483e2840 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:18.740828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1387/2777] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:18 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:18.742162 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7084c86-ab53-4eaf-babb-35892932d3a3 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:18.742447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7084c86-ab53-4eaf-babb-35892932d3a3 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:18.742726 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7084c86-ab53-4eaf-babb-35892932d3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:18.760818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-070c6098-01e4-4443-a6bd-0a0da25b1504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006baf8564954b9faa226cc228192012'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:18.763007 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-f7084c86-ab53-4eaf-babb-35892932d3a3 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:18.764322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-f7084c86-ab53-4eaf-babb-35892932d3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:18.772900 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1388/2778] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:18.773892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7084c86-ab53-4eaf-babb-35892932d3a3 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:18.783588 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7084c86-ab53-4eaf-babb-35892932d3a3 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:18.788147 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963f309-9b8d-4528-aea7-62d6cde97951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:18.788780 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963f309-9b8d-4528-aea7-62d6cde97951 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:18.789063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963f309-9b8d-4528-aea7-62d6cde97951 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:18.789336 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963f309-9b8d-4528-aea7-62d6cde97951 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:18.790054 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963f309-9b8d-4528-aea7-62d6cde97951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:18.791710 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963f309-9b8d-4528-aea7-62d6cde97951 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:18.801728 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1389/2779] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:18.802888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e0458-7686-48aa-8af4-9f6f0451730f None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:18.803179 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e0458-7686-48aa-8af4-9f6f0451730f None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:18.803461 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e0458-7686-48aa-8af4-9f6f0451730f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:18.809051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-070c6098-01e4-4443-a6bd-0a0da25b1504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006baf8564954b9faa226cc228192012'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:18.820925 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-740e0458-7686-48aa-8af4-9f6f0451730f None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:18.822140 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-740e0458-7686-48aa-8af4-9f6f0451730f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:18.822367 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-070c6098-01e4-4443-a6bd-0a0da25b1504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006baf8564954b9faa226cc228192012'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:18.829643 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-070c6098-01e4-4443-a6bd-0a0da25b1504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006baf8564954b9faa226cc228192012'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:18.830312 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-070c6098-01e4-4443-a6bd-0a0da25b1504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006baf8564954b9faa226cc228192012'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:18.830468 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1390/2780] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:18.831159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e0458-7686-48aa-8af4-9f6f0451730f None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:18.840162 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1391/2781] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:18 2022] DELETE /identity/v3/users/006baf8564954b9faa226cc228192012 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:18.840950 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c6098-01e4-4443-a6bd-0a0da25b1504 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:18.841109 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e0458-7686-48aa-8af4-9f6f0451730f None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:18.842479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-070c6098-01e4-4443-a6bd-0a0da25b1504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:18.854692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:18.904707 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d461472-0c52-4c32-bf97-ec34ff0fc7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:18.905742 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d461472-0c52-4c32-bf97-ec34ff0fc7ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:18.906034 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d461472-0c52-4c32-bf97-ec34ff0fc7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:18.906318 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d461472-0c52-4c32-bf97-ec34ff0fc7ca admin admin] PATH_INFO: `/v3/projects/81ebbafc376f44a68ebdfef0db84914e/users/92e8d168583d4ef8b0c861624ba228af/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:18.922646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d461472-0c52-4c32-bf97-ec34ff0fc7ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ebbafc376f44a68ebdfef0db84914e, user_id=92e8d168583d4ef8b0c861624ba228af, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:18.923945 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c6098-01e4-4443-a6bd-0a0da25b1504 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:18.925615 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d461472-0c52-4c32-bf97-ec34ff0fc7ca admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:18.929625 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf973a9f-105a-41d9-8211-d6ad98fa81de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:18.930316 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf973a9f-105a-41d9-8211-d6ad98fa81de admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:18.930597 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf973a9f-105a-41d9-8211-d6ad98fa81de admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:18.930868 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf973a9f-105a-41d9-8211-d6ad98fa81de admin admin] PATH_INFO: `/v3/domains` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:18.931655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf973a9f-105a-41d9-8211-d6ad98fa81de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86869) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:58:18.931970 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf973a9f-105a-41d9-8211-d6ad98fa81de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:18.933776 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf973a9f-105a-41d9-8211-d6ad98fa81de admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:18.946530 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1392/2782] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:58:18.950072 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf973a9f-105a-41d9-8211-d6ad98fa81de admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:18.959898 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf973a9f-105a-41d9-8211-d6ad98fa81de admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:18.964622 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff0197-faee-48e4-9ca8-c7f8b97e7ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:18.965239 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff0197-faee-48e4-9ca8-c7f8b97e7ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:18.965519 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff0197-faee-48e4-9ca8-c7f8b97e7ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:18.965791 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff0197-faee-48e4-9ca8-c7f8b97e7ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:18.966459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff0197-faee-48e4-9ca8-c7f8b97e7ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:18.968410 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff0197-faee-48e4-9ca8-c7f8b97e7ed4 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:18.981907 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:19.027083 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1391/2783] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:18 2022] PUT /identity/v3/projects/81ebbafc376f44a68ebdfef0db84914e/users/92e8d168583d4ef8b0c861624ba228af/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:19.030798 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d461472-0c52-4c32-bf97-ec34ff0fc7ca admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:19.032426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-9d461472-0c52-4c32-bf97-ec34ff0fc7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:19.061370 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1393/2784] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:18 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:19.062418 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff0197-faee-48e4-9ca8-c7f8b97e7ed4 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:19.115119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d461472-0c52-4c32-bf97-ec34ff0fc7ca admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:19.136981 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff0197-faee-48e4-9ca8-c7f8b97e7ed4 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:19.142590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a1241-d032-45ea-99fb-de692e5a69c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:19.143463 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a1241-d032-45ea-99fb-de692e5a69c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:19.143846 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a1241-d032-45ea-99fb-de692e5a69c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:19.144184 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a1241-d032-45ea-99fb-de692e5a69c9 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:19.145135 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a1241-d032-45ea-99fb-de692e5a69c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:19.147766 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a1241-d032-45ea-99fb-de692e5a69c9 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:19.176952 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbdd6a-4d64-45f5-b197-fa77b01d687c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:19.178915 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbdd6a-4d64-45f5-b197-fa77b01d687c admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:19.179580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbdd6a-4d64-45f5-b197-fa77b01d687c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:19.179580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbdd6a-4d64-45f5-b197-fa77b01d687c admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:19.180556 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbdd6a-4d64-45f5-b197-fa77b01d687c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:19.182240 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbdd6a-4d64-45f5-b197-fa77b01d687c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:19.193340 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1392/2785] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:58:19.197415 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbdd6a-4d64-45f5-b197-fa77b01d687c admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:19.207477 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbdd6a-4d64-45f5-b197-fa77b01d687c admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:19.212307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ab80f-a358-424e-bddb-ce0955bec7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:19.213185 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ab80f-a358-424e-bddb-ce0955bec7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:19.213474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ab80f-a358-424e-bddb-ce0955bec7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:19.213840 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ab80f-a358-424e-bddb-ce0955bec7b2 admin admin] PATH_INFO: `/v3/projects/81ebbafc376f44a68ebdfef0db84914e/users/92e8d168583d4ef8b0c861624ba228af/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:19.215848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ab80f-a358-424e-bddb-ce0955bec7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ebbafc376f44a68ebdfef0db84914e, user_id=92e8d168583d4ef8b0c861624ba228af, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:19.218560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ab80f-a358-424e-bddb-ce0955bec7b2 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:19.227826 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1394/2786] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:19 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:19.232082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a1241-d032-45ea-99fb-de692e5a69c9 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:19.235692 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1393/2787] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:19 2022] PUT /identity/v3/projects/81ebbafc376f44a68ebdfef0db84914e/users/92e8d168583d4ef8b0c861624ba228af/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:19.242575 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a1241-d032-45ea-99fb-de692e5a69c9 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:19.249296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f12e6-98ed-4a99-9dc1-3d90c02f5bf2 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:19.249594 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f12e6-98ed-4a99-9dc1-3d90c02f5bf2 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:19.249881 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f12e6-98ed-4a99-9dc1-3d90c02f5bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:19.277245 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-755f12e6-98ed-4a99-9dc1-3d90c02f5bf2 None None] MFA Rules not processed for user `92e8d168583d4ef8b0c861624ba228af`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:19.278491 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-755f12e6-98ed-4a99-9dc1-3d90c02f5bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:19.298058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851244fa-1982-4408-9509-aed8418842c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:19.298324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:19.298745 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851244fa-1982-4408-9509-aed8418842c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:19.299022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851244fa-1982-4408-9509-aed8418842c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:19.299301 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851244fa-1982-4408-9509-aed8418842c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:19.300067 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851244fa-1982-4408-9509-aed8418842c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:19.301674 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851244fa-1982-4408-9509-aed8418842c7 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:19.315993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1395/2788] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:58:19.315993 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851244fa-1982-4408-9509-aed8418842c7 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:19.317766 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-851244fa-1982-4408-9509-aed8418842c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:19.330939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851244fa-1982-4408-9509-aed8418842c7 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:19.336125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebeaa2-e2da-4d19-b665-a18ad71506f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:19.337000 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebeaa2-e2da-4d19-b665-a18ad71506f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:19.337290 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebeaa2-e2da-4d19-b665-a18ad71506f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:19.337574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebeaa2-e2da-4d19-b665-a18ad71506f3 admin admin] PATH_INFO: `/v3/projects/8478b32f171f47449d4a8f7983fbf43d` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:19.338932 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebeaa2-e2da-4d19-b665-a18ad71506f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8478b32f171f47449d4a8f7983fbf43d)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:19.341893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ebeaa2-e2da-4d19-b665-a18ad71506f3 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:19.360031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1394/2789] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:58:19.364088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f12e6-98ed-4a99-9dc1-3d90c02f5bf2 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:19.371690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f12e6-98ed-4a99-9dc1-3d90c02f5bf2 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:19.376435 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058438f-539c-4efc-bebf-e7355334ab9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:19.377090 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058438f-539c-4efc-bebf-e7355334ab9d admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:19.377382 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058438f-539c-4efc-bebf-e7355334ab9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:19.377661 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058438f-539c-4efc-bebf-e7355334ab9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:19.378425 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058438f-539c-4efc-bebf-e7355334ab9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:19.380142 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058438f-539c-4efc-bebf-e7355334ab9d admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:19.390752 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1395/2790] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:19.391545 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058438f-539c-4efc-bebf-e7355334ab9d admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:19.394916 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-9058438f-539c-4efc-bebf-e7355334ab9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:19.452991 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058438f-539c-4efc-bebf-e7355334ab9d admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:19.456965 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3738a7-8a54-44ad-b797-ac824b7c8cff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:19.457792 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3738a7-8a54-44ad-b797-ac824b7c8cff service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:19.458077 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3738a7-8a54-44ad-b797-ac824b7c8cff service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:19.458367 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3738a7-8a54-44ad-b797-ac824b7c8cff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:19.468366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3738a7-8a54-44ad-b797-ac824b7c8cff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:19.469866 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3738a7-8a54-44ad-b797-ac824b7c8cff service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:19.473214 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-13ebeaa2-e2da-4d19-b665-a18ad71506f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8478b32f171f47449d4a8f7983fbf43d', 'request_id': 'req-13ebeaa2-e2da-4d19-b665-a18ad71506f3'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:19.480667 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1396/2791] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:19.481274 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-13ebeaa2-e2da-4d19-b665-a18ad71506f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8478b32f171f47449d4a8f7983fbf43d', 'request_id': 'req-13ebeaa2-e2da-4d19-b665-a18ad71506f3'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:19.481420 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3738a7-8a54-44ad-b797-ac824b7c8cff service cinder] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:19.492099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3738a7-8a54-44ad-b797-ac824b7c8cff service cinder] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:19.529912 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-13ebeaa2-e2da-4d19-b665-a18ad71506f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8478b32f171f47449d4a8f7983fbf43d', 'request_id': 'req-13ebeaa2-e2da-4d19-b665-a18ad71506f3'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:19.542423 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-13ebeaa2-e2da-4d19-b665-a18ad71506f3 admin admin] The token cache is being invalidate because project 8478b32f171f47449d4a8f7983fbf43d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:19.542711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-13ebeaa2-e2da-4d19-b665-a18ad71506f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:19.543394 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-13ebeaa2-e2da-4d19-b665-a18ad71506f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:19.545051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1396/2792] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:19 2022] DELETE /identity/v3/projects/8478b32f171f47449d4a8f7983fbf43d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:19.548733 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebeaa2-e2da-4d19-b665-a18ad71506f3 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:19.548897 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc61ba7a-b8f4-4500-b95f-38986feeb456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:19.549972 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61ba7a-b8f4-4500-b95f-38986feeb456 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:19.550114 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-13ebeaa2-e2da-4d19-b665-a18ad71506f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:19.550267 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61ba7a-b8f4-4500-b95f-38986feeb456 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:19.550675 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc61ba7a-b8f4-4500-b95f-38986feeb456 admin admin] PATH_INFO: `/v3/projects/4837a07791db4061bf9efb68591ab7d3/users/b06b74b9349d46afb92fd91cc05a2a5d/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:19.558681 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:19.563723 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ebeaa2-e2da-4d19-b665-a18ad71506f3 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:19.567207 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61ba7a-b8f4-4500-b95f-38986feeb456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4837a07791db4061bf9efb68591ab7d3, user_id=b06b74b9349d46afb92fd91cc05a2a5d, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:19.570112 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc61ba7a-b8f4-4500-b95f-38986feeb456 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:19.574143 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1bf79-b5c1-4980-bb1b-94d79fb9b277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:19.575003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1bf79-b5c1-4980-bb1b-94d79fb9b277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:19.575285 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1bf79-b5c1-4980-bb1b-94d79fb9b277 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:19.575588 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1bf79-b5c1-4980-bb1b-94d79fb9b277 admin admin] PATH_INFO: `/v3/users/f084471a1d554c03b6d363c8a3132be2` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:19.576952 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1bf79-b5c1-4980-bb1b-94d79fb9b277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f084471a1d554c03b6d363c8a3132be2)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:19.578871 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1bf79-b5c1-4980-bb1b-94d79fb9b277 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:19.656077 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1397/2793] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:19 2022] PUT /identity/v3/projects/4837a07791db4061bf9efb68591ab7d3/users/b06b74b9349d46afb92fd91cc05a2a5d/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:19.668767 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eac9ec-e4e6-4ec1-9cd9-35a56c2b304e None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:19.669059 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eac9ec-e4e6-4ec1-9cd9-35a56c2b304e None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:19.669332 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eac9ec-e4e6-4ec1-9cd9-35a56c2b304e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:19.696537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-11eac9ec-e4e6-4ec1-9cd9-35a56c2b304e None None] MFA Rules not processed for user `b06b74b9349d46afb92fd91cc05a2a5d`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:19.697850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-11eac9ec-e4e6-4ec1-9cd9-35a56c2b304e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:19.717335 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:19.760251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e6e1bf79-b5c1-4980-bb1b-94d79fb9b277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f084471a1d554c03b6d363c8a3132be2'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:19.771203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1398/2794] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:58:19.791055 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eac9ec-e4e6-4ec1-9cd9-35a56c2b304e None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:19.792542 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-11eac9ec-e4e6-4ec1-9cd9-35a56c2b304e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:19.810097 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e6e1bf79-b5c1-4980-bb1b-94d79fb9b277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f084471a1d554c03b6d363c8a3132be2'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:19.823082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e6e1bf79-b5c1-4980-bb1b-94d79fb9b277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f084471a1d554c03b6d363c8a3132be2'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:19.831786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e6e1bf79-b5c1-4980-bb1b-94d79fb9b277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f084471a1d554c03b6d363c8a3132be2'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:19.833792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e6e1bf79-b5c1-4980-bb1b-94d79fb9b277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f084471a1d554c03b6d363c8a3132be2'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:19.840898 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1397/2795] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:19 2022] DELETE /identity/v3/users/f084471a1d554c03b6d363c8a3132be2 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:19.860793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eac9ec-e4e6-4ec1-9cd9-35a56c2b304e None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:19.923387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a074529-4c68-4889-abe4-c04d567387ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e59193e90e240f6b9876d0455eea355', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:19.924095 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a074529-4c68-4889-abe4-c04d567387ca service glance] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:19.924398 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a074529-4c68-4889-abe4-c04d567387ca service glance] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:19.924668 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a074529-4c68-4889-abe4-c04d567387ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:19.926562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5a074529-4c68-4889-abe4-c04d567387ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:19.987886 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a074529-4c68-4889-abe4-c04d567387ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:19.989331 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a074529-4c68-4889-abe4-c04d567387ca service glance] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:19.998196 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1399/2796] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:58:20.041724 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1bf79-b5c1-4980-bb1b-94d79fb9b277 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:20.043507 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e6e1bf79-b5c1-4980-bb1b-94d79fb9b277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:20.126430 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1bf79-b5c1-4980-bb1b-94d79fb9b277 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:20.132174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab09641b-7102-4684-9443-1d02daa1a6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:20.133396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09641b-7102-4684-9443-1d02daa1a6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:20.133624 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09641b-7102-4684-9443-1d02daa1a6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:20.133935 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab09641b-7102-4684-9443-1d02daa1a6eb admin admin] PATH_INFO: `/v3/users/ec58cf8f719c4fccbc90efb05e2ce639` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:20.135236 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09641b-7102-4684-9443-1d02daa1a6eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec58cf8f719c4fccbc90efb05e2ce639)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:20.137294 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab09641b-7102-4684-9443-1d02daa1a6eb admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:20.263388 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a074529-4c68-4889-abe4-c04d567387ca service glance] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:20.265877 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-5a074529-4c68-4889-abe4-c04d567387ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:20.279700 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a074529-4c68-4889-abe4-c04d567387ca service glance] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:20.284837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd86cbc-d285-402e-a3db-fd314db2ad6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:20.285958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd86cbc-d285-402e-a3db-fd314db2ad6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:20.286584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd86cbc-d285-402e-a3db-fd314db2ad6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:20.287404 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd86cbc-d285-402e-a3db-fd314db2ad6c admin admin] PATH_INFO: `/v3/projects/9b3f9a9543354524a84956cfe56151fa` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:20.288695 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd86cbc-d285-402e-a3db-fd314db2ad6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b3f9a9543354524a84956cfe56151fa)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:20.294496 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd86cbc-d285-402e-a3db-fd314db2ad6c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:20.305380 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ab09641b-7102-4684-9443-1d02daa1a6eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec58cf8f719c4fccbc90efb05e2ce639'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:20.369503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ab09641b-7102-4684-9443-1d02daa1a6eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec58cf8f719c4fccbc90efb05e2ce639'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:20.382583 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ab09641b-7102-4684-9443-1d02daa1a6eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec58cf8f719c4fccbc90efb05e2ce639'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:20.387035 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:20.389978 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ab09641b-7102-4684-9443-1d02daa1a6eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec58cf8f719c4fccbc90efb05e2ce639'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:20.390658 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ab09641b-7102-4684-9443-1d02daa1a6eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec58cf8f719c4fccbc90efb05e2ce639'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:20.397409 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1398/2797] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:20 2022] DELETE /identity/v3/users/ec58cf8f719c4fccbc90efb05e2ce639 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:20.399976 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:20.401650 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78319a64-4235-4317-8f59-eab528a570de None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:20.401947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78319a64-4235-4317-8f59-eab528a570de None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:20.402260 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78319a64-4235-4317-8f59-eab528a570de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:20.415760 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2bd86cbc-d285-402e-a3db-fd314db2ad6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b3f9a9543354524a84956cfe56151fa', 'request_id': 'req-2bd86cbc-d285-402e-a3db-fd314db2ad6c'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:20.419880 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-78319a64-4235-4317-8f59-eab528a570de None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:20.421090 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-78319a64-4235-4317-8f59-eab528a570de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:20.478980 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1399/2798] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:58:20.488776 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78319a64-4235-4317-8f59-eab528a570de None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:20.490157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-78319a64-4235-4317-8f59-eab528a570de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:20.523820 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2bd86cbc-d285-402e-a3db-fd314db2ad6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b3f9a9543354524a84956cfe56151fa', 'request_id': 'req-2bd86cbc-d285-402e-a3db-fd314db2ad6c'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:20.530523 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2bd86cbc-d285-402e-a3db-fd314db2ad6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b3f9a9543354524a84956cfe56151fa', 'request_id': 'req-2bd86cbc-d285-402e-a3db-fd314db2ad6c'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:20.543571 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2bd86cbc-d285-402e-a3db-fd314db2ad6c admin admin] The token cache is being invalidate because project 9b3f9a9543354524a84956cfe56151fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:20.543909 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2bd86cbc-d285-402e-a3db-fd314db2ad6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:20.545202 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-2bd86cbc-d285-402e-a3db-fd314db2ad6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:20.547287 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1400/2799] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:20 2022] DELETE /identity/v3/projects/9b3f9a9543354524a84956cfe56151fa => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:20.548844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78319a64-4235-4317-8f59-eab528a570de None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:20.552921 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d19436-15bf-4bc1-af39-16b179f33cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:20.553209 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fd104-52ca-4721-a3f8-9637b187cd20 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:20.553505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fd104-52ca-4721-a3f8-9637b187cd20 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:20.553614 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d19436-15bf-4bc1-af39-16b179f33cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:20.553790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fd104-52ca-4721-a3f8-9637b187cd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:20.553897 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d19436-15bf-4bc1-af39-16b179f33cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:20.554095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d19436-15bf-4bc1-af39-16b179f33cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:20.556043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a2d19436-15bf-4bc1-af39-16b179f33cb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:20.571706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d19436-15bf-4bc1-af39-16b179f33cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:20.573602 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d19436-15bf-4bc1-af39-16b179f33cb3 service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:20.578714 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-1b1fd104-52ca-4721-a3f8-9637b187cd20 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:20.581421 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-1b1fd104-52ca-4721-a3f8-9637b187cd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:20.586365 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1400/2800] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:58:20.597550 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1401/2801] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:58:20.606155 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7eedb7-2361-4ff7-8bc0-2eba5cf85bc3 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:20.606832 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7eedb7-2361-4ff7-8bc0-2eba5cf85bc3 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:20.606832 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7eedb7-2361-4ff7-8bc0-2eba5cf85bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:20.629136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-2b7eedb7-2361-4ff7-8bc0-2eba5cf85bc3 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:20.631100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-2b7eedb7-2361-4ff7-8bc0-2eba5cf85bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:20.642667 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1401/2802] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:20.649872 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fd104-52ca-4721-a3f8-9637b187cd20 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:20.660402 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1fd104-52ca-4721-a3f8-9637b187cd20 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:20.666004 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3153c-b417-4930-8205-352206470edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:20.666697 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3153c-b417-4930-8205-352206470edb admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:20.667041 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3153c-b417-4930-8205-352206470edb admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:20.667334 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3153c-b417-4930-8205-352206470edb admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:20.668168 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3153c-b417-4930-8205-352206470edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:58:20.668487 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3153c-b417-4930-8205-352206470edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:20.670210 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3153c-b417-4930-8205-352206470edb admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:20.687994 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1402/2803] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:58:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:58:20.692604 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7eedb7-2361-4ff7-8bc0-2eba5cf85bc3 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:20.702868 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7eedb7-2361-4ff7-8bc0-2eba5cf85bc3 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:20.709070 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c970081-5e30-4b9d-8991-eba7bfa64e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:20.710191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c970081-5e30-4b9d-8991-eba7bfa64e7e admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:20.710489 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c970081-5e30-4b9d-8991-eba7bfa64e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:20.710878 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c970081-5e30-4b9d-8991-eba7bfa64e7e admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:20.711609 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c970081-5e30-4b9d-8991-eba7bfa64e7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:20.714947 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c970081-5e30-4b9d-8991-eba7bfa64e7e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:20.847001 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1402/2804] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:20 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:58:20.851244 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3153c-b417-4930-8205-352206470edb admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:20.865625 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3153c-b417-4930-8205-352206470edb admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:20.926289 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fa9f2-9785-4767-a1fe-5207889521f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:20.928068 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fa9f2-9785-4767-a1fe-5207889521f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:20.928068 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fa9f2-9785-4767-a1fe-5207889521f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:20.928319 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fa9f2-9785-4767-a1fe-5207889521f3 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:20.929000 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fa9f2-9785-4767-a1fe-5207889521f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:20.931099 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fa9f2-9785-4767-a1fe-5207889521f3 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:21.042870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1403/2805] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:20 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:21.044171 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c970081-5e30-4b9d-8991-eba7bfa64e7e admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:21.055318 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c970081-5e30-4b9d-8991-eba7bfa64e7e admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:21.059912 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d465452-7564-4778-a602-2224f708556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:21.060572 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d465452-7564-4778-a602-2224f708556b admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:21.060853 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d465452-7564-4778-a602-2224f708556b admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:21.061129 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d465452-7564-4778-a602-2224f708556b admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:21.061855 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d465452-7564-4778-a602-2224f708556b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:21.063458 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d465452-7564-4778-a602-2224f708556b admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:21.075017 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1403/2806] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:21.078953 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fa9f2-9785-4767-a1fe-5207889521f3 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:21.089894 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fa9f2-9785-4767-a1fe-5207889521f3 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:21.092612 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d465452-7564-4778-a602-2224f708556b admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:21.095103 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5477432-c6ac-4cda-86ee-835ae12b60a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:21.095934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5477432-c6ac-4cda-86ee-835ae12b60a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:21.096223 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5477432-c6ac-4cda-86ee-835ae12b60a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:21.096502 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5477432-c6ac-4cda-86ee-835ae12b60a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:21.097241 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5477432-c6ac-4cda-86ee-835ae12b60a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:21.098871 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5477432-c6ac-4cda-86ee-835ae12b60a2 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:21.101047 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-8d465452-7564-4778-a602-2224f708556b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:21.118918 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d465452-7564-4778-a602-2224f708556b admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:21.122619 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a6d93-6756-4fda-9d82-2a2f14d80e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:21.123479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a6d93-6756-4fda-9d82-2a2f14d80e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:21.123792 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a6d93-6756-4fda-9d82-2a2f14d80e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:21.124067 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a6d93-6756-4fda-9d82-2a2f14d80e32 admin admin] PATH_INFO: `/v3/projects/8e104b8ed91644aea8cbff3d6dcb99e5` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:21.125375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a6d93-6756-4fda-9d82-2a2f14d80e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e104b8ed91644aea8cbff3d6dcb99e5)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:21.125891 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1404/2807] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:21.127356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a6d93-6756-4fda-9d82-2a2f14d80e32 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:21.129878 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5477432-c6ac-4cda-86ee-835ae12b60a2 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:21.141278 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5477432-c6ac-4cda-86ee-835ae12b60a2 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:21.146776 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abce875-a0af-409c-9b64-49b4faabecf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:21.147769 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abce875-a0af-409c-9b64-49b4faabecf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:21.148052 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abce875-a0af-409c-9b64-49b4faabecf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:21.148334 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abce875-a0af-409c-9b64-49b4faabecf1 admin admin] PATH_INFO: `/v3/projects/efdacebd43504470a143a3c9a7e8fbe0/users/465e5107219d4195aa475c008e4c3f54/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:21.165485 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abce875-a0af-409c-9b64-49b4faabecf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efdacebd43504470a143a3c9a7e8fbe0, user_id=465e5107219d4195aa475c008e4c3f54, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:21.168203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abce875-a0af-409c-9b64-49b4faabecf1 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:21.220833 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1405/2808] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:21 2022] PUT /identity/v3/projects/efdacebd43504470a143a3c9a7e8fbe0/users/465e5107219d4195aa475c008e4c3f54/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:21.228536 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-077a6d93-6756-4fda-9d82-2a2f14d80e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e104b8ed91644aea8cbff3d6dcb99e5', 'request_id': 'req-077a6d93-6756-4fda-9d82-2a2f14d80e32'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:21.230655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:21.232934 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459068d5-0c80-4620-8d01-c7d5598c362f None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:21.233226 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459068d5-0c80-4620-8d01-c7d5598c362f None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:21.233505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459068d5-0c80-4620-8d01-c7d5598c362f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:21.235216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-077a6d93-6756-4fda-9d82-2a2f14d80e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e104b8ed91644aea8cbff3d6dcb99e5', 'request_id': 'req-077a6d93-6756-4fda-9d82-2a2f14d80e32'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:21.261053 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-459068d5-0c80-4620-8d01-c7d5598c362f None None] MFA Rules not processed for user `465e5107219d4195aa475c008e4c3f54`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:21.262265 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-459068d5-0c80-4620-8d01-c7d5598c362f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:21.299453 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:21.312164 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-077a6d93-6756-4fda-9d82-2a2f14d80e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e104b8ed91644aea8cbff3d6dcb99e5', 'request_id': 'req-077a6d93-6756-4fda-9d82-2a2f14d80e32'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:21.325231 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-077a6d93-6756-4fda-9d82-2a2f14d80e32 admin admin] The token cache is being invalidate because project 8e104b8ed91644aea8cbff3d6dcb99e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:21.325459 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-077a6d93-6756-4fda-9d82-2a2f14d80e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:21.326502 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-077a6d93-6756-4fda-9d82-2a2f14d80e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:21.326984 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1406/2809] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:21.331131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459068d5-0c80-4620-8d01-c7d5598c362f None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:21.331686 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1404/2810] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:21 2022] DELETE /identity/v3/projects/8e104b8ed91644aea8cbff3d6dcb99e5 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:21.336094 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a6d93-6756-4fda-9d82-2a2f14d80e32 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:21.337562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-077a6d93-6756-4fda-9d82-2a2f14d80e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:21.401486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459068d5-0c80-4620-8d01-c7d5598c362f None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:21.405257 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a6d93-6756-4fda-9d82-2a2f14d80e32 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:21.406433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3d741-b763-476e-a379-414dc891535b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:21.407098 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3d741-b763-476e-a379-414dc891535b admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:21.407385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3d741-b763-476e-a379-414dc891535b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:21.407718 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3d741-b763-476e-a379-414dc891535b admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:21.408418 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3d741-b763-476e-a379-414dc891535b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:21.410106 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f189dd8-0b8b-4e6f-a031-92445b9fd90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:21.410961 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3d741-b763-476e-a379-414dc891535b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:21.411095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f189dd8-0b8b-4e6f-a031-92445b9fd90c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:21.411321 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f189dd8-0b8b-4e6f-a031-92445b9fd90c admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:21.411569 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f189dd8-0b8b-4e6f-a031-92445b9fd90c admin admin] PATH_INFO: `/v3/users/92e8d168583d4ef8b0c861624ba228af` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:21.413589 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f189dd8-0b8b-4e6f-a031-92445b9fd90c admin admin] RBAC: Authorizing `identity:delete_user(user_id=92e8d168583d4ef8b0c861624ba228af)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:21.415266 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f189dd8-0b8b-4e6f-a031-92445b9fd90c admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:21.497063 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1407/2811] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:21 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:58:21.502152 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3d741-b763-476e-a379-414dc891535b admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:21.505221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d5f3d741-b763-476e-a379-414dc891535b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:21.572124 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3d741-b763-476e-a379-414dc891535b admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:21.577037 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0c3c7-91bc-4440-b626-f9ae0a6d7721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:21.577650 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0c3c7-91bc-4440-b626-f9ae0a6d7721 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:21.577936 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0c3c7-91bc-4440-b626-f9ae0a6d7721 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:21.578216 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0c3c7-91bc-4440-b626-f9ae0a6d7721 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:21.578907 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0c3c7-91bc-4440-b626-f9ae0a6d7721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:21.580893 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0c3c7-91bc-4440-b626-f9ae0a6d7721 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:21.611888 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-4f189dd8-0b8b-4e6f-a031-92445b9fd90c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92e8d168583d4ef8b0c861624ba228af'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:21.661426 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1408/2812] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:21 2022] POST /identity/v3/users => generated 299 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:21.665350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0c3c7-91bc-4440-b626-f9ae0a6d7721 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:21.675407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0c3c7-91bc-4440-b626-f9ae0a6d7721 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:21.680860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb82fe3-ba8b-4aec-be2b-79cbf3132509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:21.681506 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82fe3-ba8b-4aec-be2b-79cbf3132509 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:21.681793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82fe3-ba8b-4aec-be2b-79cbf3132509 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:21.682148 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb82fe3-ba8b-4aec-be2b-79cbf3132509 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:21.682850 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb82fe3-ba8b-4aec-be2b-79cbf3132509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:21.683525 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-4f189dd8-0b8b-4e6f-a031-92445b9fd90c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92e8d168583d4ef8b0c861624ba228af'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:21.684515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb82fe3-ba8b-4aec-be2b-79cbf3132509 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:21.696422 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1409/2813] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:58:21.697665 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-4f189dd8-0b8b-4e6f-a031-92445b9fd90c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92e8d168583d4ef8b0c861624ba228af'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:21.700920 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb82fe3-ba8b-4aec-be2b-79cbf3132509 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:21.705376 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-4f189dd8-0b8b-4e6f-a031-92445b9fd90c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92e8d168583d4ef8b0c861624ba228af'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:21.706157 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-4f189dd8-0b8b-4e6f-a031-92445b9fd90c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92e8d168583d4ef8b0c861624ba228af'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:21.711102 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb82fe3-ba8b-4aec-be2b-79cbf3132509 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:21.712244 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1405/2814] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:21 2022] DELETE /identity/v3/users/92e8d168583d4ef8b0c861624ba228af => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:21.755198 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:21.776467 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560f8b9-e4c5-40a1-8d68-afdf3810568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:21.777376 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560f8b9-e4c5-40a1-8d68-afdf3810568f admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:21.777842 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560f8b9-e4c5-40a1-8d68-afdf3810568f admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:21.778027 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6560f8b9-e4c5-40a1-8d68-afdf3810568f admin admin] PATH_INFO: `/v3/projects/129ab5d59e774eb096716c8d99849d21/users/33fb45a215104c8c8da28d172fa307fc/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:21.795752 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560f8b9-e4c5-40a1-8d68-afdf3810568f admin admin] RBAC: Authorizing `identity:create_grant(project_id=129ab5d59e774eb096716c8d99849d21, user_id=33fb45a215104c8c8da28d172fa307fc, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:21.798525 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6560f8b9-e4c5-40a1-8d68-afdf3810568f admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:21.861279 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1410/2815] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:21 2022] PUT /identity/v3/projects/129ab5d59e774eb096716c8d99849d21/users/33fb45a215104c8c8da28d172fa307fc/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:21.865918 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f189dd8-0b8b-4e6f-a031-92445b9fd90c admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:21.867429 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-4f189dd8-0b8b-4e6f-a031-92445b9fd90c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:21.881574 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f189dd8-0b8b-4e6f-a031-92445b9fd90c admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:21.946023 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936b356-754f-41e9-9e19-54bf16876dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:21.946734 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936b356-754f-41e9-9e19-54bf16876dca admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:21.947022 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936b356-754f-41e9-9e19-54bf16876dca admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:21.947302 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936b356-754f-41e9-9e19-54bf16876dca admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:21.948075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936b356-754f-41e9-9e19-54bf16876dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:21.949839 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936b356-754f-41e9-9e19-54bf16876dca admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:21.951239 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:21.962809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1406/2816] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:21.967337 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560f8b9-e4c5-40a1-8d68-afdf3810568f admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:21.979307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6560f8b9-e4c5-40a1-8d68-afdf3810568f admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:21.985938 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1199d2e-d8ad-42a8-81b9-b3b4ea096f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:21.986847 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1199d2e-d8ad-42a8-81b9-b3b4ea096f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:21.987139 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1199d2e-d8ad-42a8-81b9-b3b4ea096f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:21.987420 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1199d2e-d8ad-42a8-81b9-b3b4ea096f99 admin admin] PATH_INFO: `/v3/projects/129ab5d59e774eb096716c8d99849d21/users/33fb45a215104c8c8da28d172fa307fc/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:21.989473 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1199d2e-d8ad-42a8-81b9-b3b4ea096f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=129ab5d59e774eb096716c8d99849d21, user_id=33fb45a215104c8c8da28d172fa307fc, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:21.993328 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1199d2e-d8ad-42a8-81b9-b3b4ea096f99 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:22.005123 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1411/2817] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:21 2022] PUT /identity/v3/projects/129ab5d59e774eb096716c8d99849d21/users/33fb45a215104c8c8da28d172fa307fc/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:22.016954 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ff824-b4d2-4628-8239-5a8887562aca None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:22.017273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ff824-b4d2-4628-8239-5a8887562aca None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:22.017530 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ff824-b4d2-4628-8239-5a8887562aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:22.048458 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-e08ff824-b4d2-4628-8239-5a8887562aca None None] MFA Rules not processed for user `33fb45a215104c8c8da28d172fa307fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:22.053144 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e08ff824-b4d2-4628-8239-5a8887562aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:22.119754 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1407/2818] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:22.130963 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1199d2e-d8ad-42a8-81b9-b3b4ea096f99 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:22.135626 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-f1199d2e-d8ad-42a8-81b9-b3b4ea096f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:22.159862 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ff824-b4d2-4628-8239-5a8887562aca None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:22.170188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e08ff824-b4d2-4628-8239-5a8887562aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:22.197152 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1199d2e-d8ad-42a8-81b9-b3b4ea096f99 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:22.201011 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b376b2-aedc-4a44-b785-913d93aa5ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:22.202098 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b376b2-aedc-4a44-b785-913d93aa5ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:22.202098 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b376b2-aedc-4a44-b785-913d93aa5ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:22.202336 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b376b2-aedc-4a44-b785-913d93aa5ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:22.213002 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b376b2-aedc-4a44-b785-913d93aa5ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:22.214990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b376b2-aedc-4a44-b785-913d93aa5ef0 service cinder] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:22.226103 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1412/2819] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:22.239998 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ff824-b4d2-4628-8239-5a8887562aca None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:22.245910 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89d9b0-e5b6-4054-9644-f39657e12a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:22.246899 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89d9b0-e5b6-4054-9644-f39657e12a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:22.247117 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89d9b0-e5b6-4054-9644-f39657e12a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:22.247454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89d9b0-e5b6-4054-9644-f39657e12a30 admin admin] PATH_INFO: `/v3/projects/81ebbafc376f44a68ebdfef0db84914e` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:22.248689 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89d9b0-e5b6-4054-9644-f39657e12a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ebbafc376f44a68ebdfef0db84914e)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:22.250731 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89d9b0-e5b6-4054-9644-f39657e12a30 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:22.353582 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-3d89d9b0-e5b6-4054-9644-f39657e12a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ebbafc376f44a68ebdfef0db84914e', 'request_id': 'req-3d89d9b0-e5b6-4054-9644-f39657e12a30'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:22.365332 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-3d89d9b0-e5b6-4054-9644-f39657e12a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ebbafc376f44a68ebdfef0db84914e', 'request_id': 'req-3d89d9b0-e5b6-4054-9644-f39657e12a30'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:22.449073 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-3d89d9b0-e5b6-4054-9644-f39657e12a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ebbafc376f44a68ebdfef0db84914e', 'request_id': 'req-3d89d9b0-e5b6-4054-9644-f39657e12a30'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:22.463644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-3d89d9b0-e5b6-4054-9644-f39657e12a30 admin admin] The token cache is being invalidate because project 81ebbafc376f44a68ebdfef0db84914e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:22.463644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-3d89d9b0-e5b6-4054-9644-f39657e12a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:22.463644 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-3d89d9b0-e5b6-4054-9644-f39657e12a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:22.465414 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1408/2820] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:22 2022] DELETE /identity/v3/projects/81ebbafc376f44a68ebdfef0db84914e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:22.470443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869cec9-4226-4cdb-9d45-4b520bc28f28 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:22.470932 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869cec9-4226-4cdb-9d45-4b520bc28f28 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:22.471323 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869cec9-4226-4cdb-9d45-4b520bc28f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:22.491652 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-e869cec9-4226-4cdb-9d45-4b520bc28f28 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:22.492958 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e869cec9-4226-4cdb-9d45-4b520bc28f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:22.560042 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1413/2821] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:22.568467 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f83a4c-8dd0-4c1c-8d78-60dc8389a67a None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:22.569814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f83a4c-8dd0-4c1c-8d78-60dc8389a67a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:22.569814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f83a4c-8dd0-4c1c-8d78-60dc8389a67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:22.593440 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-53f83a4c-8dd0-4c1c-8d78-60dc8389a67a None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:22.594660 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-53f83a4c-8dd0-4c1c-8d78-60dc8389a67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:22.602901 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1409/2822] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:22.609440 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869cec9-4226-4cdb-9d45-4b520bc28f28 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:22.619275 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869cec9-4226-4cdb-9d45-4b520bc28f28 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:22.627851 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f05b3-aca9-47ae-9730-6463b9e13da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:22.628871 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f05b3-aca9-47ae-9730-6463b9e13da2 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:22.629159 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f05b3-aca9-47ae-9730-6463b9e13da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:22.629441 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f05b3-aca9-47ae-9730-6463b9e13da2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:22.630320 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f05b3-aca9-47ae-9730-6463b9e13da2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:58:22.631466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f05b3-aca9-47ae-9730-6463b9e13da2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:22.635635 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f05b3-aca9-47ae-9730-6463b9e13da2 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:22.649424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1414/2823] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:58:22.650498 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f83a4c-8dd0-4c1c-8d78-60dc8389a67a None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:22.656637 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:22.662618 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f83a4c-8dd0-4c1c-8d78-60dc8389a67a None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:22.670277 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcca66-467a-47fb-a1fa-3b8a970eeda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:22.671043 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcca66-467a-47fb-a1fa-3b8a970eeda4 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:22.671327 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcca66-467a-47fb-a1fa-3b8a970eeda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:22.671640 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcca66-467a-47fb-a1fa-3b8a970eeda4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:22.672410 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcca66-467a-47fb-a1fa-3b8a970eeda4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:22.674273 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dcca66-467a-47fb-a1fa-3b8a970eeda4 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:22.794669 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1410/2824] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:22 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:58:22.798807 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f05b3-aca9-47ae-9730-6463b9e13da2 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:22.808873 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f05b3-aca9-47ae-9730-6463b9e13da2 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:22.857131 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:22.874656 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af3e32-306d-4532-800f-7e5ed6a482f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:22.875346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af3e32-306d-4532-800f-7e5ed6a482f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:22.882943 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af3e32-306d-4532-800f-7e5ed6a482f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:22.882943 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af3e32-306d-4532-800f-7e5ed6a482f0 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:22.882943 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af3e32-306d-4532-800f-7e5ed6a482f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:22.882943 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5af3e32-306d-4532-800f-7e5ed6a482f0 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:22.974663 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1415/2825] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:22 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:22.975080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcca66-467a-47fb-a1fa-3b8a970eeda4 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:22.988923 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dcca66-467a-47fb-a1fa-3b8a970eeda4 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:22.995350 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99c126-7ee4-4aa3-a02c-172689b7a62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:22.996291 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99c126-7ee4-4aa3-a02c-172689b7a62d admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:22.996454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99c126-7ee4-4aa3-a02c-172689b7a62d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:22.996732 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99c126-7ee4-4aa3-a02c-172689b7a62d admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:22.997472 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99c126-7ee4-4aa3-a02c-172689b7a62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:22.999225 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc99c126-7ee4-4aa3-a02c-172689b7a62d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:23.016088 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1411/2826] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:58:23.020116 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af3e32-306d-4532-800f-7e5ed6a482f0 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:23.033738 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5af3e32-306d-4532-800f-7e5ed6a482f0 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:23.045577 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5b83f9-4853-43c6-80da-9f772905c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:23.047303 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b83f9-4853-43c6-80da-9f772905c37b admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:23.047303 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b83f9-4853-43c6-80da-9f772905c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:23.047303 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5b83f9-4853-43c6-80da-9f772905c37b admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:23.048445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b83f9-4853-43c6-80da-9f772905c37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:23.052091 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5b83f9-4853-43c6-80da-9f772905c37b admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:23.068882 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1416/2827] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:23 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:23.074647 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99c126-7ee4-4aa3-a02c-172689b7a62d admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:23.087371 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc99c126-7ee4-4aa3-a02c-172689b7a62d admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:23.093624 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec2d62-f39f-48f4-b4a0-051f2f7e5ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:23.094101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec2d62-f39f-48f4-b4a0-051f2f7e5ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:23.094422 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec2d62-f39f-48f4-b4a0-051f2f7e5ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:23.094706 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec2d62-f39f-48f4-b4a0-051f2f7e5ceb admin admin] PATH_INFO: `/v3/projects/427752e61209465982d22ea708185241/users/f2b2a3a71c7243e8b999257b260793ba/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:23.126619 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec2d62-f39f-48f4-b4a0-051f2f7e5ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=427752e61209465982d22ea708185241, user_id=f2b2a3a71c7243e8b999257b260793ba, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:23.134779 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec2d62-f39f-48f4-b4a0-051f2f7e5ceb admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:23.187448 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1412/2828] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:23 2022] PUT /identity/v3/projects/427752e61209465982d22ea708185241/users/f2b2a3a71c7243e8b999257b260793ba/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:23.201955 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a16b2-c4e4-4929-a2a1-915ba81491cb None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:23.204533 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a16b2-c4e4-4929-a2a1-915ba81491cb None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:23.204901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a16b2-c4e4-4929-a2a1-915ba81491cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:23.239594 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-484a16b2-c4e4-4929-a2a1-915ba81491cb None None] MFA Rules not processed for user `f2b2a3a71c7243e8b999257b260793ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:23.241218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-484a16b2-c4e4-4929-a2a1-915ba81491cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:23.320150 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1417/2829] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:23.330344 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec2d62-f39f-48f4-b4a0-051f2f7e5ceb admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:23.335795 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-87ec2d62-f39f-48f4-b4a0-051f2f7e5ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:23.339901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a16b2-c4e4-4929-a2a1-915ba81491cb None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:23.341385 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-484a16b2-c4e4-4929-a2a1-915ba81491cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:23.406098 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec2d62-f39f-48f4-b4a0-051f2f7e5ceb admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:23.413018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a16b2-c4e4-4929-a2a1-915ba81491cb None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:23.414675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6881025c-4898-479d-8722-895302626da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:23.415361 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881025c-4898-479d-8722-895302626da5 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:23.415681 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881025c-4898-479d-8722-895302626da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:23.415963 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6881025c-4898-479d-8722-895302626da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:23.417941 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9477f-bbe3-44c7-ac58-ea16df744f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:23.418837 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9477f-bbe3-44c7-ac58-ea16df744f3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:23.419119 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9477f-bbe3-44c7-ac58-ea16df744f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:23.419395 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9477f-bbe3-44c7-ac58-ea16df744f3c admin admin] PATH_INFO: `/v3/users/465e5107219d4195aa475c008e4c3f54` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:23.420631 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9477f-bbe3-44c7-ac58-ea16df744f3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=465e5107219d4195aa475c008e4c3f54)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:23.422694 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b9477f-bbe3-44c7-ac58-ea16df744f3c admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:23.425818 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881025c-4898-479d-8722-895302626da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:23.427509 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6881025c-4898-479d-8722-895302626da5 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:23.437695 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1413/2830] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:58:23.617888 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-32b9477f-bbe3-44c7-ac58-ea16df744f3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '465e5107219d4195aa475c008e4c3f54'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:23.621612 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:23.684224 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-32b9477f-bbe3-44c7-ac58-ea16df744f3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '465e5107219d4195aa475c008e4c3f54'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:23.697534 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-32b9477f-bbe3-44c7-ac58-ea16df744f3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '465e5107219d4195aa475c008e4c3f54'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:23.698259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-32b9477f-bbe3-44c7-ac58-ea16df744f3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '465e5107219d4195aa475c008e4c3f54'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:23.705153 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-32b9477f-bbe3-44c7-ac58-ea16df744f3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '465e5107219d4195aa475c008e4c3f54'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:23.711203 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1418/2831] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:23 2022] DELETE /identity/v3/users/465e5107219d4195aa475c008e4c3f54 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:23.716099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2e585-10fa-453c-8311-2e4d338afa7b None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:23.716616 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2e585-10fa-453c-8311-2e4d338afa7b None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:23.716704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2e585-10fa-453c-8311-2e4d338afa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:23.733926 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-a3e2e585-10fa-453c-8311-2e4d338afa7b None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:23.735136 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a3e2e585-10fa-453c-8311-2e4d338afa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:23.796717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1414/2832] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:23.806472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9477f-bbe3-44c7-ac58-ea16df744f3c admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:23.808070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-32b9477f-bbe3-44c7-ac58-ea16df744f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:23.870396 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b9477f-bbe3-44c7-ac58-ea16df744f3c admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:23.874212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e75321-225a-4375-bf7e-ebc9bea3e552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:23.874854 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e75321-225a-4375-bf7e-ebc9bea3e552 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:23.875137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e75321-225a-4375-bf7e-ebc9bea3e552 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:23.875413 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e75321-225a-4375-bf7e-ebc9bea3e552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:23.886169 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e75321-225a-4375-bf7e-ebc9bea3e552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:23.887815 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e75321-225a-4375-bf7e-ebc9bea3e552 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:23.898348 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1419/2833] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:24.389454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2e585-10fa-453c-8311-2e4d338afa7b None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:24.390948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-a3e2e585-10fa-453c-8311-2e4d338afa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:24.405886 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2e585-10fa-453c-8311-2e4d338afa7b None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:24.412509 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:24.413503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:24.413840 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:24.414023 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82 admin admin] PATH_INFO: `/v3/projects/efdacebd43504470a143a3c9a7e8fbe0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:24.415361 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efdacebd43504470a143a3c9a7e8fbe0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:24.417370 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:24.516088 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:24.519052 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efdacebd43504470a143a3c9a7e8fbe0', 'request_id': 'req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:24.526182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efdacebd43504470a143a3c9a7e8fbe0', 'request_id': 'req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:24.574991 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efdacebd43504470a143a3c9a7e8fbe0', 'request_id': 'req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:24.586363 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82 admin admin] The token cache is being invalidate because project efdacebd43504470a143a3c9a7e8fbe0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:24.586652 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:24.587262 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:24.588814 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1415/2834] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:24 2022] DELETE /identity/v3/projects/efdacebd43504470a143a3c9a7e8fbe0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:24.592983 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e75321-225a-4375-bf7e-ebc9bea3e552 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:24.603817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e75321-225a-4375-bf7e-ebc9bea3e552 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:24.659741 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140507e8-2c32-4167-8936-b1c7318d8260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:24.660643 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140507e8-2c32-4167-8936-b1c7318d8260 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:24.660929 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140507e8-2c32-4167-8936-b1c7318d8260 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:24.661209 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140507e8-2c32-4167-8936-b1c7318d8260 admin admin] PATH_INFO: `/v3/users/33fb45a215104c8c8da28d172fa307fc` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:24.663025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140507e8-2c32-4167-8936-b1c7318d8260 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33fb45a215104c8c8da28d172fa307fc)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:24.665077 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140507e8-2c32-4167-8936-b1c7318d8260 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:24.892333 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-140507e8-2c32-4167-8936-b1c7318d8260 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33fb45a215104c8c8da28d172fa307fc'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:24.957962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-140507e8-2c32-4167-8936-b1c7318d8260 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33fb45a215104c8c8da28d172fa307fc'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:24.971982 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-140507e8-2c32-4167-8936-b1c7318d8260 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33fb45a215104c8c8da28d172fa307fc'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:24.972724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-140507e8-2c32-4167-8936-b1c7318d8260 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33fb45a215104c8c8da28d172fa307fc'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:24.974825 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:24.980602 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-140507e8-2c32-4167-8936-b1c7318d8260 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33fb45a215104c8c8da28d172fa307fc'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:24.987096 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1420/2835] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:24 2022] DELETE /identity/v3/users/33fb45a215104c8c8da28d172fa307fc => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:25.417003 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:25.418520 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:25.431892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbbb98-10a7-4c21-8e54-bfe05d683b82 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:25.513045 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60feb8c2-ffc8-4a70-ade2-d7214aa9ed40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:25.514104 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60feb8c2-ffc8-4a70-ade2-d7214aa9ed40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:25.514454 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60feb8c2-ffc8-4a70-ade2-d7214aa9ed40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:25.514842 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60feb8c2-ffc8-4a70-ade2-d7214aa9ed40 admin admin] PATH_INFO: `/v3/projects/129ab5d59e774eb096716c8d99849d21` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:25.516154 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60feb8c2-ffc8-4a70-ade2-d7214aa9ed40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=129ab5d59e774eb096716c8d99849d21)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:25.518069 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60feb8c2-ffc8-4a70-ade2-d7214aa9ed40 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:25.661060 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-60feb8c2-ffc8-4a70-ade2-d7214aa9ed40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '129ab5d59e774eb096716c8d99849d21', 'request_id': 'req-60feb8c2-ffc8-4a70-ade2-d7214aa9ed40'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:25.667634 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-60feb8c2-ffc8-4a70-ade2-d7214aa9ed40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '129ab5d59e774eb096716c8d99849d21', 'request_id': 'req-60feb8c2-ffc8-4a70-ade2-d7214aa9ed40'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:25.757943 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-60feb8c2-ffc8-4a70-ade2-d7214aa9ed40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '129ab5d59e774eb096716c8d99849d21', 'request_id': 'req-60feb8c2-ffc8-4a70-ade2-d7214aa9ed40'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:25.769010 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-60feb8c2-ffc8-4a70-ade2-d7214aa9ed40 admin admin] The token cache is being invalidate because project 129ab5d59e774eb096716c8d99849d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:25.769297 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-60feb8c2-ffc8-4a70-ade2-d7214aa9ed40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:25.769906 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-60feb8c2-ffc8-4a70-ade2-d7214aa9ed40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:25.771463 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1416/2836] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:25 2022] DELETE /identity/v3/projects/129ab5d59e774eb096716c8d99849d21 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:25.777505 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f048f1c-a32e-44a7-a779-bc9ee34bac6c None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:25.777997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f048f1c-a32e-44a7-a779-bc9ee34bac6c None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:25.778130 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f048f1c-a32e-44a7-a779-bc9ee34bac6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:25.797212 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-3f048f1c-a32e-44a7-a779-bc9ee34bac6c None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:25.798412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-3f048f1c-a32e-44a7-a779-bc9ee34bac6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:25.861070 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1421/2837] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:25.869517 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec24b9c-c967-466a-982a-3429bf53eb2d None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:25.869807 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec24b9c-c967-466a-982a-3429bf53eb2d None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:25.870091 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec24b9c-c967-466a-982a-3429bf53eb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:25.888600 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-3ec24b9c-c967-466a-982a-3429bf53eb2d None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:25.889786 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-3ec24b9c-c967-466a-982a-3429bf53eb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:25.898106 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1417/2838] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:25.903062 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f048f1c-a32e-44a7-a779-bc9ee34bac6c None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:25.914466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f048f1c-a32e-44a7-a779-bc9ee34bac6c None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:25.918551 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f71c6e-e5ea-4469-91c3-faa900b3eac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:25.919206 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f71c6e-e5ea-4469-91c3-faa900b3eac9 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:25.919488 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f71c6e-e5ea-4469-91c3-faa900b3eac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:25.919795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f71c6e-e5ea-4469-91c3-faa900b3eac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:25.920520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f71c6e-e5ea-4469-91c3-faa900b3eac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:58:25.920834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f71c6e-e5ea-4469-91c3-faa900b3eac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:25.922436 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f71c6e-e5ea-4469-91c3-faa900b3eac9 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:25.933917 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1422/2839] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:58:25.938240 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec24b9c-c967-466a-982a-3429bf53eb2d None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:25.947396 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec24b9c-c967-466a-982a-3429bf53eb2d None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:25.952501 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ecca5-0855-4a5a-a9cb-909a8561ab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:25.953284 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ecca5-0855-4a5a-a9cb-909a8561ab5d admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:25.953575 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ecca5-0855-4a5a-a9cb-909a8561ab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:25.953857 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ecca5-0855-4a5a-a9cb-909a8561ab5d admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:25.954590 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ecca5-0855-4a5a-a9cb-909a8561ab5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:25.956576 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ecca5-0855-4a5a-a9cb-909a8561ab5d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:26.067682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1418/2840] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:25 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:26.072323 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f71c6e-e5ea-4469-91c3-faa900b3eac9 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:26.082673 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f71c6e-e5ea-4469-91c3-faa900b3eac9 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:26.140711 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7b280-e547-4891-b553-01ec8482c187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:26.141378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b280-e547-4891-b553-01ec8482c187 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:26.141665 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b280-e547-4891-b553-01ec8482c187 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:26.141940 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe7b280-e547-4891-b553-01ec8482c187 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:26.142637 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7b280-e547-4891-b553-01ec8482c187 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:26.144646 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe7b280-e547-4891-b553-01ec8482c187 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:26.261250 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1423/2841] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:26 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:58:26.265327 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ecca5-0855-4a5a-a9cb-909a8561ab5d admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:26.276263 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ecca5-0855-4a5a-a9cb-909a8561ab5d admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:26.280516 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efba4b7-65ae-4183-9500-c1804cb7f7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:26.281169 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efba4b7-65ae-4183-9500-c1804cb7f7e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:26.281449 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efba4b7-65ae-4183-9500-c1804cb7f7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:26.281878 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efba4b7-65ae-4183-9500-c1804cb7f7e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:26.282719 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efba4b7-65ae-4183-9500-c1804cb7f7e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:26.284351 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efba4b7-65ae-4183-9500-c1804cb7f7e9 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:26.296325 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1419/2842] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:26.300342 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7b280-e547-4891-b553-01ec8482c187 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:26.311163 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe7b280-e547-4891-b553-01ec8482c187 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:26.316262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4687f1-04db-48a1-95dc-505b0d718249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:26.316918 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4687f1-04db-48a1-95dc-505b0d718249 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:26.317204 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4687f1-04db-48a1-95dc-505b0d718249 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:26.317486 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4687f1-04db-48a1-95dc-505b0d718249 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:26.318234 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4687f1-04db-48a1-95dc-505b0d718249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:26.320343 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4687f1-04db-48a1-95dc-505b0d718249 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:26.330828 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1424/2843] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:26.334909 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efba4b7-65ae-4183-9500-c1804cb7f7e9 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:26.344793 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efba4b7-65ae-4183-9500-c1804cb7f7e9 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:26.349388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af678b-e872-4c60-b6e7-0ac5f654ffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:26.350809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af678b-e872-4c60-b6e7-0ac5f654ffc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:26.351844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af678b-e872-4c60-b6e7-0ac5f654ffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:26.352186 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af678b-e872-4c60-b6e7-0ac5f654ffc4 admin admin] PATH_INFO: `/v3/projects/1267f4d4dc80448fbef71df5fe2ddb41/users/086e2b91000e493692de8817fdde6db0/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:26.368470 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af678b-e872-4c60-b6e7-0ac5f654ffc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1267f4d4dc80448fbef71df5fe2ddb41, user_id=086e2b91000e493692de8817fdde6db0, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:26.371101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92af678b-e872-4c60-b6e7-0ac5f654ffc4 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:26.451375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:26.457430 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1420/2844] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:26 2022] PUT /identity/v3/projects/1267f4d4dc80448fbef71df5fe2ddb41/users/086e2b91000e493692de8817fdde6db0/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:26.471051 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2ca8f-8182-43f5-a723-848c3124ef34 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:26.471346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2ca8f-8182-43f5-a723-848c3124ef34 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:26.471669 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a2ca8f-8182-43f5-a723-848c3124ef34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:26.498447 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-d9a2ca8f-8182-43f5-a723-848c3124ef34 None None] MFA Rules not processed for user `086e2b91000e493692de8817fdde6db0`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:26.499824 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d9a2ca8f-8182-43f5-a723-848c3124ef34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:26.545664 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:26.565651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1425/2845] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:26.577095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af678b-e872-4c60-b6e7-0ac5f654ffc4 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:26.578944 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-92af678b-e872-4c60-b6e7-0ac5f654ffc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:26.647420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92af678b-e872-4c60-b6e7-0ac5f654ffc4 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:26.651199 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad210c-3f1e-40b1-8ec4-aee9d4c7f424 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:26.651893 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad210c-3f1e-40b1-8ec4-aee9d4c7f424 service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:26.652178 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad210c-3f1e-40b1-8ec4-aee9d4c7f424 service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:26.652452 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad210c-3f1e-40b1-8ec4-aee9d4c7f424 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:26.665082 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad210c-3f1e-40b1-8ec4-aee9d4c7f424 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:26.667855 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad210c-3f1e-40b1-8ec4-aee9d4c7f424 service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:26.680253 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1421/2846] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:30.285562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2ca8f-8182-43f5-a723-848c3124ef34 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:30.286973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d9a2ca8f-8182-43f5-a723-848c3124ef34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:30.353931 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a2ca8f-8182-43f5-a723-848c3124ef34 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:30.359055 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7a60d-aaa7-4fb2-a0dd-fb339e531d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:30.360058 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7a60d-aaa7-4fb2-a0dd-fb339e531d25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:30.360337 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7a60d-aaa7-4fb2-a0dd-fb339e531d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:30.360612 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7a60d-aaa7-4fb2-a0dd-fb339e531d25 admin admin] PATH_INFO: `/v3/users/f2b2a3a71c7243e8b999257b260793ba` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:30.361818 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7a60d-aaa7-4fb2-a0dd-fb339e531d25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b2a3a71c7243e8b999257b260793ba)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:30.363795 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7a60d-aaa7-4fb2-a0dd-fb339e531d25 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:30.538388 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-1bb7a60d-aaa7-4fb2-a0dd-fb339e531d25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b2a3a71c7243e8b999257b260793ba'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:30.643437 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-1bb7a60d-aaa7-4fb2-a0dd-fb339e531d25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b2a3a71c7243e8b999257b260793ba'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:30.657011 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-1bb7a60d-aaa7-4fb2-a0dd-fb339e531d25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b2a3a71c7243e8b999257b260793ba'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:30.657859 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-1bb7a60d-aaa7-4fb2-a0dd-fb339e531d25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b2a3a71c7243e8b999257b260793ba'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:30.660974 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad210c-3f1e-40b1-8ec4-aee9d4c7f424 service cinder] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:30.668645 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-1bb7a60d-aaa7-4fb2-a0dd-fb339e531d25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b2a3a71c7243e8b999257b260793ba'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:30.674672 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1426/2847] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:30 2022] DELETE /identity/v3/users/f2b2a3a71c7243e8b999257b260793ba => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:30.678079 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad210c-3f1e-40b1-8ec4-aee9d4c7f424 service cinder] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:30.679126 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fcf92-5f3e-4dc4-92f2-5f17be312081 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:30.679417 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fcf92-5f3e-4dc4-92f2-5f17be312081 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:30.679724 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620fcf92-5f3e-4dc4-92f2-5f17be312081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:30.697262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-620fcf92-5f3e-4dc4-92f2-5f17be312081 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:30.698862 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-620fcf92-5f3e-4dc4-92f2-5f17be312081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:30.735573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9cfed-8cae-4f98-8dce-72773315b0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:30.736469 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9cfed-8cae-4f98-8dce-72773315b0db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:30.736760 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9cfed-8cae-4f98-8dce-72773315b0db admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:30.737076 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9cfed-8cae-4f98-8dce-72773315b0db admin admin] PATH_INFO: `/v3/users/086e2b91000e493692de8817fdde6db0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:30.738312 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9cfed-8cae-4f98-8dce-72773315b0db admin admin] RBAC: Authorizing `identity:delete_user(user_id=086e2b91000e493692de8817fdde6db0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:30.740382 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9cfed-8cae-4f98-8dce-72773315b0db admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:30.765152 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1427/2848] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:58:30.776814 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fcf92-5f3e-4dc4-92f2-5f17be312081 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:30.776814 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-620fcf92-5f3e-4dc4-92f2-5f17be312081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:30.786214 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:30.832686 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620fcf92-5f3e-4dc4-92f2-5f17be312081 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:30.836317 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419e59c-bd0e-40e1-a935-5bc5ac437366 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:30.836959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419e59c-bd0e-40e1-a935-5bc5ac437366 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:30.837241 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419e59c-bd0e-40e1-a935-5bc5ac437366 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:30.837520 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419e59c-bd0e-40e1-a935-5bc5ac437366 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:30.846773 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419e59c-bd0e-40e1-a935-5bc5ac437366 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:30.848239 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419e59c-bd0e-40e1-a935-5bc5ac437366 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:30.858249 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1428/2849] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:58:30.907016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-70d9cfed-8cae-4f98-8dce-72773315b0db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '086e2b91000e493692de8817fdde6db0'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:30.997864 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-70d9cfed-8cae-4f98-8dce-72773315b0db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '086e2b91000e493692de8817fdde6db0'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:31.014042 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-70d9cfed-8cae-4f98-8dce-72773315b0db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '086e2b91000e493692de8817fdde6db0'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:31.021547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-70d9cfed-8cae-4f98-8dce-72773315b0db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '086e2b91000e493692de8817fdde6db0'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:31.022280 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-70d9cfed-8cae-4f98-8dce-72773315b0db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '086e2b91000e493692de8817fdde6db0'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:31.028401 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1422/2850] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:30 2022] DELETE /identity/v3/users/086e2b91000e493692de8817fdde6db0 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:31.033146 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b960756-c433-43e8-b29f-118d5b315a28 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:31.033438 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b960756-c433-43e8-b29f-118d5b315a28 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:31.033728 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b960756-c433-43e8-b29f-118d5b315a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:31.052121 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-8b960756-c433-43e8-b29f-118d5b315a28 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:31.054013 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-8b960756-c433-43e8-b29f-118d5b315a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:31.122125 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1429/2851] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:31.132545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9cfed-8cae-4f98-8dce-72773315b0db admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:31.134100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-70d9cfed-8cae-4f98-8dce-72773315b0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:31.169611 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:31.201287 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9cfed-8cae-4f98-8dce-72773315b0db admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:31.205075 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28306391-ec2f-4805-816b-df30be3a7afd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:31.205722 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28306391-ec2f-4805-816b-df30be3a7afd service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:31.206068 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28306391-ec2f-4805-816b-df30be3a7afd service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:31.206399 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28306391-ec2f-4805-816b-df30be3a7afd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:31.215997 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28306391-ec2f-4805-816b-df30be3a7afd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:31.217479 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28306391-ec2f-4805-816b-df30be3a7afd service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:31.227921 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1423/2852] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:31.522580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b960756-c433-43e8-b29f-118d5b315a28 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:31.522580 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-8b960756-c433-43e8-b29f-118d5b315a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:31.557671 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b960756-c433-43e8-b29f-118d5b315a28 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:31.578343 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba77cb-9ced-480c-b889-9a7d925a206e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:31.579269 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba77cb-9ced-480c-b889-9a7d925a206e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:31.580088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba77cb-9ced-480c-b889-9a7d925a206e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:31.580370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba77cb-9ced-480c-b889-9a7d925a206e admin admin] PATH_INFO: `/v3/projects/427752e61209465982d22ea708185241` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:31.581635 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba77cb-9ced-480c-b889-9a7d925a206e admin admin] RBAC: Authorizing `identity:delete_project(project_id=427752e61209465982d22ea708185241)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:31.583647 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba77cb-9ced-480c-b889-9a7d925a206e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:31.701362 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-12ba77cb-9ced-480c-b889-9a7d925a206e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '427752e61209465982d22ea708185241', 'request_id': 'req-12ba77cb-9ced-480c-b889-9a7d925a206e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:31.714992 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28306391-ec2f-4805-816b-df30be3a7afd service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:31.716517 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-28306391-ec2f-4805-816b-df30be3a7afd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:31.731661 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28306391-ec2f-4805-816b-df30be3a7afd service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:31.788752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d8e89-9199-4dcc-a1cb-b13811a812fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:31.789623 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8e89-9199-4dcc-a1cb-b13811a812fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:31.789904 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8e89-9199-4dcc-a1cb-b13811a812fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:31.790181 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d8e89-9199-4dcc-a1cb-b13811a812fd admin admin] PATH_INFO: `/v3/projects/1267f4d4dc80448fbef71df5fe2ddb41` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:31.791436 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d8e89-9199-4dcc-a1cb-b13811a812fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1267f4d4dc80448fbef71df5fe2ddb41)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:31.792273 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-12ba77cb-9ced-480c-b889-9a7d925a206e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '427752e61209465982d22ea708185241', 'request_id': 'req-12ba77cb-9ced-480c-b889-9a7d925a206e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:31.793420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d8e89-9199-4dcc-a1cb-b13811a812fd admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:31.798738 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-12ba77cb-9ced-480c-b889-9a7d925a206e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '427752e61209465982d22ea708185241', 'request_id': 'req-12ba77cb-9ced-480c-b889-9a7d925a206e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:31.811725 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-12ba77cb-9ced-480c-b889-9a7d925a206e admin admin] The token cache is being invalidate because project 427752e61209465982d22ea708185241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:31.812020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-12ba77cb-9ced-480c-b889-9a7d925a206e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:31.812670 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-12ba77cb-9ced-480c-b889-9a7d925a206e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:31.814205 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1430/2853] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:31 2022] DELETE /identity/v3/projects/427752e61209465982d22ea708185241 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:31.819494 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d6c8c-fd0f-485c-a5c8-11b7b2c3a740 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:31.819823 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d6c8c-fd0f-485c-a5c8-11b7b2c3a740 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:31.820096 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d6c8c-fd0f-485c-a5c8-11b7b2c3a740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:31.838242 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-205d6c8c-fd0f-485c-a5c8-11b7b2c3a740 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:31.839444 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-205d6c8c-fd0f-485c-a5c8-11b7b2c3a740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:31.847658 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1431/2854] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:31.855428 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5954e0-fdb6-4105-8065-6bbe5e12e074 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:31.855749 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5954e0-fdb6-4105-8065-6bbe5e12e074 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:31.856033 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5954e0-fdb6-4105-8065-6bbe5e12e074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:31.875687 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-fc5954e0-fdb6-4105-8065-6bbe5e12e074 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:31.876962 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-fc5954e0-fdb6-4105-8065-6bbe5e12e074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:31.889279 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-b30d8e89-9199-4dcc-a1cb-b13811a812fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1267f4d4dc80448fbef71df5fe2ddb41', 'request_id': 'req-b30d8e89-9199-4dcc-a1cb-b13811a812fd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:31.895717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-b30d8e89-9199-4dcc-a1cb-b13811a812fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1267f4d4dc80448fbef71df5fe2ddb41', 'request_id': 'req-b30d8e89-9199-4dcc-a1cb-b13811a812fd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:31.899305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:31.937350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1432/2855] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:58:31.941445 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5954e0-fdb6-4105-8065-6bbe5e12e074 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:31.950565 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5954e0-fdb6-4105-8065-6bbe5e12e074 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:31.955299 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43088a-b3f2-488d-9cd7-de6088f8d8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:31.955790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43088a-b3f2-488d-9cd7-de6088f8d8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:31.956075 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43088a-b3f2-488d-9cd7-de6088f8d8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:31.956352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43088a-b3f2-488d-9cd7-de6088f8d8e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:31.957064 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43088a-b3f2-488d-9cd7-de6088f8d8e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:58:31.957372 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43088a-b3f2-488d-9cd7-de6088f8d8e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:31.958973 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43088a-b3f2-488d-9cd7-de6088f8d8e5 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:31.969989 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1433/2856] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 27 18:58:31.973870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43088a-b3f2-488d-9cd7-de6088f8d8e5 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:31.984473 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43088a-b3f2-488d-9cd7-de6088f8d8e5 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:31.989095 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad593c-58da-44a4-bcae-ed60113dc0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:31.989698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad593c-58da-44a4-bcae-ed60113dc0f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:31.989981 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad593c-58da-44a4-bcae-ed60113dc0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:31.990807 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad593c-58da-44a4-bcae-ed60113dc0f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:31.991466 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad593c-58da-44a4-bcae-ed60113dc0f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:31.993457 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad593c-58da-44a4-bcae-ed60113dc0f4 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:32.003182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-b30d8e89-9199-4dcc-a1cb-b13811a812fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1267f4d4dc80448fbef71df5fe2ddb41', 'request_id': 'req-b30d8e89-9199-4dcc-a1cb-b13811a812fd'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:32.014854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-b30d8e89-9199-4dcc-a1cb-b13811a812fd admin admin] The token cache is being invalidate because project 1267f4d4dc80448fbef71df5fe2ddb41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:32.015139 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-b30d8e89-9199-4dcc-a1cb-b13811a812fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:32.015794 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-b30d8e89-9199-4dcc-a1cb-b13811a812fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:32.017338 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1424/2857] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:31 2022] DELETE /identity/v3/projects/1267f4d4dc80448fbef71df5fe2ddb41 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:32.089379 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1434/2858] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:31 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:58:32.090679 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d8e89-9199-4dcc-a1cb-b13811a812fd admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:32.092196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-b30d8e89-9199-4dcc-a1cb-b13811a812fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:32.106058 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d8e89-9199-4dcc-a1cb-b13811a812fd admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:32.161131 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:32.169181 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99607b9-4ef6-4516-a51b-5cffdc3aecad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:32.169875 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99607b9-4ef6-4516-a51b-5cffdc3aecad admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:32.170153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99607b9-4ef6-4516-a51b-5cffdc3aecad admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:32.170426 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99607b9-4ef6-4516-a51b-5cffdc3aecad admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:32.171118 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99607b9-4ef6-4516-a51b-5cffdc3aecad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:32.173087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99607b9-4ef6-4516-a51b-5cffdc3aecad admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:32.267251 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1425/2859] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:32 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:32.271271 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad593c-58da-44a4-bcae-ed60113dc0f4 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:32.281959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad593c-58da-44a4-bcae-ed60113dc0f4 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:32.286601 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a882cd-4d6c-40a6-86f4-b82ec8356716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:32.287801 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a882cd-4d6c-40a6-86f4-b82ec8356716 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:32.288089 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a882cd-4d6c-40a6-86f4-b82ec8356716 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:32.288412 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a882cd-4d6c-40a6-86f4-b82ec8356716 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:32.289155 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a882cd-4d6c-40a6-86f4-b82ec8356716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:32.290764 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a882cd-4d6c-40a6-86f4-b82ec8356716 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:32.302296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1435/2860] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:32.306216 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99607b9-4ef6-4516-a51b-5cffdc3aecad admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:32.316335 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99607b9-4ef6-4516-a51b-5cffdc3aecad admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:32.321205 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdee57-916c-4eb3-b1e6-30faadc844b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:32.321855 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdee57-916c-4eb3-b1e6-30faadc844b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:32.322135 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdee57-916c-4eb3-b1e6-30faadc844b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:32.322409 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdee57-916c-4eb3-b1e6-30faadc844b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:32.323134 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdee57-916c-4eb3-b1e6-30faadc844b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:32.324753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdee57-916c-4eb3-b1e6-30faadc844b7 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:32.335425 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1426/2861] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 27 18:58:32.342935 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a882cd-4d6c-40a6-86f4-b82ec8356716 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:32.353503 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a882cd-4d6c-40a6-86f4-b82ec8356716 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:32.358387 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7ddf3-3a9f-4735-835a-7b06d4e05ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:32.359264 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7ddf3-3a9f-4735-835a-7b06d4e05ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:32.359568 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7ddf3-3a9f-4735-835a-7b06d4e05ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:32.359848 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7ddf3-3a9f-4735-835a-7b06d4e05ac3 admin admin] PATH_INFO: `/v3/projects/301c619f97334590bad06bcca28f7ab2/users/fe4a36392c7146d58519634f9ccf290a/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:32.374926 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7ddf3-3a9f-4735-835a-7b06d4e05ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=301c619f97334590bad06bcca28f7ab2, user_id=fe4a36392c7146d58519634f9ccf290a, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:32.377633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7ddf3-3a9f-4735-835a-7b06d4e05ac3 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:32.454685 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1436/2862] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:32 2022] PUT /identity/v3/projects/301c619f97334590bad06bcca28f7ab2/users/fe4a36392c7146d58519634f9ccf290a/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:32.466105 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b97f1-8ab7-40fd-b678-f6de10ce486a None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:32.466413 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b97f1-8ab7-40fd-b678-f6de10ce486a None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:32.466698 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b97f1-8ab7-40fd-b678-f6de10ce486a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:32.494188 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-de6b97f1-8ab7-40fd-b678-f6de10ce486a None None] MFA Rules not processed for user `fe4a36392c7146d58519634f9ccf290a`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:32.495409 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-de6b97f1-8ab7-40fd-b678-f6de10ce486a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:32.559073 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1427/2863] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:32.563562 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7ddf3-3a9f-4735-835a-7b06d4e05ac3 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:32.635669 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7ddf3-3a9f-4735-835a-7b06d4e05ac3 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:32.640353 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45e309-de3d-4658-b03e-ce9b5cc7f638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:32.641010 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e309-de3d-4658-b03e-ce9b5cc7f638 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:32.641307 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e309-de3d-4658-b03e-ce9b5cc7f638 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:32.641590 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e309-de3d-4658-b03e-ce9b5cc7f638 admin admin] PATH_INFO: `/v3/projects` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:32.642296 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45e309-de3d-4658-b03e-ce9b5cc7f638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:32.644253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac45e309-de3d-4658-b03e-ce9b5cc7f638 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:32.763020 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1437/2864] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:32 2022] POST /identity/v3/projects => generated 373 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:32.764140 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b97f1-8ab7-40fd-b678-f6de10ce486a None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:32.775387 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b97f1-8ab7-40fd-b678-f6de10ce486a None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:32.830752 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3bcf2-26ae-4c7c-b5ef-8d8089d7aa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:32.831420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3bcf2-26ae-4c7c-b5ef-8d8089d7aa45 admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:32.831822 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3bcf2-26ae-4c7c-b5ef-8d8089d7aa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:32.832107 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b3bcf2-26ae-4c7c-b5ef-8d8089d7aa45 admin admin] PATH_INFO: `/v3/users` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:32.832809 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3bcf2-26ae-4c7c-b5ef-8d8089d7aa45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:32.835219 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b3bcf2-26ae-4c7c-b5ef-8d8089d7aa45 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:32.922704 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1428/2865] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:32 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:32.926560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45e309-de3d-4658-b03e-ce9b5cc7f638 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:32.937515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45e309-de3d-4658-b03e-ce9b5cc7f638 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:32.942322 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d5a8b-aef6-4bc5-a514-3f929ade58df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:32.942971 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d5a8b-aef6-4bc5-a514-3f929ade58df admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:32.943264 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d5a8b-aef6-4bc5-a514-3f929ade58df admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:32.943564 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d5a8b-aef6-4bc5-a514-3f929ade58df admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:32.944299 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d5a8b-aef6-4bc5-a514-3f929ade58df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:32.945928 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d5a8b-aef6-4bc5-a514-3f929ade58df admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:32.956570 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1438/2866] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:32.962458 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3bcf2-26ae-4c7c-b5ef-8d8089d7aa45 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:32.972375 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b3bcf2-26ae-4c7c-b5ef-8d8089d7aa45 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:32.977639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6db95-9a33-4a25-8863-7f617fe4f758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:32.978547 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6db95-9a33-4a25-8863-7f617fe4f758 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:32.978840 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6db95-9a33-4a25-8863-7f617fe4f758 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:32.979125 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb6db95-9a33-4a25-8863-7f617fe4f758 admin admin] PATH_INFO: `/v3/projects/7d3be9a90d644b8b918d01e0bcdf31b5/users/acc26c84f13a497ba4e22387206c0ba1/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:32.995222 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6db95-9a33-4a25-8863-7f617fe4f758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d3be9a90d644b8b918d01e0bcdf31b5, user_id=acc26c84f13a497ba4e22387206c0ba1, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:32.997939 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb6db95-9a33-4a25-8863-7f617fe4f758 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:33.043477 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1429/2867] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:32 2022] PUT /identity/v3/projects/7d3be9a90d644b8b918d01e0bcdf31b5/users/acc26c84f13a497ba4e22387206c0ba1/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:33.047493 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d5a8b-aef6-4bc5-a514-3f929ade58df admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:33.058157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d5a8b-aef6-4bc5-a514-3f929ade58df admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:33.088325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:33.116280 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93eeacf-5848-4171-9b6d-202268ff26a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:33.116936 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eeacf-5848-4171-9b6d-202268ff26a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:33.117218 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eeacf-5848-4171-9b6d-202268ff26a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:33.117492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93eeacf-5848-4171-9b6d-202268ff26a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:33.118211 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93eeacf-5848-4171-9b6d-202268ff26a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:33.119822 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93eeacf-5848-4171-9b6d-202268ff26a3 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:33.129421 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1439/2868] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:33.133569 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6db95-9a33-4a25-8863-7f617fe4f758 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:33.143487 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb6db95-9a33-4a25-8863-7f617fe4f758 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:33.148087 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7522dd-2bb2-4e7d-bc11-f8e3d414935e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:33.148950 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7522dd-2bb2-4e7d-bc11-f8e3d414935e admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:33.149225 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7522dd-2bb2-4e7d-bc11-f8e3d414935e admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:33.149494 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7522dd-2bb2-4e7d-bc11-f8e3d414935e admin admin] PATH_INFO: `/v3/projects/7d3be9a90d644b8b918d01e0bcdf31b5/users/acc26c84f13a497ba4e22387206c0ba1/roles/b156409c977248e1b23c26e589b1e04f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:33.151482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7522dd-2bb2-4e7d-bc11-f8e3d414935e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d3be9a90d644b8b918d01e0bcdf31b5, user_id=acc26c84f13a497ba4e22387206c0ba1, role_id=b156409c977248e1b23c26e589b1e04f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:33.154116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7522dd-2bb2-4e7d-bc11-f8e3d414935e admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:33.164623 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1430/2869] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:33 2022] PUT /identity/v3/projects/7d3be9a90d644b8b918d01e0bcdf31b5/users/acc26c84f13a497ba4e22387206c0ba1/roles/b156409c977248e1b23c26e589b1e04f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:33.174305 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76972e8-7ca9-4968-8afe-21ec2e40b7fb None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:33.174641 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76972e8-7ca9-4968-8afe-21ec2e40b7fb None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:33.174918 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76972e8-7ca9-4968-8afe-21ec2e40b7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:33.201295 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-d76972e8-7ca9-4968-8afe-21ec2e40b7fb None None] MFA Rules not processed for user `acc26c84f13a497ba4e22387206c0ba1`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:33.202555 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d76972e8-7ca9-4968-8afe-21ec2e40b7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:33.269990 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1440/2870] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:58:33.280495 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7522dd-2bb2-4e7d-bc11-f8e3d414935e admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:33.282202 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-1c7522dd-2bb2-4e7d-bc11-f8e3d414935e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:33.301595 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:33.341100 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7522dd-2bb2-4e7d-bc11-f8e3d414935e admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:33.344742 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed1085-ac18-4ab0-bbb4-8407516659ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ccc6b9aeef498a93030b48306fe402', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:33.345312 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed1085-ac18-4ab0-bbb4-8407516659ca service cinder] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:33.345592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed1085-ac18-4ab0-bbb4-8407516659ca service cinder] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:33.345867 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed1085-ac18-4ab0-bbb4-8407516659ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:33.402372 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed1085-ac18-4ab0-bbb4-8407516659ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:33.403852 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed1085-ac18-4ab0-bbb4-8407516659ca service cinder] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:33.413753 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1431/2871] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:36.350880 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76972e8-7ca9-4968-8afe-21ec2e40b7fb None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:36.412157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76972e8-7ca9-4968-8afe-21ec2e40b7fb None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:36.416515 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b75c3-a40d-42d2-9803-5c488e192e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:36.417383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b75c3-a40d-42d2-9803-5c488e192e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:36.417668 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b75c3-a40d-42d2-9803-5c488e192e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:36.417944 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b75c3-a40d-42d2-9803-5c488e192e50 admin admin] PATH_INFO: `/v3/users/fe4a36392c7146d58519634f9ccf290a` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:36.419144 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b75c3-a40d-42d2-9803-5c488e192e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe4a36392c7146d58519634f9ccf290a)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:36.421089 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b75c3-a40d-42d2-9803-5c488e192e50 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:36.611071 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7c6b75c3-a40d-42d2-9803-5c488e192e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe4a36392c7146d58519634f9ccf290a'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:36.677104 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7c6b75c3-a40d-42d2-9803-5c488e192e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe4a36392c7146d58519634f9ccf290a'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:36.678258 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:36.690342 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7c6b75c3-a40d-42d2-9803-5c488e192e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe4a36392c7146d58519634f9ccf290a'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:36.690979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7c6b75c3-a40d-42d2-9803-5c488e192e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe4a36392c7146d58519634f9ccf290a'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:36.697617 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-7c6b75c3-a40d-42d2-9803-5c488e192e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe4a36392c7146d58519634f9ccf290a'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:36.703433 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1441/2872] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:36 2022] DELETE /identity/v3/users/fe4a36392c7146d58519634f9ccf290a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:36.707986 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da43989-2d76-404c-a3ff-d01cdcf9ce96 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:36.708447 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da43989-2d76-404c-a3ff-d01cdcf9ce96 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:36.708563 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da43989-2d76-404c-a3ff-d01cdcf9ce96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:36.725074 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-5da43989-2d76-404c-a3ff-d01cdcf9ce96 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:36.726773 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-5da43989-2d76-404c-a3ff-d01cdcf9ce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:36.785351 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1432/2873] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:36.795346 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b75c3-a40d-42d2-9803-5c488e192e50 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:36.796787 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-7c6b75c3-a40d-42d2-9803-5c488e192e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:36.853424 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b75c3-a40d-42d2-9803-5c488e192e50 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:36.857370 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51205326-56c9-4f04-8f73-72b7b53c489c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:36.858010 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51205326-56c9-4f04-8f73-72b7b53c489c service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:36.858300 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51205326-56c9-4f04-8f73-72b7b53c489c service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:36.858578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51205326-56c9-4f04-8f73-72b7b53c489c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:36.868114 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51205326-56c9-4f04-8f73-72b7b53c489c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:36.869576 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51205326-56c9-4f04-8f73-72b7b53c489c service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:36.878942 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1442/2874] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:37.325825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da43989-2d76-404c-a3ff-d01cdcf9ce96 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:37.327482 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-5da43989-2d76-404c-a3ff-d01cdcf9ce96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:37.347832 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da43989-2d76-404c-a3ff-d01cdcf9ce96 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:37.354585 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f9329-46a1-44f8-a87b-da810e228d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:37.356562 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f9329-46a1-44f8-a87b-da810e228d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:37.356890 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f9329-46a1-44f8-a87b-da810e228d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:37.357453 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f9329-46a1-44f8-a87b-da810e228d1f admin admin] PATH_INFO: `/v3/projects/301c619f97334590bad06bcca28f7ab2` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:37.358717 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f9329-46a1-44f8-a87b-da810e228d1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=301c619f97334590bad06bcca28f7ab2)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:37.360835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9f9329-46a1-44f8-a87b-da810e228d1f admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:37.468519 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6f9f9329-46a1-44f8-a87b-da810e228d1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301c619f97334590bad06bcca28f7ab2', 'request_id': 'req-6f9f9329-46a1-44f8-a87b-da810e228d1f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:37.474943 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6f9f9329-46a1-44f8-a87b-da810e228d1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301c619f97334590bad06bcca28f7ab2', 'request_id': 'req-6f9f9329-46a1-44f8-a87b-da810e228d1f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:37.528770 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6f9f9329-46a1-44f8-a87b-da810e228d1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301c619f97334590bad06bcca28f7ab2', 'request_id': 'req-6f9f9329-46a1-44f8-a87b-da810e228d1f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:37.533921 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:37.541581 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6f9f9329-46a1-44f8-a87b-da810e228d1f admin admin] The token cache is being invalidate because project 301c619f97334590bad06bcca28f7ab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:37.546968 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6f9f9329-46a1-44f8-a87b-da810e228d1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:37.546968 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-6f9f9329-46a1-44f8-a87b-da810e228d1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:37.546968 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1433/2875] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:37 2022] DELETE /identity/v3/projects/301c619f97334590bad06bcca28f7ab2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:37.548103 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51205326-56c9-4f04-8f73-72b7b53c489c service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:37.558651 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51205326-56c9-4f04-8f73-72b7b53c489c service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:37.620846 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df10b675-be32-4692-9dd8-70f9263a3992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:37.621735 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10b675-be32-4692-9dd8-70f9263a3992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:37.622021 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10b675-be32-4692-9dd8-70f9263a3992 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:37.622378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df10b675-be32-4692-9dd8-70f9263a3992 admin admin] PATH_INFO: `/v3/users/acc26c84f13a497ba4e22387206c0ba1` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:37.623657 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10b675-be32-4692-9dd8-70f9263a3992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acc26c84f13a497ba4e22387206c0ba1)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:37.625574 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df10b675-be32-4692-9dd8-70f9263a3992 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:37.834115 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-df10b675-be32-4692-9dd8-70f9263a3992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acc26c84f13a497ba4e22387206c0ba1'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:37.900448 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-df10b675-be32-4692-9dd8-70f9263a3992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acc26c84f13a497ba4e22387206c0ba1'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:37.914363 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-df10b675-be32-4692-9dd8-70f9263a3992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acc26c84f13a497ba4e22387206c0ba1'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:37.915032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-df10b675-be32-4692-9dd8-70f9263a3992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acc26c84f13a497ba4e22387206c0ba1'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:37.919633 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:37.922622 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-df10b675-be32-4692-9dd8-70f9263a3992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acc26c84f13a497ba4e22387206c0ba1'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:37.928531 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1443/2876] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:37 2022] DELETE /identity/v3/users/acc26c84f13a497ba4e22387206c0ba1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:38.353450 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f9329-46a1-44f8-a87b-da810e228d1f admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:38.354898 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-6f9f9329-46a1-44f8-a87b-da810e228d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:38.371580 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f9329-46a1-44f8-a87b-da810e228d1f admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:38.440573 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b482a4-d242-4107-959f-6dbddd8b0f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:38.441511 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b482a4-d242-4107-959f-6dbddd8b0f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:38.441973 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b482a4-d242-4107-959f-6dbddd8b0f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:38.442337 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b482a4-d242-4107-959f-6dbddd8b0f32 admin admin] PATH_INFO: `/v3/projects/7d3be9a90d644b8b918d01e0bcdf31b5` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:38.443901 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b482a4-d242-4107-959f-6dbddd8b0f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d3be9a90d644b8b918d01e0bcdf31b5)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:38.447187 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b482a4-d242-4107-959f-6dbddd8b0f32 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:38.640174 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-a8b482a4-d242-4107-959f-6dbddd8b0f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d3be9a90d644b8b918d01e0bcdf31b5', 'request_id': 'req-a8b482a4-d242-4107-959f-6dbddd8b0f32'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:38.653137 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-a8b482a4-d242-4107-959f-6dbddd8b0f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d3be9a90d644b8b918d01e0bcdf31b5', 'request_id': 'req-a8b482a4-d242-4107-959f-6dbddd8b0f32'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:38.751965 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-a8b482a4-d242-4107-959f-6dbddd8b0f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d3be9a90d644b8b918d01e0bcdf31b5', 'request_id': 'req-a8b482a4-d242-4107-959f-6dbddd8b0f32'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:38.764302 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-a8b482a4-d242-4107-959f-6dbddd8b0f32 admin admin] The token cache is being invalidate because project 7d3be9a90d644b8b918d01e0bcdf31b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:38.764592 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-a8b482a4-d242-4107-959f-6dbddd8b0f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:38.765279 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-a8b482a4-d242-4107-959f-6dbddd8b0f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:38.766824 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1434/2877] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:38 2022] DELETE /identity/v3/projects/7d3be9a90d644b8b918d01e0bcdf31b5 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:38.772687 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760d878-09d7-4b56-aec9-4d5c53186679 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:38.773185 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760d878-09d7-4b56-aec9-4d5c53186679 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:38.773291 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e760d878-09d7-4b56-aec9-4d5c53186679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:38.791174 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-e760d878-09d7-4b56-aec9-4d5c53186679 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:38.792413 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-e760d878-09d7-4b56-aec9-4d5c53186679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:38.850352 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1444/2878] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:38.858388 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f8825-64cb-4bfa-a7ab-d38ff5718fd8 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:38.858682 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f8825-64cb-4bfa-a7ab-d38ff5718fd8 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:38.859155 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f8825-64cb-4bfa-a7ab-d38ff5718fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:38.879267 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-684f8825-64cb-4bfa-a7ab-d38ff5718fd8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:38.880531 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-684f8825-64cb-4bfa-a7ab-d38ff5718fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:38.889173 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1435/2879] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:38.893461 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760d878-09d7-4b56-aec9-4d5c53186679 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:38.903127 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e760d878-09d7-4b56-aec9-4d5c53186679 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:38.907796 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e8001-07ce-470d-8a71-32c7e351fdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:38.908474 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e8001-07ce-470d-8a71-32c7e351fdca admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:38.908762 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e8001-07ce-470d-8a71-32c7e351fdca admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:38.909043 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e8001-07ce-470d-8a71-32c7e351fdca admin admin] PATH_INFO: `/v3/domains` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:38.909772 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e8001-07ce-470d-8a71-32c7e351fdca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86870) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 27 18:58:38.910084 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e8001-07ce-470d-8a71-32c7e351fdca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:38.911774 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e8001-07ce-470d-8a71-32c7e351fdca admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:38.927698 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1445/2880] 10.222.0.36 () {58 vars in 1152 bytes} [Mon Jun 27 18:58:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 27 18:58:38.929348 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f8825-64cb-4bfa-a7ab-d38ff5718fd8 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:38.938727 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f8825-64cb-4bfa-a7ab-d38ff5718fd8 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:38.943608 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334025d6-8b40-448f-98be-cc233807161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:38.948080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334025d6-8b40-448f-98be-cc233807161d admin admin] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:38.948080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334025d6-8b40-448f-98be-cc233807161d admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:38.948080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334025d6-8b40-448f-98be-cc233807161d admin admin] PATH_INFO: `/v3/projects` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:38.948080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334025d6-8b40-448f-98be-cc233807161d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:38.948080 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334025d6-8b40-448f-98be-cc233807161d admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:39.033207 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1436/2881] 10.222.0.36 () {60 vars in 1152 bytes} [Mon Jun 27 18:58:38 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 27 18:58:39.037350 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e8001-07ce-470d-8a71-32c7e351fdca admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:39.047676 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e8001-07ce-470d-8a71-32c7e351fdca admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:39.106738 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf22fc-89a0-45b8-800d-df4f801758f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:39.107400 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf22fc-89a0-45b8-800d-df4f801758f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:39.107719 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf22fc-89a0-45b8-800d-df4f801758f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:39.107997 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf22fc-89a0-45b8-800d-df4f801758f8 admin admin] PATH_INFO: `/v3/users` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:39.108683 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf22fc-89a0-45b8-800d-df4f801758f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:39.110790 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf22fc-89a0-45b8-800d-df4f801758f8 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:39.244494 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1446/2882] 10.222.0.36 () {60 vars in 1143 bytes} [Mon Jun 27 18:58:39 2022] POST /identity/v3/users => generated 285 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 27 18:58:39.248334 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334025d6-8b40-448f-98be-cc233807161d admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:39.258483 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334025d6-8b40-448f-98be-cc233807161d admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:39.263165 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d4136-81dd-458e-8d8c-9f18209c2117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:39.263892 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d4136-81dd-458e-8d8c-9f18209c2117 admin admin] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:39.264195 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d4136-81dd-458e-8d8c-9f18209c2117 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:39.264456 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074d4136-81dd-458e-8d8c-9f18209c2117 admin admin] PATH_INFO: `/v3/roles` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:39.265182 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d4136-81dd-458e-8d8c-9f18209c2117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:39.266827 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074d4136-81dd-458e-8d8c-9f18209c2117 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:39.278012 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1437/2883] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:39.282016 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf22fc-89a0-45b8-800d-df4f801758f8 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:39.292691 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf22fc-89a0-45b8-800d-df4f801758f8 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:39.297429 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41168a1-1e7d-420e-958b-c08ec77ef3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:39.298088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41168a1-1e7d-420e-958b-c08ec77ef3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:39.298375 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41168a1-1e7d-420e-958b-c08ec77ef3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:39.298654 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41168a1-1e7d-420e-958b-c08ec77ef3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:39.299431 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41168a1-1e7d-420e-958b-c08ec77ef3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:39.301078 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41168a1-1e7d-420e-958b-c08ec77ef3c8 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:39.311935 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1447/2884] 10.222.0.36 () {58 vars in 1121 bytes} [Mon Jun 27 18:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 27 18:58:39.315971 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d4136-81dd-458e-8d8c-9f18209c2117 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:39.325675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074d4136-81dd-458e-8d8c-9f18209c2117 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:39.330232 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db71c3-016c-4387-9801-7d041d9f8260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:39.331099 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db71c3-016c-4387-9801-7d041d9f8260 admin admin] REQUEST_METHOD: `PUT` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:39.331376 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db71c3-016c-4387-9801-7d041d9f8260 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:39.331691 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db71c3-016c-4387-9801-7d041d9f8260 admin admin] PATH_INFO: `/v3/projects/c4c0609e00f5465b82f7c16375802bcd/users/3a91061614fc4db29f65c8a72be3adda/roles/5c4481f023774d67997d4ba28e07cff0` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:39.346850 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db71c3-016c-4387-9801-7d041d9f8260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c0609e00f5465b82f7c16375802bcd, user_id=3a91061614fc4db29f65c8a72be3adda, role_id=5c4481f023774d67997d4ba28e07cff0)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:39.349721 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db71c3-016c-4387-9801-7d041d9f8260 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:39.437394 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1438/2885] 10.222.0.36 () {60 vars in 1482 bytes} [Mon Jun 27 18:58:39 2022] PUT /identity/v3/projects/c4c0609e00f5465b82f7c16375802bcd/users/3a91061614fc4db29f65c8a72be3adda/roles/5c4481f023774d67997d4ba28e07cff0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:58:39.448797 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a628b-134e-4ff4-89d6-df82fe56eebc None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:39.449095 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a628b-134e-4ff4-89d6-df82fe56eebc None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:39.449378 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a628b-134e-4ff4-89d6-df82fe56eebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:39.477473 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-352a628b-134e-4ff4-89d6-df82fe56eebc None None] MFA Rules not processed for user `3a91061614fc4db29f65c8a72be3adda`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:39.478690 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-352a628b-134e-4ff4-89d6-df82fe56eebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:39.526578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:39.544276 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1448/2886] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:58:39.555743 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db71c3-016c-4387-9801-7d041d9f8260 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:39.557663 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-93db71c3-016c-4387-9801-7d041d9f8260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:39.581800 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:39.617362 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db71c3-016c-4387-9801-7d041d9f8260 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:39.621047 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803586e-a7fe-4b77-a47e-36844516ce1c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e59193e90e240f6b9876d0455eea355', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:39.621681 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803586e-a7fe-4b77-a47e-36844516ce1c service glance] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:39.621990 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803586e-a7fe-4b77-a47e-36844516ce1c service glance] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:39.622269 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803586e-a7fe-4b77-a47e-36844516ce1c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:39.630420 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803586e-a7fe-4b77-a47e-36844516ce1c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:39.632439 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803586e-a7fe-4b77-a47e-36844516ce1c service glance] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:39.641009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1439/2887] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:45.317585 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a628b-134e-4ff4-89d6-df82fe56eebc None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:45.318987 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-352a628b-134e-4ff4-89d6-df82fe56eebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:45.383677 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a628b-134e-4ff4-89d6-df82fe56eebc None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:45.389066 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bb55d-3195-4ea8-afd8-50d207b76ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:45.389975 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bb55d-3195-4ea8-afd8-50d207b76ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:45.390286 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bb55d-3195-4ea8-afd8-50d207b76ada admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:45.390560 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7bb55d-3195-4ea8-afd8-50d207b76ada admin admin] PATH_INFO: `/v3/users/b06b74b9349d46afb92fd91cc05a2a5d` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:45.391814 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bb55d-3195-4ea8-afd8-50d207b76ada admin admin] RBAC: Authorizing `identity:delete_user(user_id=b06b74b9349d46afb92fd91cc05a2a5d)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:45.393834 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7bb55d-3195-4ea8-afd8-50d207b76ada admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:45.540854 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ad7bb55d-3195-4ea8-afd8-50d207b76ada admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b06b74b9349d46afb92fd91cc05a2a5d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:45.609321 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ad7bb55d-3195-4ea8-afd8-50d207b76ada admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b06b74b9349d46afb92fd91cc05a2a5d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:45.622875 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ad7bb55d-3195-4ea8-afd8-50d207b76ada admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b06b74b9349d46afb92fd91cc05a2a5d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:45.623777 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ad7bb55d-3195-4ea8-afd8-50d207b76ada admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b06b74b9349d46afb92fd91cc05a2a5d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:45.630630 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-ad7bb55d-3195-4ea8-afd8-50d207b76ada admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b06b74b9349d46afb92fd91cc05a2a5d'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:45.636616 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1449/2888] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:58:45 2022] DELETE /identity/v3/users/b06b74b9349d46afb92fd91cc05a2a5d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:45.641185 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dd777-8ca6-4b1f-829d-fedcaf875f24 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:45.641668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dd777-8ca6-4b1f-829d-fedcaf875f24 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:45.641780 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392dd777-8ca6-4b1f-829d-fedcaf875f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:45.659323 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-392dd777-8ca6-4b1f-829d-fedcaf875f24 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:58:45.660575 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-392dd777-8ca6-4b1f-829d-fedcaf875f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:45.720356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1440/2889] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:58:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:58:45.730593 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bb55d-3195-4ea8-afd8-50d207b76ada admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:45.732033 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-ad7bb55d-3195-4ea8-afd8-50d207b76ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:45.787448 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7bb55d-3195-4ea8-afd8-50d207b76ada admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:45.791686 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae84318-f67d-41d1-a159-da9187593cb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:45.792323 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae84318-f67d-41d1-a159-da9187593cb1 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:45.792613 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae84318-f67d-41d1-a159-da9187593cb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:45.792892 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae84318-f67d-41d1-a159-da9187593cb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:45.803259 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae84318-f67d-41d1-a159-da9187593cb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:45.804989 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae84318-f67d-41d1-a159-da9187593cb1 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:45.817328 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1450/2890] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:58:46.194299 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dd777-8ca6-4b1f-829d-fedcaf875f24 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:46.199173 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-392dd777-8ca6-4b1f-829d-fedcaf875f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:46.209673 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392dd777-8ca6-4b1f-829d-fedcaf875f24 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:46.215662 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:46.217192 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:46.217655 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:46.217938 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a admin admin] PATH_INFO: `/v3/projects/4837a07791db4061bf9efb68591ab7d3` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:46.219315 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4837a07791db4061bf9efb68591ab7d3)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:46.221280 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:46.318867 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4837a07791db4061bf9efb68591ab7d3', 'request_id': 'req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:46.326503 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4837a07791db4061bf9efb68591ab7d3', 'request_id': 'req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:46.408832 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4837a07791db4061bf9efb68591ab7d3', 'request_id': 'req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:46.419410 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a admin admin] The token cache is being invalidate because project 4837a07791db4061bf9efb68591ab7d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86869) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:58:46.419904 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:46.420517 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:58:46.422062 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1441/2891] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:58:46 2022] DELETE /identity/v3/projects/4837a07791db4061bf9efb68591ab7d3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:58:51.580512 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae84318-f67d-41d1-a159-da9187593cb1 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:58:51.581901 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-2ae84318-f67d-41d1-a159-da9187593cb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:51.595767 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:58:51.649479 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae84318-f67d-41d1-a159-da9187593cb1 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:58:51.707759 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d407ecb4-f0f8-49f1-aae2-9059f7a81bd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af6ef16884604753972c916f74271f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:58:51.708411 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407ecb4-f0f8-49f1-aae2-9059f7a81bd6 service placement] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:58:51.708701 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407ecb4-f0f8-49f1-aae2-9059f7a81bd6 service placement] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:58:51.708983 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d407ecb4-f0f8-49f1-aae2-9059f7a81bd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:58:51.710859 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d407ecb4-f0f8-49f1-aae2-9059f7a81bd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:58:51.722634 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407ecb4-f0f8-49f1-aae2-9059f7a81bd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:58:51.724253 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d407ecb4-f0f8-49f1-aae2-9059f7a81bd6 service placement] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:58:51.734495 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1451/2892] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:58:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:58:56.416310 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:59:01.730018 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=53 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:59:04.963620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:59:04.965096 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:59:05.027872 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba26e8-fadc-4b8c-898a-c2c7b8fafb9a admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:59:05.032403 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ddcbe-a19a-4dff-82f0-1a838bd128c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:59:05.033262 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ddcbe-a19a-4dff-82f0-1a838bd128c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:59:05.033543 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ddcbe-a19a-4dff-82f0-1a838bd128c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:59:05.033820 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ddcbe-a19a-4dff-82f0-1a838bd128c5 admin admin] PATH_INFO: `/v3/users/3a91061614fc4db29f65c8a72be3adda` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:59:05.035009 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ddcbe-a19a-4dff-82f0-1a838bd128c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a91061614fc4db29f65c8a72be3adda)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:59:05.036937 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ddcbe-a19a-4dff-82f0-1a838bd128c5 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:59:05.302323 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e60ddcbe-a19a-4dff-82f0-1a838bd128c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a91061614fc4db29f65c8a72be3adda'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:05.379701 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e60ddcbe-a19a-4dff-82f0-1a838bd128c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a91061614fc4db29f65c8a72be3adda'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:05.392051 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e60ddcbe-a19a-4dff-82f0-1a838bd128c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a91061614fc4db29f65c8a72be3adda'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:05.398844 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e60ddcbe-a19a-4dff-82f0-1a838bd128c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a91061614fc4db29f65c8a72be3adda'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:05.399514 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e60ddcbe-a19a-4dff-82f0-1a838bd128c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a91061614fc4db29f65c8a72be3adda'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:05.405835 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1442/2893] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:59:04 2022] DELETE /identity/v3/users/3a91061614fc4db29f65c8a72be3adda => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:59:05.410569 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4f391-9af7-42fd-ae1b-9e0d5b2e85a8 None None] REQUEST_METHOD: `POST` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:59:05.411050 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4f391-9af7-42fd-ae1b-9e0d5b2e85a8 None None] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:59:05.416242 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4f391-9af7-42fd-ae1b-9e0d5b2e85a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:59:05.428578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.auth.core [None req-b2d4f391-9af7-42fd-ae1b-9e0d5b2e85a8 None None] MFA Rules not processed for user `c8d6148460c64b19ad3d5930db893c77`. Rule list: `[]` (Enabled: `True`). {{(pid=86870) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:59:05.429777 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b2d4f391-9af7-42fd-ae1b-9e0d5b2e85a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:59:05.488177 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1452/2894] 10.222.0.36 () {58 vars in 957 bytes} [Mon Jun 27 18:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 27 18:59:05.503334 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ddcbe-a19a-4dff-82f0-1a838bd128c5 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:59:05.504796 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e60ddcbe-a19a-4dff-82f0-1a838bd128c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:59:05.566639 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ddcbe-a19a-4dff-82f0-1a838bd128c5 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:59:05.570191 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b602c7e-5e81-4e96-a490-4a7327ecb6ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:59:05.570825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b602c7e-5e81-4e96-a490-4a7327ecb6ba service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:59:05.571106 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b602c7e-5e81-4e96-a490-4a7327ecb6ba service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:59:05.571381 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b602c7e-5e81-4e96-a490-4a7327ecb6ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:59:05.580208 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b602c7e-5e81-4e96-a490-4a7327ecb6ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:59:05.581636 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b602c7e-5e81-4e96-a490-4a7327ecb6ba service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:59:05.591296 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1443/2895] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 27 18:59:05.975360 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4f391-9af7-42fd-ae1b-9e0d5b2e85a8 None None] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:59:05.976867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b2d4f391-9af7-42fd-ae1b-9e0d5b2e85a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:59:05.989410 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4f391-9af7-42fd-ae1b-9e0d5b2e85a8 None None] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:59:05.995157 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ba473-d551-49ae-b080-add952657c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:59:05.996027 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ba473-d551-49ae-b080-add952657c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:59:05.996342 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ba473-d551-49ae-b080-add952657c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:59:05.996590 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3ba473-d551-49ae-b080-add952657c2e admin admin] PATH_INFO: `/v3/projects/c4c0609e00f5465b82f7c16375802bcd` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:59:06.005120 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ba473-d551-49ae-b080-add952657c2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c0609e00f5465b82f7c16375802bcd)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:59:06.007160 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3ba473-d551-49ae-b080-add952657c2e admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:59:06.130221 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-9b3ba473-d551-49ae-b080-add952657c2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c0609e00f5465b82f7c16375802bcd', 'request_id': 'req-9b3ba473-d551-49ae-b080-add952657c2e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:06.180057 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-9b3ba473-d551-49ae-b080-add952657c2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c0609e00f5465b82f7c16375802bcd', 'request_id': 'req-9b3ba473-d551-49ae-b080-add952657c2e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:06.186427 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-9b3ba473-d551-49ae-b080-add952657c2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c0609e00f5465b82f7c16375802bcd', 'request_id': 'req-9b3ba473-d551-49ae-b080-add952657c2e'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:06.197266 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-9b3ba473-d551-49ae-b080-add952657c2e admin admin] The token cache is being invalidate because project c4c0609e00f5465b82f7c16375802bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:59:06.197551 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-9b3ba473-d551-49ae-b080-add952657c2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:06.198169 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-9b3ba473-d551-49ae-b080-add952657c2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:06.199907 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1453/2896] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:59:05 2022] DELETE /identity/v3/projects/c4c0609e00f5465b82f7c16375802bcd => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:59:15.586675 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:59:16.194262 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:59:25.190739 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b602c7e-5e81-4e96-a490-4a7327ecb6ba service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:59:25.192914 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-0b602c7e-5e81-4e96-a490-4a7327ecb6ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:59:25.204328 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b602c7e-5e81-4e96-a490-4a7327ecb6ba service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:59:25.261720 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f0f1c-434a-427b-8d95-5d915a01d55a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:59:25.262365 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f0f1c-434a-427b-8d95-5d915a01d55a service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:59:25.262673 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f0f1c-434a-427b-8d95-5d915a01d55a service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:59:25.262948 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f0f1c-434a-427b-8d95-5d915a01d55a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:59:25.264771 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-0a9f0f1c-434a-427b-8d95-5d915a01d55a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:59:25.273854 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f0f1c-434a-427b-8d95-5d915a01d55a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:59:25.275744 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f0f1c-434a-427b-8d95-5d915a01d55a service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:59:25.283514 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1444/2897] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:59:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:59:25.353871 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ba473-d551-49ae-b080-add952657c2e admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:59:25.355471 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-9b3ba473-d551-49ae-b080-add952657c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:59:25.369623 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3ba473-d551-49ae-b080-add952657c2e admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:59:25.373959 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab91365-56b8-4ef7-8bc9-f2edb02e0955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:59:25.374635 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab91365-56b8-4ef7-8bc9-f2edb02e0955 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:59:25.374923 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab91365-56b8-4ef7-8bc9-f2edb02e0955 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:59:25.375204 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab91365-56b8-4ef7-8bc9-f2edb02e0955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:59:25.377031 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-7ab91365-56b8-4ef7-8bc9-f2edb02e0955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:59:25.447046 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab91365-56b8-4ef7-8bc9-f2edb02e0955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:59:25.448511 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab91365-56b8-4ef7-8bc9-f2edb02e0955 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:59:25.459738 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1454/2898] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 18:59:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 18:59:25.829226 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36341fd-f712-4705-af86-2935b85e0079 None None] REQUEST_METHOD: `POST` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:59:25.829545 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36341fd-f712-4705-af86-2935b85e0079 None None] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:59:25.829825 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36341fd-f712-4705-af86-2935b85e0079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:59:25.847557 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.auth.core [None req-d36341fd-f712-4705-af86-2935b85e0079 None None] MFA Rules not processed for user `6e6313c444eb4a788b6559eff17959f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86869) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 27 18:59:25.848750 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-d36341fd-f712-4705-af86-2935b85e0079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:59:25.902309 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1445/2899] 10.222.0.36 () {58 vars in 967 bytes} [Mon Jun 27 18:59:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 27 18:59:25.941971 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab91365-56b8-4ef7-8bc9-f2edb02e0955 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:59:25.943366 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-7ab91365-56b8-4ef7-8bc9-f2edb02e0955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:59:26.010376 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab91365-56b8-4ef7-8bc9-f2edb02e0955 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:59:26.015903 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e948a75-330f-439c-9c54-fe1a2f1396d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94555ff897d94c90968c470d82ff9e2a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:59:26.016541 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e948a75-330f-439c-9c54-fe1a2f1396d1 service swift] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:59:26.016829 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e948a75-330f-439c-9c54-fe1a2f1396d1 service swift] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:59:26.017109 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e948a75-330f-439c-9c54-fe1a2f1396d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:59:26.024995 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e948a75-330f-439c-9c54-fe1a2f1396d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:59:26.026586 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e948a75-330f-439c-9c54-fe1a2f1396d1 service swift] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:59:26.035113 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1455/2900] 10.222.0.36 () {60 vars in 1384 bytes} [Mon Jun 27 18:59:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 27 18:59:34.302178 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36341fd-f712-4705-af86-2935b85e0079 None None] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:59:34.303668 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-d36341fd-f712-4705-af86-2935b85e0079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:59:34.376101 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36341fd-f712-4705-af86-2935b85e0079 None None] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:59:34.380711 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694861ce-fe5e-42ee-b04b-e11569b2a671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:59:34.383518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694861ce-fe5e-42ee-b04b-e11569b2a671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:59:34.383518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694861ce-fe5e-42ee-b04b-e11569b2a671 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:59:34.383518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694861ce-fe5e-42ee-b04b-e11569b2a671 admin admin] PATH_INFO: `/v3/users/77773d40a7a940819a99d11055439333` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:59:34.383518 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694861ce-fe5e-42ee-b04b-e11569b2a671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77773d40a7a940819a99d11055439333)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:59:34.385509 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694861ce-fe5e-42ee-b04b-e11569b2a671 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:59:34.536478 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-694861ce-fe5e-42ee-b04b-e11569b2a671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77773d40a7a940819a99d11055439333'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:34.539237 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:59:34.597037 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-694861ce-fe5e-42ee-b04b-e11569b2a671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77773d40a7a940819a99d11055439333'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:34.610220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-694861ce-fe5e-42ee-b04b-e11569b2a671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77773d40a7a940819a99d11055439333'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:34.617196 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-694861ce-fe5e-42ee-b04b-e11569b2a671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77773d40a7a940819a99d11055439333'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:34.617883 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-694861ce-fe5e-42ee-b04b-e11569b2a671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77773d40a7a940819a99d11055439333'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:34.623872 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1446/2901] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:59:34 2022] DELETE /identity/v3/users/77773d40a7a940819a99d11055439333 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 27 18:59:34.861754 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e948a75-330f-439c-9c54-fe1a2f1396d1 service swift] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:59:34.873183 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e948a75-330f-439c-9c54-fe1a2f1396d1 service swift] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:59:34.930173 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90088e5-b5e4-4fb7-b538-840935639636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:59:34.930964 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90088e5-b5e4-4fb7-b538-840935639636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:59:34.931257 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90088e5-b5e4-4fb7-b538-840935639636 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:59:34.931567 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90088e5-b5e4-4fb7-b538-840935639636 admin admin] PATH_INFO: `/v3/projects/e28f236933c34203a389956b259bee23` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:59:34.932758 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90088e5-b5e4-4fb7-b538-840935639636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28f236933c34203a389956b259bee23)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:59:34.934722 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90088e5-b5e4-4fb7-b538-840935639636 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:59:34.953067 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=100 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:59:35.065584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-d90088e5-b5e4-4fb7-b538-840935639636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28f236933c34203a389956b259bee23', 'request_id': 'req-d90088e5-b5e4-4fb7-b538-840935639636'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:35.123088 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-d90088e5-b5e4-4fb7-b538-840935639636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28f236933c34203a389956b259bee23', 'request_id': 'req-d90088e5-b5e4-4fb7-b538-840935639636'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:35.129220 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-d90088e5-b5e4-4fb7-b538-840935639636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28f236933c34203a389956b259bee23', 'request_id': 'req-d90088e5-b5e4-4fb7-b538-840935639636'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:35.141207 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-d90088e5-b5e4-4fb7-b538-840935639636 admin admin] The token cache is being invalidate because project e28f236933c34203a389956b259bee23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:59:35.141494 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-d90088e5-b5e4-4fb7-b538-840935639636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:35.142137 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-d90088e5-b5e4-4fb7-b538-840935639636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:35.143682 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1456/2902] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:59:34 2022] DELETE /identity/v3/projects/e28f236933c34203a389956b259bee23 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:59:35.147549 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694861ce-fe5e-42ee-b04b-e11569b2a671 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:59:35.148955 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-694861ce-fe5e-42ee-b04b-e11569b2a671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:59:35.162726 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694861ce-fe5e-42ee-b04b-e11569b2a671 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:59:35.217193 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dcb46-8139-4e02-8276-15821018a37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:59:35.217995 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dcb46-8139-4e02-8276-15821018a37c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:59:35.218274 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dcb46-8139-4e02-8276-15821018a37c admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:59:35.218550 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868dcb46-8139-4e02-8276-15821018a37c admin admin] PATH_INFO: `/v3/users/edd7e26bebdc4e06a35fd3b65d51ed5f` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:59:35.219808 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dcb46-8139-4e02-8276-15821018a37c admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd7e26bebdc4e06a35fd3b65d51ed5f)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:59:35.221716 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868dcb46-8139-4e02-8276-15821018a37c admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:59:35.358885 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-868dcb46-8139-4e02-8276-15821018a37c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd7e26bebdc4e06a35fd3b65d51ed5f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:35.413373 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-868dcb46-8139-4e02-8276-15821018a37c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd7e26bebdc4e06a35fd3b65d51ed5f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:35.425473 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-868dcb46-8139-4e02-8276-15821018a37c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd7e26bebdc4e06a35fd3b65d51ed5f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:35.432412 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-868dcb46-8139-4e02-8276-15821018a37c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd7e26bebdc4e06a35fd3b65d51ed5f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:35.433050 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-868dcb46-8139-4e02-8276-15821018a37c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd7e26bebdc4e06a35fd3b65d51ed5f'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:35.439417 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1447/2903] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 18:59:35 2022] DELETE /identity/v3/users/edd7e26bebdc4e06a35fd3b65d51ed5f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:59:35.694870 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90088e5-b5e4-4fb7-b538-840935639636 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 18:59:35.696400 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-d90088e5-b5e4-4fb7-b538-840935639636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 18:59:35.710420 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90088e5-b5e4-4fb7-b538-840935639636 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 18:59:35.768793 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae3184-fd9c-4226-83c5-06fb57a8d899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 18:59:35.769578 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae3184-fd9c-4226-83c5-06fb57a8d899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 18:59:35.769860 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae3184-fd9c-4226-83c5-06fb57a8d899 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 18:59:35.770133 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae3184-fd9c-4226-83c5-06fb57a8d899 admin admin] PATH_INFO: `/v3/projects/b262838a98254041806923c66e11e1a8` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 18:59:35.771302 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae3184-fd9c-4226-83c5-06fb57a8d899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b262838a98254041806923c66e11e1a8)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 18:59:35.773235 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae3184-fd9c-4226-83c5-06fb57a8d899 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 18:59:35.873908 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-71ae3184-fd9c-4226-83c5-06fb57a8d899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b262838a98254041806923c66e11e1a8', 'request_id': 'req-71ae3184-fd9c-4226-83c5-06fb57a8d899'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:35.951127 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-71ae3184-fd9c-4226-83c5-06fb57a8d899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b262838a98254041806923c66e11e1a8', 'request_id': 'req-71ae3184-fd9c-4226-83c5-06fb57a8d899'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:35.957492 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-71ae3184-fd9c-4226-83c5-06fb57a8d899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b262838a98254041806923c66e11e1a8', 'request_id': 'req-71ae3184-fd9c-4226-83c5-06fb57a8d899'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:35.969461 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-71ae3184-fd9c-4226-83c5-06fb57a8d899 admin admin] The token cache is being invalidate because project b262838a98254041806923c66e11e1a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 18:59:35.969753 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-71ae3184-fd9c-4226-83c5-06fb57a8d899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:35.970443 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-71ae3184-fd9c-4226-83c5-06fb57a8d899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 18:59:35.972032 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1457/2904] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 18:59:35 2022] DELETE /identity/v3/projects/b262838a98254041806923c66e11e1a8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 18:59:45.435879 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:DELETE=13,keystone:SELECT=65,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 18:59:45.965804 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 19:00:53.110175 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dcb46-8139-4e02-8276-15821018a37c admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 19:00:53.112081 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-868dcb46-8139-4e02-8276-15821018a37c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 19:00:53.171327 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868dcb46-8139-4e02-8276-15821018a37c admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 19:00:53.220617 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea781731-4327-451c-a9e5-ff624491bafd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 19:00:53.221264 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea781731-4327-451c-a9e5-ff624491bafd service neutron] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 19:00:53.221544 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea781731-4327-451c-a9e5-ff624491bafd service neutron] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 19:00:53.221819 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea781731-4327-451c-a9e5-ff624491bafd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 19:00:53.223708 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ea781731-4327-451c-a9e5-ff624491bafd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 19:00:53.297356 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea781731-4327-451c-a9e5-ff624491bafd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 19:00:53.298964 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea781731-4327-451c-a9e5-ff624491bafd service neutron] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 19:00:53.311415 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1448/2905] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 19:00:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 19:00:54.488082 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae3184-fd9c-4226-83c5-06fb57a8d899 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 19:00:54.489402 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-71ae3184-fd9c-4226-83c5-06fb57a8d899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 19:00:54.502375 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae3184-fd9c-4226-83c5-06fb57a8d899 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 19:00:54.507383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293ef1e-7542-43bd-a2d8-c487a93b0f21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1e684ee875464138abc4e89060902100', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 19:00:54.507383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293ef1e-7542-43bd-a2d8-c487a93b0f21 service neutron] REQUEST_METHOD: `GET` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 19:00:54.507383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293ef1e-7542-43bd-a2d8-c487a93b0f21 service neutron] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 19:00:54.507383 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293ef1e-7542-43bd-a2d8-c487a93b0f21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 19:00:54.509294 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-2293ef1e-7542-43bd-a2d8-c487a93b0f21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 19:00:54.527080 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293ef1e-7542-43bd-a2d8-c487a93b0f21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 19:00:54.529165 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293ef1e-7542-43bd-a2d8-c487a93b0f21 service neutron] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 19:00:54.540979 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1458/2906] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 19:00:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 19:01:03.306055 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=74 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 19:01:04.196486 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea781731-4327-451c-a9e5-ff624491bafd service neutron] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 19:01:04.197926 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ea781731-4327-451c-a9e5-ff624491bafd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 19:01:04.263769 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea781731-4327-451c-a9e5-ff624491bafd service neutron] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 19:01:04.268480 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3732730-775d-4503-8b2c-ae5671447a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 19:01:04.269348 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3732730-775d-4503-8b2c-ae5671447a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 19:01:04.269632 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3732730-775d-4503-8b2c-ae5671447a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 19:01:04.269908 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3732730-775d-4503-8b2c-ae5671447a8b admin admin] PATH_INFO: `/v3/users/8e3ca26b66be4f5cab84485228ce4252` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 19:01:04.271092 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3732730-775d-4503-8b2c-ae5671447a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e3ca26b66be4f5cab84485228ce4252)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 19:01:04.273141 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3732730-775d-4503-8b2c-ae5671447a8b admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 19:01:04.425823 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e3732730-775d-4503-8b2c-ae5671447a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e3ca26b66be4f5cab84485228ce4252'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:04.469116 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e3732730-775d-4503-8b2c-ae5671447a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e3ca26b66be4f5cab84485228ce4252'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:04.482029 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e3732730-775d-4503-8b2c-ae5671447a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e3ca26b66be4f5cab84485228ce4252'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:04.489504 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e3732730-775d-4503-8b2c-ae5671447a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e3ca26b66be4f5cab84485228ce4252'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:04.490153 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-e3732730-775d-4503-8b2c-ae5671447a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e3ca26b66be4f5cab84485228ce4252'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:04.496095 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1449/2907] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 19:01:04 2022] DELETE /identity/v3/users/8e3ca26b66be4f5cab84485228ce4252 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 19:01:04.535787 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=6 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 19:01:04.748301 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293ef1e-7542-43bd-a2d8-c487a93b0f21 service neutron] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 19:01:04.761325 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293ef1e-7542-43bd-a2d8-c487a93b0f21 service neutron] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 19:01:04.817817 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1198140-5c67-436c-a8ff-3e51b36a0263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 19:01:04.822871 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198140-5c67-436c-a8ff-3e51b36a0263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 19:01:04.822871 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198140-5c67-436c-a8ff-3e51b36a0263 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 19:01:04.822871 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1198140-5c67-436c-a8ff-3e51b36a0263 admin admin] PATH_INFO: `/v3/projects/4fc8b638d0644da8931adbf4ca0229e0` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 19:01:04.822871 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1198140-5c67-436c-a8ff-3e51b36a0263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc8b638d0644da8931adbf4ca0229e0)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 19:01:04.822871 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1198140-5c67-436c-a8ff-3e51b36a0263 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 19:01:04.910339 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-b1198140-5c67-436c-a8ff-3e51b36a0263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc8b638d0644da8931adbf4ca0229e0', 'request_id': 'req-b1198140-5c67-436c-a8ff-3e51b36a0263'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:04.972150 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-b1198140-5c67-436c-a8ff-3e51b36a0263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc8b638d0644da8931adbf4ca0229e0', 'request_id': 'req-b1198140-5c67-436c-a8ff-3e51b36a0263'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:04.977925 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-b1198140-5c67-436c-a8ff-3e51b36a0263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc8b638d0644da8931adbf4ca0229e0', 'request_id': 'req-b1198140-5c67-436c-a8ff-3e51b36a0263'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:04.989164 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-b1198140-5c67-436c-a8ff-3e51b36a0263 admin admin] The token cache is being invalidate because project 4fc8b638d0644da8931adbf4ca0229e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 19:01:04.989392 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-b1198140-5c67-436c-a8ff-3e51b36a0263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:04.990025 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-b1198140-5c67-436c-a8ff-3e51b36a0263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:04.991584 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1459/2908] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 19:01:04 2022] DELETE /identity/v3/projects/4fc8b638d0644da8931adbf4ca0229e0 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 19:01:04.995607 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3732730-775d-4503-8b2c-ae5671447a8b admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 19:01:04.997014 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-e3732730-775d-4503-8b2c-ae5671447a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 19:01:05.010106 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3732730-775d-4503-8b2c-ae5671447a8b admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 19:01:05.065572 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45bd24-cfef-40b7-8030-dcc48640ac61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 19:01:05.066441 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45bd24-cfef-40b7-8030-dcc48640ac61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 19:01:05.066728 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45bd24-cfef-40b7-8030-dcc48640ac61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 19:01:05.067011 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45bd24-cfef-40b7-8030-dcc48640ac61 admin admin] PATH_INFO: `/v3/users/fd53de9596454762a1f62156f69a8d7b` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 19:01:05.068244 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45bd24-cfef-40b7-8030-dcc48640ac61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd53de9596454762a1f62156f69a8d7b)` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 19:01:05.070220 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45bd24-cfef-40b7-8030-dcc48640ac61 admin admin] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 19:01:05.092895 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 19:01:05.265271 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ab45bd24-cfef-40b7-8030-dcc48640ac61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd53de9596454762a1f62156f69a8d7b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:05.343505 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ab45bd24-cfef-40b7-8030-dcc48640ac61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd53de9596454762a1f62156f69a8d7b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:05.356307 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ab45bd24-cfef-40b7-8030-dcc48640ac61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd53de9596454762a1f62156f69a8d7b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:05.363358 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ab45bd24-cfef-40b7-8030-dcc48640ac61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd53de9596454762a1f62156f69a8d7b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:05.364066 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.notifications [None req-ab45bd24-cfef-40b7-8030-dcc48640ac61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd53de9596454762a1f62156f69a8d7b'} {{(pid=86869) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:05.370016 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1450/2909] 10.222.0.36 () {58 vars in 1223 bytes} [Mon Jun 27 19:01:04 2022] DELETE /identity/v3/users/fd53de9596454762a1f62156f69a8d7b => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 19:01:05.608407 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1198140-5c67-436c-a8ff-3e51b36a0263 admin admin] Authenticating user token {{(pid=86870) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 19:01:05.610537 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.fernet_utils [None req-b1198140-5c67-436c-a8ff-3e51b36a0263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86870) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 19:01:05.624268 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1198140-5c67-436c-a8ff-3e51b36a0263 admin admin] Validating token access rules against request {{(pid=86870) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 19:01:05.681999 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9bfa44-0b3e-45a2-b636-acd801b360e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c8d6148460c64b19ad3d5930db893c77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f3d89cc168b4f4880cd82876788b05f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86870) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 19:01:05.682867 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bfa44-0b3e-45a2-b636-acd801b360e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 19:01:05.683189 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bfa44-0b3e-45a2-b636-acd801b360e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 19:01:05.683473 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9bfa44-0b3e-45a2-b636-acd801b360e2 admin admin] PATH_INFO: `/v3/projects/d4b12f6282454202bb0f4871ead214ee` {{(pid=86870) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 19:01:05.684696 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bfa44-0b3e-45a2-b636-acd801b360e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b12f6282454202bb0f4871ead214ee)` {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 19:01:05.686608 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9bfa44-0b3e-45a2-b636-acd801b360e2 admin admin] RBAC: Authorization granted {{(pid=86870) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 19:01:05.794811 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 19:01:05.807324 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa9bfa44-0b3e-45a2-b636-acd801b360e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b12f6282454202bb0f4871ead214ee', 'request_id': 'req-aa9bfa44-0b3e-45a2-b636-acd801b360e2'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:05.909533 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa9bfa44-0b3e-45a2-b636-acd801b360e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b12f6282454202bb0f4871ead214ee', 'request_id': 'req-aa9bfa44-0b3e-45a2-b636-acd801b360e2'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:05.915336 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa9bfa44-0b3e-45a2-b636-acd801b360e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b12f6282454202bb0f4871ead214ee', 'request_id': 'req-aa9bfa44-0b3e-45a2-b636-acd801b360e2'} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:05.927187 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa9bfa44-0b3e-45a2-b636-acd801b360e2 admin admin] The token cache is being invalidate because project d4b12f6282454202bb0f4871ead214ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86870) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 27 19:01:05.927472 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa9bfa44-0b3e-45a2-b636-acd801b360e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:05.928124 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG keystone.notifications [None req-aa9bfa44-0b3e-45a2-b636-acd801b360e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86870) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 27 19:01:05.929649 dv-cinder-844601-6-smb devstack@keystone.service[86870]: [pid: 86870|app: 0|req: 1460/2910] 10.222.0.36 () {58 vars in 1232 bytes} [Mon Jun 27 19:01:05 2022] DELETE /identity/v3/projects/d4b12f6282454202bb0f4871ead214ee => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 27 19:01:15.366484 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 19:01:16.103831 dv-cinder-844601-6-smb devstack@keystone.service[86870]: DEBUG dbcounter [-] [86870] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86870) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 19:03:58.578451 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45bd24-cfef-40b7-8030-dcc48640ac61 admin admin] Authenticating user token {{(pid=86869) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 27 19:03:58.579891 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-ab45bd24-cfef-40b7-8030-dcc48640ac61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 19:03:58.722218 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45bd24-cfef-40b7-8030-dcc48640ac61 admin admin] Validating token access rules against request {{(pid=86869) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 27 19:03:58.779620 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ffbfc8-d003-403e-879b-d9706959dad2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af6ef16884604753972c916f74271f42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94dba2006b6747f8badff33745bde432', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86869) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 27 19:03:58.780193 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffbfc8-d003-403e-879b-d9706959dad2 service placement] REQUEST_METHOD: `GET` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 27 19:03:58.780475 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffbfc8-d003-403e-879b-d9706959dad2 service placement] SCRIPT_NAME: `/identity` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 27 19:03:58.780747 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ffbfc8-d003-403e-879b-d9706959dad2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86869) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 27 19:03:58.782496 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.fernet_utils [None req-f3ffbfc8-d003-403e-879b-d9706959dad2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86869) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 27 19:03:58.793228 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffbfc8-d003-403e-879b-d9706959dad2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 27 19:03:58.795313 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ffbfc8-d003-403e-879b-d9706959dad2 service placement] RBAC: Authorization granted {{(pid=86869) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 27 19:03:58.805054 dv-cinder-844601-6-smb devstack@keystone.service[86869]: [pid: 86869|app: 0|req: 1451/2911] 10.222.0.36 () {60 vars in 1365 bytes} [Mon Jun 27 19:03:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 27 19:04:08.800966 dv-cinder-844601-6-smb devstack@keystone.service[86869]: DEBUG dbcounter [-] [86869] Writing DB stats keystone:SELECT=89 {{(pid=86869) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}